Migrating data from old site to new template

[thebigkick]

So I'm not all that familiar with ZenCart (or sql databases for that matter) but I"m learning fast (I come from Wordpress and Joomla). I was hired to help out with some front-end UI work but have been asked to do much more. Basically, we are trying to migrate a very large, very outdated, and very poorly maintained site over to a new install (12/15/2011) of ZenCart with a fresh new template and hosting space.

The data migration, which was outsourced to an experienced ZenCart guy and true code monkey, went well. Although we are having trouble on how to migrate over the product info that was logged into the WYSIWYG editor from the old site. The stuff that resides in HTML. The product descriptions, model numbers, image tags and other additional product info that wasn't logged in using the ZenCart admin fields are located inside HTML tables that were built in the TinyMCE.

We are at a loss as to how we are going to get that info logged into the new site. Anyone here have a solution. We are just afraid that we may have to log in over 700 products manually (which is probably the answer but we're just not ready to accept it). Any help would be much appreciate.

Regards.

[schoolboy]

This can be done - but will involve several "stages".

Stage One will involve "scraping" or "grabbing" all the current product data off the old site. If it is in HTML format, you could look for a script that will "scrape" the text off each HTML page, and put it into a format that removes the HTML, but retains the text.

The data could then be saved (one product per page) as a MS-Word file, for example.

Then, you need to go through the pages and get the formatting consistent. The "scraper" tool may have done this for you, to a greater or lesser extent. By "formatting" I mean the position of each text element in relation to others.

Ideally, each "page" should look something like this:

Product Code
[paragraph space]
Product Image Name
Product Name
[paragraph space]
Product Description Text (could be several sentences)
[paragraph space]
Product Price (just digits - no currency symbol)
[paragraph space]
EOR (End of Record Marker)

The End Of Record marker is important, as it will allow you to later DELIMIT each product aand create a TABBED TABLE - each row being one product data-set. You will probably need to insert EOR manually after each product record. You will see why this is important later...

So, a TYPICAL MS-Word page for each product could liik like:

----------------------------------------------------------

A10292 (product code)

brownshoes.jpg (product image)

Brown Leather Shoes (product name)

These fantastic brown leather shoes are a must for any fashion-conscious man. Wear them casually, or at any formal occasion. Impress the ladies with your stylish feet. (product description)

35.99 (product price)

EOR (End of Record Marker)

----------------------------------------------------------

Stage Two will require CONVERTING the text in the pages to a TABLE. So, using MS REPLACE function, you need to REPLACE paracraph marks with tabs.

In MS-Word, the symbol for PARAGRAPH in the replace function is ^p.

In MS-Word, the symbol for TAB in the replace function is ^t.

So... you REPLACE all instances of ^p with ^t .

Now... your EOR MARKER comes into play...

Using the same REPLACE function, REPLACE all instances of EOR with ^p .

This will put a LINE BREAK after each product data-set.

You will now have each product data set in a row of TABBED elements, with each data-set separated with a LINE BREAK (paragraph mark).

STAGE THREE
This involves using MS-Word TEXT-TO-TABLE function, where you convert the text to a TABLE. Different versions of MS-Word act differently, but the key is to highlight ALL the text on ALL the pages, and then using the TEXT To TABLE feature, you place all the product data elements into ordered table cells.

You will then have a TABLE of all your product data, with each ROW being a PRODUCT data-set, and each COLUMN being specific to the data types (eg: Column one should be all the product codes going down the page... Column two should be all the Product Image names going down the page... etc...


STAGE FOUR.

Highlight the entire TABLE, copy it, and PASTE it into MS-Excel.

You will now have the data in a SPREADSHEET, allowing you to add/edit it in a much more manageable fashion.


STAGE FIVE.

Install Easy Populate Version 1.2.5.4 into your webshop. (NOT SURE IF THIS IS COMPATIBLE WITH NEW ZC Ver 1.5 !!!)

Read My WIKI: http://www.zen-cart.com/wiki/index.php/Easy_Populate


STAGE SIX
Once you are familiar with Easy Populate, ALTER your spreadsheet to suit the Product Fields available to you.


STAGE SEVEN
Use easy Populate to IMPORT your product data into the store.

--------------------------------------------------

We have had to undertake this numerous times over the years, and while time consuming, is a LOT faster than loading each product manually.

We have used wget as a scraping tool in the past:-
http://sourceforge.net/project/downl...se_mirror=garr

----------------------------------------------------

[schoolboy]

Easy Populate version 4 by Chadd will (he says) work with Zencart 1.5.
SEE: http://www.zen-cart.com/forum/showpo...9&postcount=52

MOD AVAILABLE AT:
https://github.com/chaddro/EasyPopulate-4.0