En cours

Products crawler several web sites into mySQL DB

We need products crawler into mySQL DB

Crawl the following 7 web sites

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

and save product data into mySQL Database with the following structure:

--

-- Create schema products_crawling

CREATE DATABASE IF NOT EXISTS products_crawling;

USE products_crawling;

-- Definition of table `products`

DROP TABLE IF EXISTS `products`;

CREATE TABLE `products` (

`website_product_id` int(10) unsigned NOT NULL AUTO_INCREMENT,

`website` varchar(80) NOT NULL,

`website_product_url` varchar(500) NOT NULL,

`product_category` varchar(250) NOT NULL,

`product_sku` varchar(40) NOT NULL,

`product_model` varchar(40) NOT NULL,

`product_features` text NOT NULL,

`product_name` varchar(200) NOT NULL,

`product_description` text NOT NULL,

`product_overview` text NOT NULL,

`product_specification_text` text NOT NULL,

`product_specification_html` text NOT NULL,

`product_manufacturer_warranty` varchar(40) NOT NULL,

`product_manufacturer_website_url` varchar(500) NOT NULL,

`product_manufacturer_website_support_url` varchar(500) NOT NULL,

`product_manufacturer_website_product_url` varchar(45) NOT NULL,

`product_brochure1` varchar(150) NOT NULL,

`product_brochure2` varchar(150) NOT NULL,

`product_brochure3` varchar(150) NOT NULL,

`product_brochure4` varchar(150) NOT NULL,

`product_video_url` varchar(250) NOT NULL,

`product_image_path1` varchar(150) NOT NULL,

`product_image_path2` varchar(150) NOT NULL,

`product_image_path3` varchar(150) NOT NULL,

`product_image_path4` varchar(150) NOT NULL,

`product_image_path5` varchar(150) NOT NULL,

`product_stock_level` varchar(20) NOT NULL,

`product_price` float NOT NULL,

`product_rrp` float NOT NULL,

`product_created_ts` datetime NOT NULL,

`product_updated_ts` datetime NOT NULL,

`product_status_cd` smallint(5) unsigned NOT NULL,

PRIMARY KEY (`website_product_id`)

) ENGINE=MyISAM DEFAULT CHARSET=latin1;

Product Categories must be saved on MySQL DB in the following format Category > SubCategory > SubSubCategory…

Product images must be downloaded into separate folders for each web site and image paths should be saved on MySQL DB.

Product video URLs must be saved on MySQL DB

Crawler must have 2 modes:

Full – each products details information crawled and stored on DB

List – all categories crawled and only stock level and price stored on DB for all existing products and for new products stored information only available from the List.

Compétences : MySQL, PHP

Voir plus : mysql db, key data structure, definition of data structure in c, data structure definition, create products, create category and subcategory in php, product crawler definition, stock categories, definition of format, definition format, website crawler, products video, price crawler, null, float, drop the products, db, database crawler, data crawler, create web sites, crawler, mysql estore, web data crawler, mysql create database engine, mysql structure

Concernant l'employeur :
( 13 commentaires ) Lawnton, Australia

N° du projet : #1029269

Décerné à :

MrSawy

5-8 days, thanks for inviting me....

400 $ USD en 8 jours
(3 Commentaires)
3.6

22 freelance ont fait une offre moyenne de 530 $ pour ce travail

SigmaVisual

We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

450 $ USD en 10 jours
(241 Commentaires)
7.8
gopalvora

Hi please check pmb for more detail Thanks

250 $ USD en 5 jours
(221 Commentaires)
7.1
humashahid80

Hi, Immediately ready for your work, please check PM for details.

600 $ USD en 15 jours
(55 Commentaires)
6.9
mitrasubir

Lets start ...

750 $ USD en 21 jours
(36 Commentaires)
6.6
MAnkita

Hello,Please refer your [url removed, login to view] you.

600 $ USD en 10 jours
(50 Commentaires)
6.5
ashisha100

Please check PMB for details.

500 $ USD en 10 jours
(23 Commentaires)
6.2
wildlily980

I can do this.

490 $ USD en 9 jours
(41 Commentaires)
6.1
inzaghi2006

I'm EXPERT in GATHERING DATA from website. Please view PM

395 $ USD en 10 jours
(89 Commentaires)
6.0
priboy

Please check PMB

800 $ USD en 10 jours
(9 Commentaires)
5.6
getndone

Please check pm

450 $ USD en 7 jours
(41 Commentaires)
5.5
softwarevamp

Hello, ready to start!

450 $ USD en 5 jours
(24 Commentaires)
5.1
tomkus

Hi! I am interested in your project. Please check your PM. Thanks!

750 $ USD en 15 jours
(2 Commentaires)
3.6
sunsriinfosys

Hi, I have over 12 years of Experience in software design, development and implementation of various commercial applications in Client/Server environment, Web and ERP applications using C# 1.1/2.0/3.5, ASP.Net, VB.N Plus

400 $ USD en 5 jours
(7 Commentaires)
3.6
rajeev0507

I am ready...

300 $ USD en 7 jours
(2 Commentaires)
3.4
Kavi76

HI, Pls check your mail box. Thanks, Kavitha.

500 $ USD en 7 jours
(1 Commentaire)
2.9
JaminCollins

I have extensive experience using regular expressions to retrieve data from external sources. I can provide you with a modular and maintainable solution that fits your needs.

700 $ USD en 8 jours
(0 Commentaires)
0.0
palinfotech

we have a team of 25 members with expertise in their profession. We have made a similar kind of projects. For further information please view your PMB. Ready to work with you Regards

390 $ USD en 5 jours
(0 Commentaires)
0.0
yehia111111

Hi sir, please check your PMB

300 $ USD en 8 jours
(0 Commentaires)
1.7
Datacrops

Dear Sir, Please see PM. Regards, Chandni

1400 $ USD en 7 jours
(0 Commentaires)
3.8
fouraxiz

pls see my PMB

280 $ USD en 15 jours
(0 Commentaires)
0.0