Web scraper using [login to view URL]

For a project that I'm currently working on as a web developer, we need to build a database of products available in the online market. We chose to scrape Amazon and get the products with their details and pictures.

So here is the requirement:

You would write a piece of software that will:

1. Scrape [url removed, login to view]

2. Get into each department link and the sub-categories all the way down until you see the filters, and thats when you see the product list

3. Scrape first 5 pages in there and get the product details. For now, we need only the product name, short description, and the pictures. Do the same through all the departments and subcategories until our storage crashes :)

4. The scraped details will go into a MySql database and the pictures go into Amazon S3 cloud storage. I'll provide the details of S3 when the work begins.

The tool we prefer to use is noodle ([url removed, login to view]). Because of this, the time to write the software will reduce drastically.

Looking for somebody with excellent demonstrable experience in nodejs, not in writing web apps with nodejs (we have developers to do that), but in writing complex pieces.

Please apply only if you have experience and are confident that you can finish this software in less than a week, because we need this done ASAP, otherwise we would do it ourselves.

Compétences : node.js

en voir plus : writing web apps in go, work online web developer, work online as web developer, working online web developer, working online as web developer, web developers list, web developer requirement, web developer market, web developer com nodejs, web developer apps, web developer apply, web apps for web developers, using in writing, requirement of a web developer, piece of software for short, online work web developers, online work for web developers, online web developer tool, need web developers online, need a nodejs developer, js products, js developers, i m a web developer, go noodle, get a web developer

Concernant l'employeur :
( 4 commentaires ) West Drayton, United Kingdom

Nº du projet : #8483982

5 freelance font une offre moyenne de £168 pour ce travail


Hi, I haven't used [login to view URL] but have good experience in web scraping with Ruby. I have scraped Amazon few times. You can see my profile for that. Have experience using Tor, Proxies, User agent switching and IP rotatio Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% GBP en 2 jours
(1 Évaluation)

Hello,sir I've read your job description and understood your requirements. As I am a senior node.js and mongodb expert, I am very interested in your project. I've many experiences and strong skills for 7 years. By Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% GBP en 7 jours
(0 Commentaires)

A proposal has not yet been provided

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% GBP en 3 jours
(0 Commentaires)

Ainda não foi fornecida uma proposta

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% GBP en 5 jours
(0 Commentaires)

Hello, I have been working in IT industry for more than 3 years. I am a MEAN stack developer. My 3 years developing experience is mainly in Node.js/Angular.js/Express.js/Mongodb. I have been working as a lead no Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% GBP en 5 jours
(0 Commentaires)