Fermé

Web scraper using [url removed, login to view]

For a project that I'm currently working on as a web developer, we need to build a database of products available in the online market. We chose to scrape Amazon and get the products with their details and pictures.

So here is the requirement:

You would write a piece of software that will:

1. Scrape [url removed, login to view]

2. Get into each department link and the sub-categories all the way down until you see the filters, and thats when you see the product list

3. Scrape first 5 pages in there and get the product details. For now, we need only the product name, short description, and the pictures. Do the same through all the departments and subcategories until our storage crashes :)

4. The scraped details will go into a MySql database and the pictures go into Amazon S3 cloud storage. I'll provide the details of S3 when the work begins.

The tool we prefer to use is noodle ([url removed, login to view]). Because of this, the time to write the software will reduce drastically.

Looking for somebody with excellent demonstrable experience in nodejs, not in writing web apps with nodejs (we have developers to do that), but in writing complex pieces.

Please apply only if you have experience and are confident that you can finish this software in less than a week, because we need this done ASAP, otherwise we would do it ourselves.

Compétences : node.js

Voir plus : writing web apps in go, work online web developer, work online as web developer, working online web developer, working online as web developer, web developers list, web developer requirement, web developer market, web developer com nodejs, web developer apps, web developer apply, web apps for web developers, using in writing, requirement of a web developer, piece of software for short, online work web developers, online work for web developers, online web developer tool, need web developers online, need a nodejs developer, js products, js developers, i m a web developer, go noodle, get a web developer

Concernant l'employeur :
( 4 commentaires ) West Drayton, United Kingdom

N° du projet : #8483982

5 freelance font une offre moyenne de £168 pour ce travail

prem89k

Hi, I haven't used [url removed, login to view] but have good experience in web scraping with Ruby. I have scraped Amazon few times. You can see my profile for that. Have experience using Tor, Proxies, User agent switching and IP rotatio Plus

150 £ GBP en 2 jours
(1 Commentaire)
2.9
ZhangWei99

Hello,sir I've read your job description and understood your requirements. As I am a senior node.js and mongodb expert, I am very interested in your project. I've many experiences and strong skills for 7 years. By Plus

166 £ GBP en 7 jours
(0 Commentaires)
0.0
manisharatnapala

A proposal has not yet been provided

150 £ GBP en 3 jours
(0 Commentaires)
0.0
brun0ventur4

Ainda não foi fornecida uma proposta

150 £ GBP en 5 jours
(0 Commentaires)
0.0
nawaztahir

Hello, I have been working in IT industry for more than 3 years. I am a MEAN stack developer. My 3 years developing experience is mainly in [url removed, login to view] I have been working as a lead no Plus

222 £ GBP en 5 jours
(0 Commentaires)
0.0