Develop 5 Scrapy spiders.

We have a Scrapy project already working on a Linux Server, extracting data from several e-commerce sites, and we need add 5 spiders more.

The site names will be showed after project acceptance.


1) The code should be integrated to a existent project.

2) The spider must store data in to a mongodb (already created).

The field to store are:



id (unique by site)




timestamp (date when the product is updated)

3) Before store an item to Db, you should verify if this same product already exist, if not, you should insert a new one, if yes you should update the existent. The way to know that is by, id and site_name.

4) One of the sites, requires signing before browse the catalog, the spider must manage this logging.

The project payment will be divided in 5 hitos. We consider as the final of each one, the end of crawling of one site.

All the web sites are in Spanish language.

Compétences : Linux, NoSQL Couch & Mongo , Python, UNIX, Web Scraping

en voir plus : scraping e commerce web, scrapy spiders, oscommerce insert photos item, insert content html, insert flv swf, develop shoutcast apps, insert html flash, develop fantasy football program aspnet, develop inventory management projects, exist access sqlexpress dbnetlib, insert current date hidden field php mysql

Concernant l'employeur :
( 3 commentaires ) Montevideo, Uruguay

Nº du projet : #8465031

Décerné à:


Hello. I'm ready to work. I'm ready to work.I'm ready to work.I'm ready to work.I'm ready to work.I'm ready to work.

%selectedBids___i_sum_sub_7% %project_currencyDetails_sign_sub_8% USD en 3 jours
(41 Commentaires)

14 freelance font une offre moyenne de $230 pour ce travail


Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(106 Commentaires)

A proposal has not yet been provided

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(26 Commentaires)

A proposal has not yet been provided

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(24 Commentaires)

I have performed similar work recently, so I will be able to deliver quickly. I am currently 100% available. I am a linux, python, scrapy and mongodb expert.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(7 Commentaires)

Hello! I've had relevant experience, which is necessary to complete your project. In general it's clear what is necessary to do, but I'd like to get more details about existent infrastructure: 1. Are your spiders alre Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(8 Commentaires)

Hello, I have a lot of knowledge and experience for this job. If You hire me this project will be done efficiently and fast. Feel free to contact me if You have any questions. Kind regards, Nino Rasic

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 4 jours
(3 Commentaires)

Hi, I have done 4 scrapping projects and got 5 starts. Please check my profile. I can deliver faster scrapper. Hope I would be your choice. Thank you Regards Vikas

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 4 jours
(6 Commentaires)

hello , sir : i have strong skills on c/c++ & python , worked for samsung & huawei . Now I am woking on SDN with c++ and crawler with python i am familiar with scrapy & mongodb , maybe you could t Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(4 Commentaires)

Dear sir, I am ready to do your job.I am highly interested to do it with Regular updates,timely delivery with 100% [login to view URL] can trust me . I am promised to give you high quality work. My work will help you to comp Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(9 Commentaires)

Hello, I'm a Python programmer with various experience working with web scrapper. My last project was making a product scraper from beadsofcambay.com. I'm also familiar with working in UNIX environment (SSH, sft Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 6 jours
(2 Commentaires)

Hello i have good experience in making scrappers and bots i made them in PHP and C , it's upto you give me a chance to do that Thanks

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(0 Commentaires)

A proposal has not yet been provided

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 2 jours
(0 Commentaires)

Worked on mongodb with python for a long time , have knowledge of e-commerce domain . Like to work on data crawling part in my spare time.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(0 Commentaires)

HI, I have similar project written in python script for [login to view URL] where we need to extract all data for that CIN number and store it in mysql database. I c Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(1 Évaluation)