Webcrawler/scraper written using phantomjs help


I got a python webcrawler/scraper written using phantomjs and such. I would need someone who can optimize this with a short notice, preferably within some hours. And that can operate the script on servers provided by me, or if you would like to set it up yourself I can compensate for that depending on the price for it. Today the scraper can retrieve about 2500-3000 items an hour, and there is about 300 000 unique items total with duplicates it is around 16 million rows in csv. I would need this in less then three days, maybe three. The script I got might have som bugs as it is not the latest version. So if there is some improvements that can be done, and of course running multiple instances on the same/different server. What ever works for me. But I would like you to be operating the server, and making sure everything is running.

Hope someone will be interested.

Compétences : Javascript, MySQL, PHP, Architecture Logicielle, Web Scraping

en voir plus : using web scraper aspnet, scrape google using google scraper websites, help using sabre web services php, using mysql distinct select latest time, help using dreamweaver build website scratch, report viewer help using aspnet, using site scraper, using web scraper, help using revolution wordpress

Concernant l'employeur :
( 30 commentaires ) Stockholm, Sweden

Nº du projet : #8494433

2 freelance font une offre moyenne de $181 pour ce travail


Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(230 Commentaires)

Nie złożono jeszcze oferty.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(60 Commentaires)

I'm a web scraper/extractor specialist. I work with my own python scripts and with known frameworks such as scrapy and selenium webdriver with chromedriver and also phanthomJS. I've worked in a similar project, setti Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(2 Commentaires)