I got a python webcrawler/scraper written using phantomjs and such but has to be modified to better solution maybe "requests". I would need someone who can optimize this with a short notice, preferably within some hours. And that can operate the script on servers provided by me, or if you would like to set it up yourself I can compensate for that depending on the price for it. Today the scraper can retrieve about 2500-3000 items an hour, and there is about 300 000 items. I would need this in three days, maybe four. The script I got might have som bugs as it is not the latest version. So if there is some improvements that can be done, and of course running multiple instances on the same/different server. What ever works for me. But I would like to be operating the server, and making sure everything is running.
Please note that it cannot be written in PHP.
Hope someone will be interested.
27 freelance font une offre moyenne de $495 pour ce travail
Hi, I can help you fixing your script and I can also use my resources to get your data within 1 day, not 3-4 :) let me know what site you scraping so I'll estimate how much that will cost. Thanks
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
Hello I can try to help you. But I need more details. I have an experinence of creating python scripts to extract data from various websites. Waitng for your response.
Python developer. Have experience in parsing sites using various technologies : BeautifulSoup,Selenium etc. Please provide me the url of the site so I can look if I can make your script running faster.
Hello, scraper programs need constant update (as u'r facing the issue) thus my offer is only ondemand updated data, no program. If interested, details please.
hello : python will be used as you like . i have done crawler with python + scrapy + selunium etc .. maybe you can let take a look at the script to see if i could do it. btw , my skill is python2 ty