This is a web scraping project that you may do in either python or perl.
You'll need to set up a scraper that can scrape perform a 3 step process on a website that includes loading some javacript before eventually reaching a final page where the data of interest can be scraped and saved to a mysql DB.
You should be familiar with forking multiple scrapers simultainously, as well as routing the scrapers through Tor.
There needs to be a very barebones web interface to display the data being scraped (absolutely no web design needed here, this is for internal use only).
This will be an ongoing project, and eventually I'd like to set another script that will have you take the scraped data and automatically post it onto another site.
This will all be done on my linux box on AWS.
IF INTERESTED: please respond with how many hours you are able to work per day, and when you can start. Thanks.
15 freelances ont fait une offre moyenne de 19 $ /heure pour ce travail
Hello. I am experienced with web scraping and web automation. I am confident i can help you with this project. Check pmb fo further questions. Regards, -Arthur.