Annulé

2 Web Data Scrapers

Hi, I need 2 data scrapers. ========================================================== Data Scraper 1, 2 URLs to scrap data from [url removed, login to view] [url removed, login to view] From the URLs, you will collect the property listing IDs. Example, 18956450 19333978 17056636 ** The property listing ID appears on the 5,000 listings page itself. No need to visit each listing one by one to get the listing ID ** [url removed, login to view] (90,000+ property listing IDs) [url removed, login to view] (60,000+ property listing IDs) Output should be in csv. ========================================================== Data Scraper 2, Using the output from Data Scraper 1, we should make up URLs like these, [url removed, login to view] [url removed, login to view] [url removed, login to view] With those URLs, we will get the JSON file of each property listing. We will use the JSON file to extract the data i need. The data i need can be found in the attached CSV. ([url removed, login to view]) I will need the text data (csv) and the corresponding images/pdfs in the csv to be downloaded. ========================================================= Since there are 140,000 listings. Using a desktop application can be extremely slow. I am open to other methods which will allow me to gather the data and images asap. Maybe, hosting the scraper script on AWS or any other method which you may suggest for greater speed in extracting the data - multi-threading/proxies/hosting script on server and etc. Kindly let me know your plan of action in your proposal. Don't send in ready-made proposals as i will immediately remove them. Thank You.

Compétences : Web Scraping

Voir plus : gather online data web, data web macro, data web page, extract data web site, address data web site

Concernant l'employeur :
( 69 commentaires ) Singapore, Singapore

N° du projet : #8475770

1 freelance a fait une offre moyenne de 200 $ pour ce travail

shivamsoni95

I am a hard working, communicative, and dedicated person looking forward to be hired for any data entry, writing, or web development task. I have huge experience working as a data entry operator. You will find me very Plus

200 $ USD en 2 jours
(3 Commentaires)
2.0