Web Scraper for Google Trends website

Google Trends scraper which runs on a pre-defined time interval to fetch fresh data.

1. I need a web scraper for Google Trends website which runs frequently over the 30m/1hr interval and collects Google trends (keywords and details) for the given country. For each keyword, its related news links and region score is to be collected. The region-specific score for each keyword is shown on the individual keyword's detail page on Google Trends website.

2. For each keyword identified in the Google trend, corresponding Google search result data needs to be collected (news, video links, twitter, web links).

3. The requirement includes source code and deploying the program with scheduling for periodic scrapper run. Deployment it over Scrapy Cloud or Azure Virtual Server. Provision for IP blocking to be included.

Please share your technical recommendation/suggestion, if any. And please feel free to ask for any clarification, if required.

Please provide cost and effort estimate.

Best Regards

Python Web Scraping

Nº du projet : #19326401

À propos du projet