We are looking for a developer to develop a KW scraping software. Here's how it will work.
1. We will give the program a CSV file, it has a list of keywords (about 50k). The software will take one KW from this list, and then input it at Google Adwords Keyword Research Tool ([login to view URL]). The keyword is then removed from the original list.
2. It then saves the results from Adwords Keyword Research Tool (in .csv or whatever) and then eliminates results with less than 2,400 EXACT searches. This number can be changed by me as well. In this step, any KW that consists of more than 4 words will be removed.
3. It then takes one by one the KW from Step 2 and do allintitle search on Google.
Any allintitle searches that returns less than 10k or 5k results will be saved in a spreadsheet.
4. The keyword from (3) above will then be fetched one by one for a Google search. The top 10(first page) result will then be analyzed, if there is more than 2 sites with PR of none or 0, then the KW will be placed in a final spreadsheet.
5. The software needs to be able to solve captcha using [login to view URL] API.
6. The software needs to be able to use a list of proxy that I will provide.
Then if it doesn't cost too much more (optional)
7. [login to view URL] scrape the advertisers and cost/click
8. EDM check - eg: if kw is small washing machine, check if [login to view URL] .com .org are available