I need of a distributed web crawler + indexing, that can take care of crawls of any size. For example the crawler must be able to crawl & indexing a single website (few web pages) as well as the whole web (over a billion web pages).
Installation & configuration : Apache Nutch
4 freelance font une offre moyenne de $41 pour ce travail
Hi sir, This is Lin and I am scraping expert, i have checked all details for your project. can we discuss more info then i can provide example data for you? Please message me then we can discuss more ASAP. Tha Plus