We have a list of URLs in excel
We need a Crawler (that will crawl the whole list ) on a fixed schedule
We will set the frequency from back end
We need :
ID number to each file
ALL the files of those URL's stored in a new DB ,we will set manually what file types we will choose (file type (PDF,DOC,HTML,IMGAES,OFFICE FILES,- all the versions )
ALL links to the file
The file links on the main site.
17 freelance ont fait une offre moyenne de 119 $ pour ce travail
I have relevant c# experience in making windows forms and console applications, extracting the data from the web, and writing this information to a database.