Scrape and download files from a list of URL's

We have a list of URLs in excel We need a Crawler (that will crawl the whole list ) We will set the frequently from back end We need : ID number to each file ALL the files of those URL's stored in a new DB ,we will set manually what file types we will choose (file type (PDF,DOC,HTML,IMGAES,OFFICE FILES,- all the versions ) ALL links to the file All the mother site link