The Project is to develop an online web crawler that will do the following:
- Receive a website to crawl.
- Crawl to website for URLs of other sites featured on it and its pages.
- Open these sites and crawl them for more URLs.
- Output should be a list of websites that are connected to the first site or linking to it and websites that are connected to it in several levels deeper.
Should be a very simple Web interface.