Hi, as the project name states I need a script that can fetch data from various internet sites where property owners publish available apartments for rental.
Requirements for this scripts:
- It must be able to fetch data from a number of sites from a list that I will supply.
- The fetched raw data about available apartments must be decoded and processed (maybe with help of regular expression? I'm open for any solution as long as it works) into a number of columns, for example "surface area", "number of rooms", "rental fee", "street address", "city", "link to object", "timestamp when object was entered by the property owner", "timestamp when object was removed by the property owner".
- The information processed in previous steps should be stored in a simple database.
- A summary page in PHP with a list of all available apartments for rental. There should be a feature which makes it possible to make different selections for the summary view.
- There should also be a function where you can mark that an object has been taken care of.
- When a new object is fetched that isn't entered in the database before, an e-mail should be sent to a recipient address.
- Most of these summary pages are accessible without the need of any login information.
- One page is behind Recapthca.
- The scripts must be able to run as a cron job.
All this that I have mentioned now is basically what I want. But if you have any ideas on your side, refinements for example that could easily be done for better functionality, I'm open for that.
I'm also more than happy to answer any additional questions that you might have about this assignment.