I need a script that will access a website, and iterate through a number of log pages that are organized by date. For each such log type, it should save a file with all of the entries sequentially by date. In addition, it should save one combined file for all of the log types, where the log entries are merged across all of the different log types, and sorted by each entry's datetime. So each entry will appear twice: once in the merged log file, and once in the specific log type file. The script should accept as input the oldest date from which to capture the log entries, as well as a few keywords. The keywords will be used for first running a search per each log type and only scraping logs which contains at least 1 of the keywords.
The website requires authentication, so it may be a good idea to use something like [url removed, login to view] with Firefox where I can log in manually and then fire the script. But I'm open to other implementation approaches.
As part of this project, you'll need to thoroughly test your script. This will include setting up yourself some free account on this website and creating some activity that will generate such logs that you can use for verifying that the script works 100% as it should, before submitting it to me for acceptance testing. The code itself should be of good quality, easily readable, annotated, and making plenty of assertions with descriptive error messages so that I can easily tweak it in the future if the website makes some minor changes to how it works (e.g. if the id of some key DOM element there changes)
In order to help me filter spam bids, please answer the following question at the very top of your bid message:
What do you think about using Marionette client for this project? If you prefer not to use it, what alternative tool/framework/modules would you prefer?
Also, I need this done quite quickly so please indicate how soon you think you can finish it.