Special purpose search bot

First of all the choice of Mysql is just so I don't have to say I don't know. The need is for a custom search bot that will return intelligence for a specific company or companies. The information is in this case is hypothetical. You have company in a competitive business and need to gather information in a variety of languages regarding announcements, forum postings and other available information regarding your product or class of products. You would need the ability to tune the bot to learn from experience etc. There would need to be a web interface to do the admin work. This project should start with an open source base and I can point out several but won't for obvious reasons. Interested in proposals and qualifications.