This job requires in-depth knowledge of Perl and MySQL, specifically with regards to:
*extreme* speed in processing strings coming in from a File::Tail process (I can currently process about 5k per second, but need to get it to 30k or so).
In-depth knowledge of DBI (for mysql).
MySQL query analysis - am I using the best queries for the best performance?
The script is an existing script that I need some help on for performance improvements.
It's currently ~600 lines and processes incoming messages to match a regex. If there's a match, some db selects are done as well as comparisons with other table rows followed by updates or deletes.
In addition to all this, there's a load data infile call that loads everything into mysql after a specified amount of time or number of messages.
The current script can do around 5k messages per second (mps) but stays around 90% cpu until the mysql load data pops, then mysql eats ~95% cpu. Once mysql is done, my script spikes up again.
The script does not do any forking currently (it did, but I removed it because it didn't work with my latest additions) so I would like someone that can do something like POE::Component::PreforkDispatch (just an idea, not a requirement)
- Scale beyond 15kmps (would prefer 30kmps if possible)
- Lower CPU/Mem utilization as much as possible
If the scale requirements simply *can't* be accomplished, I would like any creative recommendations to address it.
I am very detail oriented and I expect the bid winner to be the same.
If you're trying to learn and need a challenge, please do not bid on this project. I'm pretty good with Perl/PHP/MySQL, etc. and I need someone that knows more than I do :-)
We can meet via WebEx and I'll be happy to get you familiarized with my project.
I have a dev server available with full ssh access - all I need is someone smarter than me (and I'm sure there are plenty :-))
8 freelance ont fait une offre moyenne de 395 $ pour ce travail
We are a web development company specializing in web application development and customization. We will be happy to start working on your project. Thanks.