Fermé

*Highly* skilled PERL (and mysql) coder needed

This job requires in-depth knowledge of Perl and MySQL, specifically with regards to:

daemons/forking

*extreme* speed in processing strings coming in from a File::Tail process (I can currently process about 5k per second, but need to get it to 30k or so).

In-depth knowledge of DBI (for mysql).

MySQL query analysis - am I using the best queries for the best performance?

The script is an existing script that I need some help on for performance improvements.

It's currently ~600 lines and processes incoming messages to match a regex. If there's a match, some db selects are done as well as comparisons with other table rows followed by updates or deletes.

In addition to all this, there's a load data infile call that loads everything into mysql after a specified amount of time or number of messages.

The current script can do around 5k messages per second (mps) but stays around 90% cpu until the mysql load data pops, then mysql eats ~95% cpu. Once mysql is done, my script spikes up again.

The script does not do any forking currently (it did, but I removed it because it didn't work with my latest additions) so I would like someone that can do something like POE::Component::PreforkDispatch (just an idea, not a requirement)

Requirements:

- Scale beyond 15kmps (would prefer 30kmps if possible)

- Lower CPU/Mem utilization as much as possible

If the scale requirements simply *can't* be accomplished, I would like any creative recommendations to address it.

I am very detail oriented and I expect the bid winner to be the same.

If you're trying to learn and need a challenge, please do not bid on this project. I'm pretty good with Perl/PHP/MySQL, etc. and I need someone that knows more than I do :-)

We can meet via WebEx and I'll be happy to get you familiarized with my project.

I have a dev server available with full ssh access - all I need is someone smarter than me (and I'm sure there are plenty :-))

Compétences : Linux, MySQL, Perl, Script Shell, Administration Système

Voir plus : using regex in c, the best php coder, strings and beyond, regex is, regex in c, regex c, perl get, mysql data access, learn from coder, data challenge, coder project, coder job, challenge s, best php coder, and mysql, perl mysql bid, regex &, job recommendations, requirement analysis, Regex, Poe, mysql query, mysql 4, meet a coder, good dev

Concernant l'employeur :
( 21 commentaires ) Morrisville, United States

N° du projet : #654681

8 freelance ont fait une offre moyenne de 395 $ pour ce travail

Mindon

Check the PM pls

250 $ USD en 5 jours
(85 Commentaires)
6.5
gangabass

I can do this job for you. See PM for details.

250 $ USD en 3 jours
(191 Commentaires)
6.1
sunztech

Please see PMB.

750 $ USD en 10 jours
(4 Commentaires)
5.4
YashpalSingh123

expert computer engineer, Perl/MySql

250 $ USD en 3 jours
(5 Commentaires)
4.3
aitsys

We are a web development company specializing in web application development and customization. We will be happy to start working on your project. Thanks.

560 $ USD en 7 jours
(2 Commentaires)
3.3
amsak

Placing bid

250 $ USD en 14 jours
(7 Commentaires)
3.4
blackcoffee

Hi! Please check your PMB :)

300 $ USD en 3 jours
(2 Commentaires)
1.6
lsdumbrella

may I help?

550 $ USD en 1 jour
(1 Commentaire)
2.0