Find and resolve HTTP request bottleneck

We have a system which is checking proxy server uptime and experiencing an unexpected result after a recent server change. We need a server administrator that is comfortable with tuning PHP, Apache, PHP-FPM, MySQLi, and CentOS core. You as well need to be fluent with PHP multi-curl to understand how everything is working, in order to successfully resolve this issue for us.

Please note this issue is server config related, not software related.

The system uses PHP multi curl to select 20,000 nodes from the proxies and then process them in batches of 10,000. Requests are sent to our internal judge on the same server which returns information about the node that made the request.

The problem we are experiencing is that we are limited to the 10,000 batch. As we increase the batch amount, it's actually successfully checking less proxies. For example, with the 10,000 batch, the system might return 3,000 proxies that are currently up. If we increase that to a 20,000 batch, the system might find 500 proxies that are currently up, off the same exact data set which is surely not correct

On our previous server we could run batches of 100k without experiencing this type of issue but unfortunately, that administrator is no longer with us.

Any idea of what could be causing this issue for us? We are ready for immediate assistance!

Compétences : PHP, Linux, HTTP, cURL, Administration Système

Concernant l'employeur :
( 0 commentaires ) East Liverpool, United States

Nº du projet : #21844742

46 freelance font une offre moyenne de $34/heure pour ce travail


Dear employer hope you are doing well...Regarding project can we discuss more on this to get detail understanding about project ? As i am having some technical question on this so let me know when you get time to discu Plus

$35 USD / heure
(167 Commentaires)

Hello, We are IT-Engineers and Business Analysts, creating complete web and mobile solutions, for already more than 15 years, supporting our products with custom digital marketing strategies and instruments. Befo Plus

$50 USD / heure
(103 Commentaires)

Dear Employer, Hope you are doing Great..!! I have gone through your job posting and found our skills best suited for the project scope. I would be glad to mention here that we are having team of developers with year Plus

$25 USD / heure
(163 Commentaires)

Hello, As per need, you need to find and resolve HTTP request bottleneck, we have shared our company portfolio please go through it: We have a team of professional Full Stack developers with an experience of more tha Plus

$40 USD / heure
(188 Commentaires)

There is some internal problem with the current server than the previous one. DO you have access to previous server still? Otherwise i need to check your PHP code and apache [login to view URL] and research and fix it. So let m Plus

$30 USD / heure
(343 Commentaires)

<<DALLAS, TX based & AVAILABLE 24X7 TO TALK OVER CALL/CHAT" 8+ Years of experience in Web technologies >> Relevant work experience: [login to view URL] [login to view URL] [login to view URL] Plus

$38 USD / heure
(34 Commentaires)

Hello, I got acquainted with your requirements, I am sure that I can help you with this. The fact is that I am a co-owner of a developer company and I myself am a PHP developer, and I also have administrators who can h Plus

$35 USD / heure
(64 Commentaires)

Hello, I will Find and resolve HTTP request bottleneck. I am very confident to complete this job on high quality of work.I am available 10 am-8 pm YOUR time zone. I'd really like to work with you on this one if possi Plus

$25 USD / heure
(113 Commentaires)

Hi, i'm interested, could you give me more details please? what is the difference between both servers? memory? cpu? are you running the PHP scripts via cron? command line? apache server? did you set the [login to view URL] are Plus

$50 USD / heure
(87 Commentaires)

Hello, My approach would be to first check output of all the request. That way, we can find the error response. From then we can move ahead and take necessary steps. BTW what was your previous server specification and Plus

$40 USD / heure
(30 Commentaires)

Hello there, Thameem here from skynats Technologies to help you. We have read and understood your project requirement and are happy to help you with HTTP request issue. We can start the work now and would require a d Plus

$40 USD / heure
(293 Commentaires)

yes sure I can help you right now

$27 USD / heure
(236 Commentaires)

Hi, how are you ? I have just read your description and I think that I am the proper candidate for this job. As a senior full stack developer, I have over 12 year experience in web and mobile app. In those days, I have Plus

$38 USD / heure
(35 Commentaires)

Hello I read your job post and very interested in your job I am a full stack developer have 7+years experience with Web development Kindly review my works: [login to view URL] [login to view URL] Plus

$38 USD / heure
(32 Commentaires)

Dear Sir/Madam, I checked requirement and i think what you need is : + you need a server administrator that is comfortable with tuning php, apache, php-fpm, mysqli, and centos core + you as well need to be fl Plus

$40 USD / heure
(39 Commentaires)

and I am an expert in skills and My experience is 18 years. My hourly rate:$21/hr for this project. I can easily handle it. and My rate negotiable after discussion I will give you my final rate. message me....

$38 USD / heure
(24 Commentaires)

Validcode is a dynamic and fast-moving company in Web/Mobile designing and development world-wide and has proven itself to be one of the best in markets. Validcode have served customers from USA , Canada , Germany , UK Plus

$38 USD / heure
(29 Commentaires)

Dear client. I have read your all descriptions carefully and I am sure that I can complete your project in time and at high quality. As a full-stack developer, I have recommended skills in Front-end and Back-end develo Plus

$35 USD / heure
(16 Commentaires)

Hello, Im experienced in Linux system administration including Server Security and optimization. Ill be able to identify the reason of the bottleneck (or maybe exhaustion of the socket/ports?!) in order to allow the sy Plus

$26 USD / heure
(41 Commentaires)

Hi, before accepting, please read: seems to be an issue with php multi curl and a timeout. The php-script itself could be stopped by the max runtime from [login to view URL], as multi curl waits till it got responses from all endp Plus

$33 USD / heure
(42 Commentaires)