Fermé

Max retries exceeded with URL in requests

Hey folks

I am making a crawling script that brings a large amount of data through a proxy server in Python.

Network communication is being implemented by utilizing requests library and I am facing "HTTPConnectionPool(host='host', port=port): Max retries exceeded with url" issue now.

This proxy can be regarded as a proxy server that automatically changes IP in the cloud, and the IP change cycle is to change IP for each request.

The proxy concurrency is 5 times every second.

Anyone knows why did it happen, could fix it, it would be appreciate.

Thanks.

Compétences : Python, Architecture Logicielle, Web Crawling, Web Scraping

Concernant l'employeur :
( 9 commentaires ) Shenyang, China

Nº du projet : #32681853

11 freelances font une offre moyenne de 133 $ pour ce travail

(145 Commentaires)
7.4
sgatich

Hi. I'm a programmer from Russia with strong skills in Python. I have solid experience with requests library. Also I work a lot with proxies. Let me help you to debug the script and fix the error. I'll be happy to Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 2 jours
(16 Commentaires)
5.7
(13 Commentaires)
5.0
mubashirallii

Hello employer, I have theory regarding your issue. I have faced such issues while developing many scrapers. You can message me to discuss possible solution to your project and if it is simple solution, we can negotia Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(17 Commentaires)
4.9
AbhishekSingh08

Hi there, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PH Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(2 Commentaires)
4.6
(10 Commentaires)
4.5
adnanarifali

Hi there, I would like to work and complete your project in just €100 EUR with further details. Regards, Adnan Ali.

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(34 Commentaires)
4.1
loopsatomic

Hello, If you are looking for some assistance or guidance in python, AI /ML, Backend, Flask, Django, Web Scraping and anything at all, we are the organization you are looking for. Our team has been working in this fiel Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 2 jours
(14 Commentaires)
3.6
priyanshu8090

Hi there, Can i see the code to better understand what can be the cause of problem? I have Decent knowledge of Python and can help you with the issue. Can we have a chat to discuss it further in detail?

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 2 jours
(9 Commentaires)
2.5
demvitalii3

Hi, There I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I have good experience with Python, Web Scraping, so can help you very well. I work according Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(3 Commentaires)
2.6
felixismael

I am a FullStack Developer & consultant with experience of working on a variety of website & web app development projects. I work on all aspects of the development life cycle, applying my knowledge of OOP and MVC arch Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(4 Commentaires)
1.6