Crawler engineer wanted


Able to complete the construction of the crawler framework

Be able to crawl the data of the official websites of major networks, and the related articles of the WeChat public account, and the related news of the headlines

Responsible for fetching core data

Responsible for web information extraction and data cleaning

Be able to finish the work assigned by the superior independently and handle and solve the tasks independently

Strong team spirit


1-2 years working experience in reptile field

Familiar with various crawler schemes

Proficient in web crawling principles and techniques, proficient in regular expressions, obtaining information from structured and unstructured data

Familiar with mysql database, able to use SQL query statement flexibly, can use Redis cache

Familiar with python or Java language

Familiar with Web front end skills

Familiar with TCP/IP protocol

Familiar with common anti-crawl mechanisms, verification code recognition, IP proxy pool, application IP pool, headers authentication and cookie, etc

Team spirit, good ability to work under pressure

Compétences : Java, Python, Hadoop, MySQL, Big Data Sales

en voir plus : technical translator chemical engineer wanted, audio engineer wanted, freelance structural engineer wanted, prepress engineer wanted, freelance engineer wanted, reverse engineer wanted, freelance service engineer wanted, sound engineer wanted, producer engineer wanted, senior net engineer wanted, autocad drawing engineer wanted, civil engineer wanted in narrandera shire, computer engineer wanted, electrical engineer wanted in birmingham uk, electrical engineer wanted, engineer wanted auckland, engineer wanted edmonton edmonton area, engineer wanted london, engineer wanted, find a product engineer wanted

Concernant l'employeur :
( 0 commentaires ) 泉州, China

Nº du projet : #22947928

8 freelance font une offre moyenne de $718 pour ce travail


Hi. I would like to know more details about this project. We are building different crawlers and we can help you as well. Thx, waiting for these details and hope to collaborate.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(117 Commentaires)

I have done many similar projects related to web scraping information from different websites. Very interested to work on this project. I am absolutely confident I can finish this work on time and on budget to highest Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 10 jours
(77 Commentaires)

Hi, I am very interested to work on your project. I have 17+ years experience in Web Development using a large variety of programming languages, frameworks, database architecture, APIs, CRMs, ERPs, mobile development Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 27 jours
(47 Commentaires)

Hi, We work in a team and providing services from last 5 years. We have checked your requirement and interested to work with you. It would be great if we could discuss project over chat to discuss it in detail. We ar Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 20 jours
(27 Commentaires)

I am writing this proposal in order to work for you in Software and Web Development. We are highly trained professional developers seeking to freelance and earn online. Having a flair in programming and development I Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(8 Commentaires)

Hello! I'd like to write a scrapper. I'm famliar with python. I'll do the job blazingly fast. Please, give me a try!

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(1 Évaluation)

Dear Client, I have read your project info carefully, and I considered that I am qualified for this project. I have more than 10 years working experiences of software related, and skilled in Python programming, famil Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(0 Commentaires)

Hey! I'd love to help you with developing your framework! I have worked on crawlers for logging ebay sales prices. My bid is on the lower side because I'm new to freelancer and I need to build up a positive reputati Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(0 Commentaires)