Terminé

Scrape a website and sort URLs according to content length and a certain flag

Hello,

i need someone to do these steps within 2 business days:

a) scrape all the pages/subpages of [login to view URL] (it’s a german encyclopedia for medical terms, should be more than 10.000 URLs to scrape) and put them in a excel (as a simple list).

b) every of these URLs has a specific number of visits (‘Aufrufe’) named within the source-code. I need this number attached to relevant URL. Attached, you see screenshots of this.

c) Please check the text content length of every URL and cut off all URLs of the list that have >150 words of content.

In the end, there should be an excel file with two columns: A -> URL; B -> number of visits aka ‘Aufrufe’; as a result of c) all the URLs listed do have less than 150 words of content.

I guess that this final list will contain about 100 - 1.000 URLs

Compétences : Exploitation de Données, Excel, Programmation, Web Scraping

en voir plus : scraping websites with beautifulsoup, web scraping examples, web scraping tutorial, python web scraping cookies, web scraping python beautifulsoup, web scraping python, intro to web scraping, python 3 web scraping, auto scrape website content post, scrape website absolute urls, scrape website content daily, scrape website content, google spreadsheet scrape website content, lua scrape website, website templates user generated content, php scrape website curl, scrape website screenshot, scrape website mysql, scrape website products script, scrape website databases

Concernant l'employeur :
( 3 commentaires ) München, Germany

Nº du projet : #17317970

Décerné à:

shafaqat11

Hello Sir, I have done many projects in scraping and in web mining and have scraped data from very complex websites. My recent work in scraping include following websites. [login to view URL] http://uae Plus

%selectedBids___i_sum_sub_7% %project_currencyDetails_sign_sub_8% EUR en 3 jours
(101 Commentaires)
5.8

37 freelance font une offre moyenne de €120 pour ce travail

semi786

Hi Sir/Madam, It is being my pleasure to introduce you to me. I am expert in data entry and Web Scrapping. I will scrap all URL. I will provide you sample file before start the work. Please review my profile. My pro Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 0 jours
(221 Commentaires)
7.4
mantislin

Hi sir, This is Lin and I am scraping expert, please check my reviews then you will know. I just checked [login to view URL], can we discuss more details? Thanks, Lin

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 2 jours
(255 Commentaires)
7.4
deepabittu

Hello Sir i have good team and i can do this job with good result so pls come online so we can more dissuades about project

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(216 Commentaires)
6.4
%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(59 Commentaires)
6.3
Exactwork1

Hi Sir, I am able to scrap 1000 pages of this website and collect URL and code as per your instructions into an excel with proper columns and accuracy. I humbly want to work with you with my honesty. I assure You that Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(63 Commentaires)
5.5
MaMingMing

Hello, Web scrapping is my second speciality. I have done several scrapping projects here. You will noticed that while checking my portfolio. And you wrote quite in detail in your description so i could understood Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(4 Commentaires)
5.1
Angel521

Hello. I am *XiaoLong* 99.99999% Completion Rate!!! I am an expert of web scrapping. I have done these works for several years and get good reviews as you can see on my skills. "Correct implementation for requireme Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(14 Commentaires)
4.8
royalwebraisers

Dear Hiring Manager, I can help you with the project. Let me know when we can start. Looking forward to your response. Thanks.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(15 Commentaires)
5.0
rajawi9999

I will scrape for you all URLs in less than 24 hours.... ... .. Im fast and ready to start right away.

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(13 Commentaires)
5.0
%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(16 Commentaires)
4.7
istiyaqueahmed

Hi sir, This is Istiyaque and I am scraping expert, i have checked all details for your project. can we discuss more info then i can provide example data for you? Please message me then we can discuss more AS Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 6 jours
(40 Commentaires)
4.5
maximwang8661

hello. nice to meet you. I am a good scraping expert. I have a lot of experience in scraping. Let's have a good discussion about your project with me. If you hire me, I will complete your project qualitatively and Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(13 Commentaires)
4.2
sunmoon11

Dear Sir! I’ve carefully gone through your job posting. I can finish your job within 2 days. I am Web Scrapping master with Python and you can find it on my reviews. Web Scraping have several technical problems Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(17 Commentaires)
4.3
brashel

Hello sir, I read your instruction properly and can scrape your required data with 100% accuracy. So, please contact with me. Thanks a lot.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(32 Commentaires)
4.3
osmanaydin

Hello sir, I have completed web/data scraping jobs for many times. I am interested in your project as well. I would like to discuss details via pm. I am looking forward to hear from you soon. Best Regards,

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(12 Commentaires)
3.8
vmadhavan15

am not a random bidde4r... Please ping me if you ar einterested with my proposal and share more details.. thank you...

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(9 Commentaires)
3.9
sky930320

Dear Sir. I have full experience in web scraping using python and C++. I'm using phantom, selenium, Beautiful Soup (python) and libcurl(C++) Please give me this job to prove my expertise. My expertise skills: Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(4 Commentaires)
3.3
luisalmeida

Hi, I can help with you in your project Web Scraping. I have more than 5 years of experience in Data Mining and Web Scraping.I have worked on several similar projects before! I can deliver in your deadline. Please Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(3 Commentaires)
2.5
TrueGardener

Dear hiring employer. I am good at web-scrapping. As you know it's main aim is bot. Furthermore i can make bot for your purpose with java & selenium. Thanks Sonxai

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 2 jours
(2 Commentaires)
2.6
%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(1 Évaluation)
1.3