Web Scraping Scripts - Javascript / NodeJS / ES6

I'm looking for a web scraper to write code in Javascript (ES6) to scrape 31 different websites for specific publicly accessible flight data. This job is ONLY to write the scripts, we already have a functioning scraper. Please read this carefully and make sure to speak to it in your cover letter. Generic cover letters will be reported.

Dev plan / Requirements:

1. You will create a function that takes a url.

2. This url will be translated to English using Google translate or something if it was written in a different language than English.

3. This function should then decide what is this site and based on that it will decide which scrape script it should call.

4. Then after all that it should return an array with json with basic flight data:

2. Url (Flight/Post URL)

3. Source (website name)

4. From Airport

5. To Airport

6. Dates (we will figure out format together)

7. Price

8. Airline

9. Booking link (if provided)

- If one of these info wasn’t present just give that property null or undefined as a value.

- The scrape script will have 31 scrape functions for each individual URL.

- The script should be tested with different flights/posts on the same URL and will need to pass QA by my team before final payment (we can work with milestones in the meantime).

- Script is written in ES6.

Good, but not required:

Script is written in NodeJS. If you have used NodeJs before then we can just ignore next paragraph. If you haven’t used NodeJs and you only know Javascript then it is really simple. You will just copy the javascript scrape script and instead of using jQuery for traversing the DOM you will use Cheerio (it is really really close to how jQuery).

I look forward to seeing your bids and experience!

Compétences : Javascript, node.js, Web Scraping

en voir plus : web scraping javascript ajax, linux web scraping scripts, python web scraping scripts, web scraping scripts, php web scraping javascript, javascript web scraping python, python web scraping javascript, web scraping javascript net, web scraping scripts php, web scraping javascript interpreter, javascript web scraping, java web scraping javascript, kapow web scraping experience, classic asp knowledge sequel scripts javascript experience, scripts used web scraping, web scraping javascript, web scraping experience, web scraping visual basic

Concernant l'employeur :
( 0 commentaires ) Washington, United States

Nº du projet : #15379510

Décerné à:


I have worked with Node.js and especially with ES6 for many years. Additionally, I have worked intensively with RegEx which is important when making a web scraper. Thanks! Relevant Skills and Experience RegEx, Node.j Plus

%selectedBids___i_sum_sub_7% %project_currencyDetails_sign_sub_8% USD en 3 jours
(1 Évaluation)

11 freelance font une offre moyenne de $186 pour ce travail


Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/scr Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(291 Commentaires)

I have 7+ years in web- scraping - javascript developers with very good experience. Relevant Skills and Experience I am good in Javascript, node.js, Web Scraping Proposed Milestones $200 USD - Cost

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(58 Commentaires)

I am a web expert. I can end your job perfectly. Relevant Skills and Experience Javascript, node.js, Web Scraping Proposed Milestones $244 USD - milestone no

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(35 Commentaires)

Hello, Thank you very much for sharing your requirement. I have read the brief project description and I would like to be invited for further discussion to proceed. Relevant Skills and Experience We are a team of 8 y Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(10 Commentaires)

Hello Relevant Skills and Experience OK Stay tuned, I'm still working on this proposal.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(9 Commentaires)

please ignore the bid amount we will discuss the price later in the chat after we have discussed the project thoroughly Relevant Skills and Experience: . Proposed Milestones: 190 - . Hi nckishtp! please inbox me to dis Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 2 jours
(4 Commentaires)

Hello! I would like to work with you for this project. I have rich experiences for website design and php,sql,javascript,jquery, json, css,etc... Relevant Skills and Experience I'm ready for your project now and will Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(11 Commentaires)

Hi! I have rich experience in this field. If you fast and quality result, you can hire me. Relevant Skills and Experience Javascript, node.js, Web Scraping Please contact me. Proposed Milestones $155 USD - complete Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(10 Commentaires)
%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(19 Commentaires)

SUHAIL Hello My name is Suhail. I am professional programmer. I have 8+ years experience working Node.js, In addition to writing front-end codes and creating technical specifications for prototypes and guides. I am pro Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(0 Commentaires)