En cours

simple scraping / API script

I need a simple script:

step 0: you get a large file with a list of URLs (up to 1 million lines)

step 1: extract the domain names from the URL and generate a sorted unique list; this is not as simple as it sounds as the function doing that must be able to tokenize any URL format as well as any form of TLD (like .[url removed, login to view], .fr, .[url removed, login to view], ... for example),

step 2: use this API: [url removed, login to view] to get 2 or 3 data per domain,

step 3: scrape 2 data from the [url removed, login to view] page for each domain in the list,

step 4: sort and output as a flat file.

Potential for long term work with the right programmer(s)

Compétences : HTML, PHP

Voir plus : scraping com, url scraping, simple api work, php script work for scraping 2, php programmer nz, list 1 million, domain api, scrape data list urls, api alexa, php url api, use extract function, large script, scrape page http php, sorted form, scrape sort, scraping php form, function scrape, simple list urls, scraping data url, html file api, simple url file, scrape url list, html scrape, sort php list data, api scrape

Concernant l'employeur :
( 9 commentaires ) London, United Kingdom

N° du projet : #2335950

9 freelance font une offre moyenne de $116 pour ce travail


I look forward to discuss further

220 $ USD en 12 jours
(106 Commentaires)

Read your details and interested to work, thanks.

200 $ USD en 20 jours
(36 Commentaires)

Hi, I am a php mysql developer & I am interested to work in your project. Thanks

200 $ USD en 20 jours
(16 Commentaires)

The work can be done with Python. Let's talk more details with PMB.

40 $ USD en 3 jours
(5 Commentaires)

Hello, I'm a scraping expert from years; let me code that. Steve

50 $ USD en 7 jours
(6 Commentaires)

check ur PMB

80 $ USD en 2 jours
(9 Commentaires)

Hi I am very interested in your job. Would you please check your inbox? Thanks

90 $ USD en 5 jours
(3 Commentaires)

Hi, The API you mentioned will only allow 500 queries. Since you have large number of domains, you may have to buy subscription from [url removed, login to view] . Please PM me back with the exact d Plus

100 $ USD en 7 jours
(5 Commentaires)

dear sir i am not disappointed for not hiring me even i wish that the hired person will give u work as u expected. plz give a chanc regard Arup

50 $ USD en 3 jours
(0 Commentaires)

Hello. I have a template scarp script. i can adapt it according to your requirements. I give you a high quality service and will be always in communication.

200 $ USD en 1 jour
(0 Commentaires)

Hi paula717, I am interested to do your work, as I am already done this type of work. i am 7 years experience in PHP field. Thanks Avi

100 $ USD en 5 jours
(0 Commentaires)

Hi,I think I can handle this. But there're some unclear requirements. plz check you mail-box.

50 $ USD en 4 jours
(0 Commentaires)