En cours

simple scraping / API script

I need a simple script:

step 0: you get a large file with a list of URLs (up to 1 million lines)

step 1: extract the domain names from the URL and generate a sorted unique list; this is not as simple as it sounds as the function doing that must be able to tokenize any URL format as well as any form of TLD (like .[url removed, login to view], .fr, .[url removed, login to view], ... for example),

step 2: use this API: [url removed, login to view] to get 2 or 3 data per domain,

step 3: scrape 2 data from the [url removed, login to view] page for each domain in the list,

step 4: sort and output as a flat file.

Potential for long term work with the right programmer(s)

Compétences : HTML, PHP

Voir plus : simple api work, php programmer, list million, domain api, api alexa, php url api, use extract function, large script, sorted form, simple list urls, html file api, simple url file, sort php list data, php sort unique file, html sort, step format file, simple php form example, simple page example html, step use programmer, alexa script, alexa data api, sort alexa, php script extract data, simple page php script, php html api

Concernant l'employeur :
( 9 commentaires ) London, United Kingdom

N° du projet : #2335950

9 freelance ont fait une offre moyenne de 116 $ pour ce travail

srinichal

I look forward to discuss further

220 $ USD en 12 jours
(106 Commentaires)
7.2
alrazon

Read your details and interested to work, thanks.

200 $ USD en 20 jours
(36 Commentaires)
5.3
rana100

Hi, I am a php mysql developer & I am interested to work in your project. Thanks

200 $ USD en 20 jours
(16 Commentaires)
4.8
joeguo

The work can be done with Python. Let's talk more details with PMB.

40 $ USD en 3 jours
(5 Commentaires)
4.3
steve1112

Hello, I'm a scraping expert from years; let me code that. Steve

50 $ USD en 7 jours
(6 Commentaires)
3.5
sthmanish

check ur PMB

80 $ USD en 2 jours
(9 Commentaires)
3.2
softaic

Hi I am very interested in your job. Would you please check your inbox? Thanks

90 $ USD en 5 jours
(3 Commentaires)
3.1
ezio2012

Hi, The API you mentioned will only allow 500 queries. Since you have large number of domains, you may have to buy subscription from http://www.domaintools.com/api/docs/pricing/ . Please PM me back with the exact d Plus

100 $ USD en 7 jours
(5 Commentaires)
2.7
bapon01

dear sir i am not disappointed for not hiring me even i wish that the hired person will give u work as u expected. plz give a chanc regard Arup

50 $ USD en 3 jours
(0 Commentaires)
0.0
syncromindproj

Hello. I have a template scarp script. i can adapt it according to your requirements. I give you a high quality service and will be always in communication.

200 $ USD en 1 jour
(0 Commentaires)
0.0
Avi1980

Hi paula717, I am interested to do your work, as I am already done this type of work. i am 7 years experience in PHP field. Thanks Avi

100 $ USD en 5 jours
(0 Commentaires)
0.0
lhdgriver

Hi,I think I can handle this. But there're some unclear requirements. plz check you mail-box.

50 $ USD en 4 jours
(0 Commentaires)
0.0