En cours

simple scraping script work

Hello,

I need a php script doing:

step 0: you get a file with a list of URLs (hundreds or thousands); they are in all sorts of format (subdomains, https, many SLD/TLD).

step 1: you extract the domain names from the URLs and generate a sorted list of unique domains; this is not as simple as it sounds as the function doing that must be able to tokenize any URL format as well as any form of TLD (like .[url removed, login to view], .fr, .[url removed, login to view], ... for example).

step 2: clean the list to remove some domains such as free blogs or .gov.

step 3: scrape [url removed, login to view] to get one data about some of the domains.

step 4: scrape [url removed, login to view] to get some data for a short list of domains (without getting banned for superusage).

step 5: scrape 2 data from the [url removed, login to view] page for each domain in the list.

step 6: sort the list and output as a flat file.

Or you can propose your method.

Potential for long term work with the right programmer(s)

Compétences : HTML, MySQL, PHP

Voir plus : work free without, php programmer, namecheap, mysql flat file, sorted list, script clean list, mysql clean data, clean php script, sorted form, gov blogs, simple list urls, php clean urls, page mysql output, simple url file, simple url script, sort php list data, php sort unique file, simple page script, data clean script, step format file, simple php form example, mysql output, script list subdomains, alexa script, sort alexa

Concernant l'employeur :
( 9 commentaires ) London, United Kingdom

N° du projet : #2379610

10 freelance ont fait une offre moyenne de 187 $ pour ce travail

srinichal

I can deliver the script

250 $ USD en 5 jours
(107 Commentaires)
7.2
waelfree

Hi, I can do that

150 $ USD en 2 jours
(100 Commentaires)
7.0
k1ng440

Full time freelance web developer with over 8 years of commercial experience.

600 $ USD en 5 jours
(96 Commentaires)
6.5
procoder898

hi, I'm an expert in scrapper programming and data mining. Please kindly have your inbox checked and let me handle your project.

149 $ USD en 5 jours
(29 Commentaires)
5.3
csharpdotnettech

sir i am an expert .Net, C# programmer(among Top 10% programmers at Odesk with 91% percentile) can view my profile https://www.odesk.com/users/~~26186839692c4731 i have 100% completion rate with 5/5 rating(can vi Plus

150 $ USD en 3 jours
(8 Commentaires)
5.1
yarco

But you should give me the domain names to be removed in step2 "step 2: clean the list to remove some domains such as free blogs or .gov."

140 $ USD en 1 jour
(16 Commentaires)
4.8
anonymed

Ready to work on.check PM

100 $ USD en 1 jour
(12 Commentaires)
4.5
joeguo

why not built the script with python?

100 $ USD en 3 jours
(6 Commentaires)
4.3
Attractionnet

Hello. I'm the right programmer! I write custom programs who can do everything. PHP code runs from certain ips thus blocked, programs can't be blocked. So, I will create a program which check the domain validity, and t Plus

150 $ USD en 5 jours
(7 Commentaires)
2.8
vishalkain

Worked as a Backbone of a web based company, now working as a freelancer. As you said you need programmer.. so, i am. ABOUT PHP working in php is like 3 things for me.. 1. confidence 2. google keywords 3. g Plus

85 $ USD en 2 jours
(1 Commentaire)
1.0