En cours

Data scraping from 3 Dutch websites

Hi!

For marketing research we need to collect public data form three websites.

REQUIREMENTS MUST HAVE

* PHP as programming language

* Use CURL library for HTTP requests

* PHP script should be run in commandline

* Efficient crawler to minimize number of requests

* Store data in MySQL database

* Configuration part in the script which sets database user/pass/dbname and other settings in one place

REQUIREMETS NICE TO HAVE

* Possibility to extend with new websites

* Possibility to stop the script and to continue where is left off. Do not crawl already crawled data more than once.

FIELDS TO SCRAPE AND STORE

source_website = name of the website

scrape_url = url where data form scraped from

contact_name

visit_adress1

visit_zipcode

visit_city

visit_country

post_address1

post_zipcode

post_city

post_country

phone1

fax1

email

website

company_name

company_vat_number

company_coc_number

company_description

company_url_logo

company_size

company_start

member_from

member_status

category

DELIVERABLES

* Database structure for MySQL tables.

* One PHP script, which can be run in command line. This script fills the database with data from the websites.

PAYMENT

* 2 milestones; 1) 50% when script is running and working and 2) 50% when everything is checked to be working properly.

WEBSITES

== 1 ==

Index page:

[url removed, login to view]

Data page:

[url removed, login to view]

Data example:

* URL to company logo

* URL: [url removed, login to view]

== 2 ==

Index page:

[url removed, login to view]

Data page:

[url removed, login to view]

Data example:

* URL to company logo

* [url removed, login to view]

== 3 ==

Index page (use the # A B C D … subpages for all entries):

[url removed, login to view]

Data page:

[url removed, login to view],CompanyId

Data example:

* [url removed, login to view]

* [url removed, login to view]

Compétences : MySQL, PHP, Web Scraping

Voir plus : www programming org com, www freelancer org in, www freelancer id, www c programming language com, working of web crawler, working from one freelancer, where store can be freelancer, where is freelancer com, web to data logo, websites programming, websites name, websites for programming, web data scraping freelancer, use of data structure in programming, use of data structure, the d programming language, tables in data structure, sets in data structure, scraping data from web database, scraping data from the web, scraping com, programming with data, programming websites company, programming language d, programming in data structure

Concernant l'employeur :
( 9 commentaires ) HENGELO OV, Netherlands

N° du projet : #1053510

Décerné à :

FMShinobi

Hello! i read your project details, i`m familiar with CURL and done similar projects, check PM please for more info.

30 € EUR en 2 jours
(2 Commentaires)
2.1

14 freelance ont fait une offre moyenne de 131 € pour ce travail

SigmaVisual

We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

200 € EUR en 7 jours
(249 Commentaires)
7.9
tomydeveloper

Hello,We are experienced with Data scraping .Please check pmb for more [url removed, login to view]

100 € EUR en 5 jours
(219 Commentaires)
7.5
srinichal

Expert in scrapping and look forward to deliver the project

200 € EUR en 4 jours
(105 Commentaires)
7.2
lafor

Can be done.

150 € EUR en 3 jours
(160 Commentaires)
6.9
ExcellenceonPHP

HELLO DENIS.I AM READY FOR [url removed, login to view] ME KNOW WHEN TO [url removed, login to view]

100 € EUR en 5 jours
(118 Commentaires)
6.5
wildlily980

I can do it.

90 € EUR en 5 jours
(46 Commentaires)
6.1
phpXpertbd

Please see pm. Thanks

140 € EUR en 10 jours
(29 Commentaires)
6.2
alexander2007

Please check PM, Thanks.

200 € EUR en 7 jours
(30 Commentaires)
5.9
allhen

Ready to work !!

420 € EUR en 9 jours
(58 Commentaires)
5.7
z0mbie

Hi again, please check PM and attachment.

50 € EUR en 2 jours
(12 Commentaires)
4.6
vunv

Check your PMB, Thanks!

100 € EUR en 3 jours
(25 Commentaires)
4.5
a2infotech

please check PMB. Thanks a2infotech

70 € EUR en 3 jours
(4 Commentaires)
2.8
kayasystems

Please see PM

100 € EUR en 2 jours
(0 Commentaires)
0.0
PutraCoder

Hi sir, Please check your PMB...

30 € EUR en 0 jours
(0 Commentaires)
0.0