En cours

WebScraper

I need a Web Scraping application to scrap reviews of products in polish website ceneo.pl. It has to work as an ETL process. Extract, Transform and Load. Extract raw data, then transform it to get useful, clear data and last, load it to database.

Data to be scraped for each review (by class):

a. product-reviewer (if lack of info, it shoul write "Anonim")

b. reviewer-recommendation

c. datetime (when posted)

d. review-score-count

e. product-review-body

f. pros

g. cons

h. vote-yes-(some number?) vote-no-(...) How many thumbs up and how many down. If "0", then it should remain empty in database.

4. Data to be scraped for each product:

a. Device Type

b. brand

c. Model

d. Additional comments

First user need to input ID of a product (e.g [url removed, login to view] the number is ID) to scrape, then should be 2 buttons: [Extract Tranform Load] - which should stop after each step (Extract -> output of raw data [continue button] Transform -> output clear data [continue button] Load -> output data loaded to DB [Back to choices button with question - "Do you want to clear DB?" if yes -> clear and show home page, if no show home page]) and [ETL] which should show the final data in database (with the same back to choices button as before).

Application must have a button to clear database in home page too, to show how it is loaded, and app should delete every single file used for the ETL process when it is finished. Of course it can't be any duplicates in database. There should be an information about how many reviews was scraped. Of course it should work for all subpages if there is any.

The application should allow the display of opinions from the database by product which they discribe. There should be an option to export all scraped data to .csv file and each review to .txt file (e.g a button next to review, and a button to export all scraped data to csv).

I prefer PHP curl and simplehtmldom libraries, html5, bootstrap and MySQL for it.

I does not have to look extraordinarily, it has to work.

I need this app no later than 12 january 2017.

Thanks in advance!

Compétences : Saisie de Données, HTML5, MySQL, PHP, Web Scraping

Voir plus : do want, close delete freelancer account, drupal easy website build, alibaba website build, joomla commerce website build, want buy used iphone, full website build, teacher rating website build, bid website build, website build bid, poker website build

Concernant l'employeur :
( 1 commentaire ) Krakow, Poland

N° du projet : #12714660

Décerné à :

nhakhtn

Dear Sir, I am a PHP programmer from VietNam (GMT +7). I have been working with PHP for 10 years. I have experience with PHP, MySQL, DHTML, Photoshop ... Some websites I worked for: http://whl.travel http://w Plus

75 zł PLN en 1 jour
(47 Commentaires)
5.2

7 freelance ont fait une offre moyenne de 72 zł pour ce travail

PiasKumarDas

Hello, I can make a java tool that will fulfill your purpose like scrapping data and saving it to database after post processing. Hope, i will be a part of the job. thanks

75 zł PLN en 1 jour
(10 Commentaires)
3.9
saaz109

Hi I am very much sure that I can complete work as per your requirements.I assure you that I will provide you quality work and within the decided time frame and budget. Please drop me a message for further discussio Plus

115 zł PLN en 1 jour
(6 Commentaires)
4.1
priteshkhande88

I am a skilled freelancer who has a working experience of more then 4 year I have working experience on- Web Research, lead generation, data entry, data mining, lead collection, All types of scrapping tools like - da Plus

30 zł PLN en 1 jour
(13 Commentaires)
3.0
ieota

Hello, Thanks for sharing your requirement with us!! On-going though your job post I have understood that you are looking a highly experience developer to develop your website. I am delighted to inform you that we Plus

65 zł PLN en 1 jour
(1 Commentaire)
0.0
fusionsoft4

Dear Client, Thanks for providing us opportunity to place bid over the project and communicate with you.We mainly deal in web development, SEO, Android App, software testing and graphic design. Our vision is to b Plus

69 zł PLN en 6 jours
(0 Commentaires)
0.0
75 zł PLN en 1 jour
(3 Commentaires)
0.0