Fermé

PHP Java Web Scraper and Crawler - open to bidding

Hi,

Can you make PHP Java web scraper/crawler for any website by putting a code into PHP file?

Normally, I put a simple htmldom to my PHP file as following:

<?php

function getDetail($ASIN){

$returndata="";

$contents=curlContent($ASIN);

$html = new simple_html_dom();

$pageURL="http://".$_SERVER['HTTP_HOST'].$_SERVER['REQUEST_URI'];

if(!empty($contents))

{

$html->load($contents);

if($html->find('div[class="product-details-and-care"] ul')){

foreach($html->find('div[class="product-details-and-care"] ul') as $detail){

$returndata=$detail->plaintext;

$regex = '#<img([^>]*) src="([^"/]*/?[^".]*\.[^"]*)"([^>]*)>((?!</a>))#';

$regex = '#<a([^>]*) href="([^"/]*/?[^".]*\.[^"]*)"([^>]*)>((?!</a>))#';

$returndata = preg_replace($regex,'',$returndata);

}

}

else {echo "There is currently no description for this product. We do not represent or warrant that product descriptions or other Content on this Site is accurate, complete, reliable, current, or error-free.";}

$html->clear();

unset($html);

}

return $returndata;

}

echo getDetail($ASIN);

?>

$ASIN is a page url variable of any web page and this case I using with any product page of [url removed, login to view] such as [url removed, login to view]

A function will find element UL under div class of product-details-and-care and will print data as plaintext when visiting a page and connect with $ASIN, if not found or can't access page will print custom text as 'There is currently no description...'

However, I got a problem when currently this code seems to be old-fashioned or get restricted to access and print data on my webpage.

So, I want to know can you make or develop a code with other language in java or etc to working with my PHP file to let all websites allow me to crawl and scrape their content to displayed on my webpage?

Thank

Compétences : Assembly, Programmation C, Java, Python, Web Scraping

Voir plus :

Concernant l'employeur :
( 0 commentaires ) Bangkok, Thailand

N° du projet : #12704532

13 freelance ont fait une offre moyenne de 194 $ pour ce travail

888 $ USD en 3 jours
(14 Commentaires)
6.4
266 $ USD en 7 jours
(63 Commentaires)
5.5
furqanorpiv

Hi I am Furqan I've reviewed your complete job description, and I fulfill all the qualifications required for this project. I have 8+years experience working in python languages i have completed lof of projects Plus

35 $ USD en 0 jours
(13 Commentaires)
5.1
prashushinde9

Hello, We have accomplished 90% of the project which is similar of your requirement. All we need 10% customization as per your requirement set and specifications. I want to discuss in personal chat in order to explore Plus

257 $ USD en 3 jours
(3 Commentaires)
4.6
BeautiCG

Hi,dear. Thank you for your interest. I've just checked your project report,I'm able to perform this task with my developer team.I look forward to your proposal...

155 $ USD en 1 jour
(4 Commentaires)
3.7
150 $ USD en 3 jours
(8 Commentaires)
3.6
NewJhelum

Hi, I have gone through your requirement and I'm very interested in this job. Yes I already did this type of jobs and its more easier for me to do this job. You can also check my profile's reviews and ratings about my Plus

45 $ USD en 3 jours
(17 Commentaires)
3.1
zhenyi2015120

I'm a Good Web Expert. I have been developing php, javascript and mysql programs for 7 years. I have developed and managed many web sites. So I think I can do it so that you satisfy. I am looking forward to being h Plus

133 $ USD en 3 jours
(1 Commentaire)
1.7
MrScraper

Hi there, thanks for the project. Please tell me if you want me to send you the demo app? You do not have any obligation about it . I like to make similar bots, I find your idea very challenging. Thanks, MrS Plus

222 $ USD en 3 jours
(1 Commentaire)
1.3
Orpiv

Hello, We are IT based company we have experts in web scrapping, data crawling and data mining,We have 7 years+ experienced employees in data mining, website scraping, screen scraping and that too certified web scrapp Plus

30 $ USD en 0 jours
(1 Commentaire)
2.9
heana2276

Hello Your job posting has caught my attention. I can work for your product until you are fully satisfied. I am very confident that i can do this job and can assist you. I am very flexible in working time an Plus

155 $ USD en 3 jours
(0 Commentaires)
0.0
addaxagency

I am the ebst for this project because i working on this materials since 3 years already so i have the experience on it, as you can see i have only excellent feedbacks from my customers.I have worked on 120+ projects i Plus

155 $ USD en 3 jours
(0 Commentaires)
0.0
shahiddar

Hello, My name is shahid from Kashmir Over the last 7 years, I have worked for several clients. Joined Freelancer with over 7 years rich experience in the field of data mining data scrapping, I am certified python dev Plus

30 $ USD en 0 jours
(0 Commentaires)
0.0