Script Fix


I´m currently running a crawler that uses the phpcrawler php class which works fine with almost all pages/urls, but with certain pages there occurs a problem which basically is that the script stops working without giving any error message or anything like that.

Now an example of a page on such a problem occurs would be:

[url removed, login to view]

Now here would be a demo code, which would simply stop - always at the same page ([url removed, login to view]):


class MyCrawler extends PHPCrawler


function handlePageData($page_data)


echo "Page requested: ".$page_data["url"]."<br>";

echo "Status: ".strtok($page_data["header"], "\n")."<br>";

echo "Referer-page: ".$page_data["referer_url"]."<br>";

if ($page_data["received"]==true)

echo "Content received: ".$page_data["bytes_received"]." bytes";


echo "Content not received";

echo str_pad(" ", 5000); // "Force flush", workaround




// Klasse laden

$crawler = new MyCrawler();




$crawler->addNonFollowMatch("/.(jpg|gif|png)$/ i");





$report = $crawler->getReport();


Now the job would be to fix the class, so that this doesn´t happen any more.

Compétences : PHP

en voir plus : referer url php, fix html error, error on page fix, crawler page_data, fix or now, certain report, url fix, message crawler, crawler report, script function, force gif, php header script, demo works, script message, problem fix, script php html text, php script echo, always running, demo crawler, html page fix

Concernant l'employeur :
( 14 commentaires ) Graz, Austria

Nº du projet : #395684

Décerné à:


Kindly see your PM.

%selectedBids___i_sum_sub_7% %project_currencyDetails_sign_sub_8% USD en 0 jours
(45 Commentaires)

2 freelance font une offre moyenne de $40 pour ce travail


If you agree I will take a look at your scripts

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(0 Commentaires)