Fermé

Spider That Downloads Content

I would like a script written in PHP for a linux server.

I will call it a site replicator for easy understanding.

I would like it to do the following:

- Be given a starting URL to start.

- Crawl every possible link it finds within this page and start downloading everything that it finds, and save what it finds,keeping the directory structure the same, on my server.

-I want to be able to specify the ammount of layers I would like it to crawl. (How deep the scan should go)

-I want to be able to exclude certain file types if neccesary

-I want it to get the html pages AND THE IMAGES FOUND ON THESE PAGES

- I want it to be able to follow dynamic URLS as well. If the pages are made from a CGI or php script then I want them to be able to be downloaded as well.

- bonus would be to have an option to stay only within this root URL, or allow it to go outside the given URL.

I want it to start on the starting URL and download everything it finds, and save it to my server.

Pretty simple right?

Compétences : PHP

Voir plus : written content, neccesary, get cgi, pretty, outside, layers, cgi images, linux php scan, call url script, save file directory, php call cgi, pretty url php, url crawl, script call url, link spider, directory content, php dynamic page content, save url file, simple crawl script, crawl content url php, content page, file scan, url spider, content pages, save url php file

Concernant l'employeur :
( 0 commentaires ) Riverside, United States

N° du projet : #23393

15 freelance ont fait une offre moyenne de 219 $ pour ce travail

siddhartha1

would be pleased to offer you our services,regards

300 $ USD en 15 jours
(35 Commentaires)
7.6
cstl

Chandusoft.com is a customer-specific service oriented company has got an Professional and creative team with 6 years experience in Web development, software development and data entry. We pay attention to every small Plus

270 $ USD en 10 jours
(18 Commentaires)
6.9
viaden

Dear Sir/Madam! We've gone through your description and are confident of meeting you requirements. Our company has been in the sphere of web development and programming for 10 years already, always providing its client Plus

300 $ USD en 15 jours
(3 Commentaires)
6.2
smirnoff

Have it ready made.

220 $ USD en 2 jours
(14 Commentaires)
5.6
izwan00

Please see PMB.

100 $ USD en 0 jours
(20 Commentaires)
5.2
nidle

Hello, We got extremely interested in the project proposed. We are an IT company specializing in web technologies and programming. Our specialists are ready to start working on the required script solution straight aw Plus

300 $ USD en 20 jours
(2 Commentaires)
4.9
Kaabi

Glad to work with you :)

300 $ USD en 7 jours
(28 Commentaires)
4.5
mediajohnny

Stealing content will land you in court buddy.

100 $ USD en 1 jour
(2 Commentaires)
3.9
bagilevi

I have done similar project before, and I can do everything you mentioned.

100 $ USD en 1 jour
(4 Commentaires)
3.4
Aure

Dear Sir, I have a one year experience with PHP technology. I can do this fast and honestly. I've been doing a project similar to yours and so the only thing to do is adjusting the script to your requirements. It shall Plus

200 $ USD en 2 jours
(2 Commentaires)
3.7
tanuj99

pl see pmb for details

298 $ USD en 15 jours
(1 Commentaire)
3.2
fictionwebs

Outsource Web Development, Website Design, Logo Design, Banner Design, Scripting and Programming, Flash Animations, Corporate Identity, E-Commerce Payment Gateway Integration === Serving since 7Years on the web, Fictio Plus

250 $ USD en 5 jours
(0 Commentaires)
0.0
kroniks

We will do this project quickly and quality. This sounds like a really interesting project. We would like very much to work on it. We believe "Quality is not an act, it is a habit". Payment escrowed to get me st Plus

290 $ USD en 10 jours
(0 Commentaires)
2.4
karols

We can provide secure and flexible solution, with well organized and commented source code which make future modifications very easy. We never sacrifice quality for short realization time. We prefer work to take a litt Plus

150 $ USD en 5 jours
(0 Commentaires)
0.0
Randeep

We are a group of highly educated professionals with specialization in various fields. although we are new to elance.com, we have done such projects before and we are confident of doing your project. We will always be Plus

100 $ USD en 7 jours
(0 Commentaires)
2.0