Application needed to crawl & gather website data

We need a Windows application that we can leave running on a PC that will crawl a business directory on the web

We need to be able to specify limits (e.g. just gather .[url removed, login to view] domains, or just a specific category in the directory) and compile the following data.

It needs to log the page name, URL, and results for the following criteria....

1) Does the site use frames (y/n)

2) Does the page have a Doctype declaration (y/n) + what is it (html, xhtml, strict etc)

3) Does the page code validate (can integrate an open source validator)

4) What is the google page rank of the page (this is optional)

5) What was the directory category

6) A way of determining (looking for ideas) of whether it is built using CSS+divs, or tables for layout.

Please state as much detail as possible about how you will achieve this, how the logged data can be accessed (ideally as an exportable excel spreadsheet from the app.), and post examples if you have done similar things.

Compétences : Programmation C, Delphi, Visual Basic, Bureau Windows

en voir plus : website layout using css, spreadsheet to web application, open source visual basic 6, n. y. post, html to spreadsheet, html spreadsheet code, html 5 doctype, html 5 application examples, google spreadsheet web app, google spreadsheet rank, google spreadsheet html, google spreadsheet examples, excel to application, excel frames, directory page layout, basic website html code, application site web, application examples, what application, doctype html 5, validate excel, name ideas, metaphase, log post, google application

Concernant l'employeur :
( 39 commentaires ) Surrey, United Kingdom

Nº du projet : #36992

11 freelance font une offre moyenne de $238 pour ce travail


hi. please check pmb.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(110 Commentaires)

We can do this for you with great pleasure and with excellent quality. Please, see PMB

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(38 Commentaires)

I can do it

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(3 Commentaires)

We offer an outstanding value added services and high degree of quality at very competitive prices. We assure quality work ,one month free suuport and 7/24 communication. ***** NOIRESOL *******Thanks*****Best Rega Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 15 jours
(2 Commentaires)

I am a gradute of Purdue University USA and have done my MSc in Software Systems from London. I have 10 years of experience in computing, 5 years VB, ASP and Java programming. Please see PMB for my detailed explanation Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 45 jours
(2 Commentaires)

Hi, I have nt actually worked on the exact specs that you have written down but on data extraction from a particular site. But can give it a try. Regards, Vibhu.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 15 jours
(2 Commentaires)

Our bid is 289 $ for the whole project. Bid includes development , deployment and testing. we offer 30 days free support. We are ready start and send daily reports. we communicate through mail,messenger,phone and skype Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 10 jours
(2 Commentaires)

I have done projects like this in the past. See PM

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 10 jours
(5 Commentaires)

Can do this in Delphi. Will use MySQL 3 (will include it in installation procedure) server. Have xpirience ofpascal programming. Also can do this in php for UNIX. Already have page ranking module ... in php.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 14 jours
(0 Commentaires)

I can do it. Program will be created using Delphy. Information can be saved in .csv files, or directly into MS Excel. I send a project in UML if needed, at first day.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(0 Commentaires)

We are India based company into Web developement, Search engine optimization and BPO. We have done series of projects like dating, ecommerce solutions, image editors, gaming websites,professional websites and many mor Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 45 jours
(0 Commentaires)