Website Backend- Site-scraping, database, simple interface.

TITLE: Website Backend- Site-scraping, database, simple interface.


We are seeking someone to implement a simple back-end solution for our future website.

This job consists of several back-end automated data-manipulation tasks, namely:

1.) Implementing a site-scraping protocol to retrieve and store information from multiple websites.

2.) Formulating the right kind of server-side database requirements which can respond to future demands.

3.) Automatically gathering said data and manipulating it into said database.

4.) Visually display basic analytics on the data.


1.) Automated scrape. Data must first be gathered (scraped) from 2-3 source websites and manipulated/processed into a working database. This must be efficiently/optimally done as some of this data must be re-acquired periodically (e.g. once an hour, once a day).

2.) Setup a basic but somewhat future-proof database. Discuss our requirements and create the baseline server-side database structure we will require. Provisions should be made for the server-side array(s) to be fast, scalable, and flexible, as some components of the data may eventually need to be manipulated by many (eg. n > 1000) users simultaneously. The basic database setup should be conducive to future growth, reliability, performance, and security considerations.

3.) Essentially, we are looking for a nice google-analytics-like summary page for the data we scrape. We want public visitor users to be able to create/login to an account, query the information they like, and save these queries with their profile. Some of the changes a user makes (such as picking 5 names from a list) would have implications towards the data available to other users (eg. those names are unavailable or statistics are gathered based on which names have already been picked, picked the most, etc.).

(4) Visually, we just need a simple, non-elegant webpage(s) for interfacing with this data. The page should contain table(s) and graphical display(s) of this data from which the user can make simple queries. Some of the front-end, on-screen real-estate would go towards a table with scroll-bars and possibly filtering options. Other real-estate would go towards the graphical/visual representation of said data in the form of a simple pie chart, histogram, and time-series.

We can provide a wire-frame concept for the visual aspects (4), of this work.


We are flexible and open to any design feedback/recommendations you may have and can possibly tailor the job/budget accordingly. We will require a non-disclosure agreement (NDA) with the freelancing person or entity. We look forward to working closely with the freelancing person or entity to devise a solution that fits the budget. Should this project become a success, we would welcome a continued working relationship with the freelancing entity as our immediate go-to for future jobs/tasks.


Time is of the essence for this project. We are looking to get started immediately.

Compétences : HTML, Javascript, MySQL, PHP, Design de site internet

en voir plus : website to freelancing, website project freelancing, website of freelancing, website non disclosure agreement, website makes, website freelancing websites, website for design freelancing, website design freelancing, webpage design jobs, visual design jobs, visual c# jobs, us freelancing site, to freelancing websites, time-series design, statistics freelancing, some freelancing site, site of freelancing, site freelancing, simple data structure, scraping a server, requirements for freelancing, representation of array in data structure, real freelancing websites, real estate jobs, project based freelancing

Concernant l'employeur :
( 0 commentaires ) Ottawa, Canada

Nº du projet : #1024740

11 freelance font une offre moyenne de $522 pour ce travail


I can offer my high quality web scraping services to you. Please contact if interested.I am expert.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 0 jours
(132 Commentaires)

We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(265 Commentaires)

Lets [login to view URL] pmb for details. Thanks ...

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 10 jours
(166 Commentaires)

.net/php experienced

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(15 Commentaires)

Hello, We will be keen in taking this up. We will provide you with single point of contact, who will be available on skype or any other IM's. Kindly check the PMB. Regards, Credent Team.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 25 jours
(4 Commentaires)

Hi Plz check the PM

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 35 jours
(4 Commentaires)

Right profile and high quality work await your acceptance. Please check PMB for details. Thanks & regards.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(4 Commentaires)

Hello, We are having great skills in design, xhtml, css, mysql, php, Joomla,J2ee ,data entry. We would like to offer our services to complete your website build. We will provide an xhtml, website using css, with a lis Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(0 Commentaires)

Ready to start right [login to view URL] Pm

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(0 Commentaires)

I'm familiar with data scraping and data mining techniques, as well as well-versed in open source data manipulation tools. Had lots of experience in designing database schema to accommodate scalability and efficiency. Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(0 Commentaires)

Hi, I have 4+ exp In programming and believe in quality output, please check my pmb and be a part of my services forever and I have also good client satisfaction across the world. I have good command on 1. Oscomme Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 10 jours
(0 Commentaires)