Data fetching from public ecommerce platform

I need a web crawler program to get the information for a public online ecommerce platform.

- select category or sub-categories of ecommerce platform (continuous update, allow add or delete)

- input brands to be ignored (continuous update, allow add or delete)

- run the program 7x24

- go through each listing one by one (by program in backend)

- record down the sales quantity (to be found out by program, as online platform will not report the data)

The most time consuming method (manual) is to click individual listing every day, check the inventory available for sale (by buying maximum quantity in shopping cart if no inventory data is available), and compare with previous day.

- record all sales quantity for each listing (if quantity is different)

- output and update to an excel file (any database e.g. MYSQL format is OK, but still need to convert back to excel file as output file) 1 by 1, and save the complete record of each category (after complete the category) in Google cloud.

- product name (with http link back to product listing), quantity sold yesterday, quantity sold last 7 days, quantity sold last 30 days, total no. of visit

- unit price, no. of sellers, brand name, seller status, image http link

- sort by highest quantity sold, brand name, unit price.

The program shall re-start automatically if there is the server is down, loss of internet connection etc.

Getting the inventory of a listing is the most time consuming.

How to update and store the data is most challenging as the listing position in web site is changing every second. The output excel file has to store 31 days data.

Online ecommerce platform does not have any support nor API.

The program shall be able to run in Windows 10 (English). It is recommended the browser to use internet explorer as the computer has other program running with Google Chrome. if developer can ensure no conflict, it is OK to use Google chrome (e.g. incognito mode).

Interested parties please send a detail quotation - time and cost. Debugging is the most time consuming.

Ecommerce platform may blocking enormous machine visit the site. Developer shall handle how to deal with such IP blocking etc.

Deliverable shall be an executable program, which we can download from Google cloud. No teamviewer etc. installation.

After completion of the program (and debug), developer shall run the program by 7 days (7x24) and send out the excel output file for checking. If positive, developer shall upload the executable file to Google cloud for us to install the program in PC to test for another 7 days. Next, developer shall install and set up the program in Windows VPS for continuous running.

30 days warranty shall be counted after running in VPS.

Automatic or chat bot response will not be considered.

Interested party please contact for the name of public ecommerce site.

Applicant shall prove he can do the program by providing a sample excel file extracted from captioned web site. Manual data capture for 5 items is sufficient.

Upon completion of the project, applicant will be awarded for 2nd project with different ecommerce site (same requirement).

Compétences : PHP, MySQL, Architecture Logicielle, Javascript, HTML

en voir plus : ecommerce platform ingram micro, data fetching, ecommerce platform forum, data entry public websites refundable fee paid, bid ecommerce platform, php html data fetching, paid free ecommerce platform, white pages data fetching program, ecommerce platform website, ecommerce platform client list couturelab, ecommerce platform import vendors products display live quantity stock xml integrationaware, ecommerce platform rating, multi store class ecommerce platform system clone netshops, odin data fetching, online data fetching, vb realtime data fetching, wp ecommerce platform projects, facebook ecommerce platform, shirt ecommerce platform

Concernant l'employeur :
( 37 commentaires ) faridabad, India

Nº du projet : #22949893

5 freelance font une offre moyenne de $175 pour ce travail


I have done many similar projects related to web scraping information from different websites. Very interested to work on this project. I am absolutely confident I can finish this work on time and on budget to highest Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% AUD en 5 jours
(192 Commentaires)

Hi, dear [login to view URL] for posting ur project and ur attention, i read ur project carefully. I can carry out ur task with the lowest budgets than anybody. HTML5/ajax/CSS3/PHP/JQuery/javascript/WordPress/CI/Laravel/Bo Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% AUD en 7 jours
(132 Commentaires)

I might take time and work for less money. Please contact if you are interested Thanks

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% AUD en 7 jours
(0 Commentaires)

hello, I'm interesting your project very well I'm good in Web Design, html, css , javascript, wordpress, other js such as reactjs, database(PHP and mysql) expert. I’m +5 experienced in these jobs. I will give you unl Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% AUD en 7 jours
(0 Commentaires)

Hi, sir i have read your project detail and find it very interesting , i have experience with web scraping and crawling . We can discuss details in the chat .

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% AUD en 7 jours
(0 Commentaires)