I need a web crawler program to get the information for a public online ecommerce platform.
- select category or sub-categories of ecommerce platform (continuous update, allow add or delete)
- input brands to be ignored (continuous update, allow add or delete)
- run the program 7x24
- go through each listing one by one (by program in backend)
- record down the sales quantity (to be found out by program, as online platform will not report the data)
The most time consuming method (manual) is to click individual listing every day, check the inventory available for sale (by buying maximum quantity in shopping cart if no inventory data is available), and compare with previous day.
- record all sales quantity for each listing (if quantity is different)
- output and update to an excel file (any database e.g. MYSQL format is OK, but still need to convert back to excel file as output file) 1 by 1, and save the complete record of each category (after complete the category) in Google cloud.
- product name (with http link back to product listing), quantity sold yesterday, quantity sold last 7 days, quantity sold last 30 days, total no. of visit
- unit price, no. of sellers, brand name, seller status, image http link
- sort by highest quantity sold, brand name, unit price.
The program shall re-start automatically if there is the server is down, loss of internet connection etc.
Getting the inventory of a listing is the most time consuming.
How to update and store the data is most challenging as the listing position in web site is changing every second. The output excel file has to store 31 days data.
Online ecommerce platform does not have any support nor API.
The program shall be able to run in Windows 10 (English). It is recommended the browser to use internet explorer as the computer has other program running with Google Chrome. if developer can ensure no conflict, it is OK to use Google chrome (e.g. incognito mode).
Interested parties please send a detail quotation - time and cost. Debugging is the most time consuming.
Ecommerce platform may blocking enormous machine visit the site. Developer shall handle how to deal with such IP blocking etc.
Deliverable shall be an executable program, which we can download from Google cloud. No teamviewer etc. installation.
After completion of the program (and debug), developer shall run the program by 7 days (7x24) and send out the excel output file for checking. If positive, developer shall upload the executable file to Google cloud for us to install the program in PC to test for another 7 days. Next, developer shall install and set up the program in Windows VPS for continuous running.
30 days warranty shall be counted after running in VPS.
Automatic or chat bot response will not be considered.
Interested party please contact for the name of public ecommerce site.
Applicant shall prove he can do the program by providing a sample excel file extracted from captioned web site. Manual data capture for 5 items is sufficient.
Upon completion of the project, applicant will be awarded for 2nd project with different ecommerce site (same requirement).
30 freelance font une offre moyenne de $571 pour ce travail
IT FLEX SOLUTIONS has focused exclusively on the Web Development/Designing projects with 10+ years of service. Our Web Development/Designing expertise has helped clients to create e-commerce, social networking, real-es Plus
we will discuss details. Please open Message box so that we discuss it in detail Expertise ================== - PHP - Cryptocurrency - Code Ignator - Magento - Laravel - Wordpress - Zen-cart - X-Cart - Website Design Plus
Hi there, I've read the project(Data fetching from public ecommerce platform (English)) description i can work on your project and get it completed in timely manners. I’m a strategic developer with a strong coding/de Plus
I have done many similar projects related to web scraping information from different websites. Very interested to work on this project. I am absolutely confident I can finish this work on time and on budget to highest Plus
Hello Sir!! We read your proposal descriptions and wanna tell you that we are “Master Expert in PHP & WordPress” and immediately available to discuss and start working on your project. We have developed/completed 500+ Plus
Hi, employer. I've read your proposals carefully. I am a web full stack developer. I am strong in php and database programming Live websites [login to view URL] [login to view URL] https://earnext Plus
Hello Sir, I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without cha Plus
Hello, Please provide the name of public ecommerce site. Please ignore my price - it just a placeholder to clarify details and to estimate workload. Regards, Sergiy
Yes. Dear Client. I have read your description with care. I can. I have rich experience like that before. Your project is very fit to my skills. If you would award it to me, I am sure that I can complete this project w Plus
Hi, I have checked out the description carefully and can make you an eCommerce platform for Data fetching from the public, I would love to discuss this further so can we have a chat? I’m an expert with eCommerce and h Plus
*****Web Data Scraping Expert ***** Hello. I have read your job description carefully. I have full experience in Web Scraping with PHP and Python. So I can do your project perfectly. I can start just now and I can del Plus
Hi, are you looking for Real Web Expert? Then WELCOME to the right place! High-quality and Fast-delivery is promised! As a highly skilled full stack developer, I have rich experience in Web development. I am very conf Plus
Hello, I carefully checked your requirements and really interested in this job. I am a developer who codes. My name is Avdo Džino. I was born in Sarajevo, and currently spending my life in Ljubljana, Slovenia. I went Plus
Hello How are you? I have read your project details for me but I have some questions to ask so please ping me for other details thanks, Let's discuss about this project friendly. I have good experiences built and cus Plus
✅Hi public ecommerce site : [login to view URL], [login to view URL] etc High Quality & Fast Delivery is promised. I am full stack web developer and have enough experience of web scraping using Node and Python. I am very confident with Plus