Create a search engine / fetcher to get specific data from some sites
Budget $750-1500 USD
Job Description:
Hello,
I want to use one open source search engine to populate a database with prices and presentations of all products of a list of specific websites.
For example, I have a list of sites, like [login to view URL]
I want the crawler to enter all the products in that page and all pages in the list I predifined, like this product page: [login to view URL]
and get the name of the product, the brand, the price, the SKU and any other data from the product sheet present in that website.
Then I need ALL this information to be saved in a database, looking like this:
| website ID | website name | URL | product URL | Price | SKU | name of product | brand | any-other-field | date of data fetched |
I need all this data to be fetched daily, once per day, from all the sites in the predefined list.
I want this to be saved in a MySQL database and can be done with any open source search engine in Java, Javascript, Python or PHP
Locally we have more experience with PHP so that is preferred but not needed.
It will be hosted in an CENTOS server with Apache.
I don't want to program from ZERO a search engine. The requirement is specific to *use an existing open source search engine*
The service must include installation and testing.
Thanks!
51 freelances font une offre moyenne de 1332 $ pour ce travail
I have gone through your job description. I am full stack developer have 6 years of experience in web designing and development. I've sound knowledge PHP, CI, Laravel,React, Node.js, Angular, WordPress, HTML, Bootstrap Plus
Hi. We are developing a tool for web crawling and we can use it to get the data you need in the structured way and insert in DB. We can also run this on our end and scale as needed. Let's discuss more details.
Hey!, I’ve carefully checked your requirements and really interested in this job. I’m full stack node.js developer working at large-scale apps as a lead developer with U.S. and European teams. I’m offering best qualit Plus
Hello, hope you are doing well. We have done different scrapping work before. We can fetch data using different library and framework such as Scrapy. Beautiful Soup or Selenium. We mostly use python for scrapping but w Plus
Hi there, I have read the description and understood the project but I have few questions. Please ping me back for further discussion. Looking forward to hearing from you soon. Regards, Pooja Bohra
Hello, How are you? I have rich experience in fetching products data from websites using PHP and then save to MySQL database. And then I can add a cron job to run daily to fetch products. Finally I can build a search Plus
Hello, I have gone through your project details Create a search engine / fetcher to get specific data from some sites and can definently do it according to your mentioned requirements I am a professional Full-stack dev Plus
Hi, I just read your job posting and it sounds like you need Open Source, PHP, Web Crawling, Web Scraping and MySQL. I am a senior developer and have been working in this field 4+ years. I'm very interested in your job Plus
Hi there, I'm a expert Web Developer with WordPress. I'm very much interested in: Creating search engine / fetcher to get specific data from some sites project you posted. My Coding skills: PHP, Python, JavaScript, H Plus
Hello There, I have gone through your project and understood your project description completely. I have oustanding experienced SEO specialists and they have already worked on several website ranking projects as wel Plus
Hello. Experienced PHP/Python/Javasript/MySQL developer here with 6+ years of hands-on experience in web scrapping and exclusively worked on search engine projects. I would like to ask the following questions relevant Plus
Hey! I understand your project description completely. I am an experienced SEO specialist and have worked on several website ranking projects as well. I also serve my skills as a blogger and articles writer. I will bo Plus
Hi sir am interested in your task. I read the description and found myself eligible for the task to do with my 4 years development experience. Quality work and client satisfaction is my first moto. Give me chance prove Plus
Hi! I am professional Digital Marketing expert with skills including Open Source, MySQL, Web Crawling, Web Scrapingand PHP. Please send a message to discuss more about this project. Thanks & regards
Hola, Gracias por compartir el requisito de su proyecto. Leemos su requerimiento y lo entendemos. Para entender más y aclarar nuestras dudas, queremos hablar contigo. Por eso, envíanos un mensaje para que lo analice Plus
Hello! I'd love to do your search engine project as per your desired needs and requirements. I am a Full-Stack developer with over 7+ years of experience in web development (PHP - Laravel, E-Commerce, WordPress and CI, Plus
Hello, How are you today? I already made a similar application for a dropshipping website that crawl over products and get the specific informations depends on the website so it wont be that hard Hit me up with the lis Plus
Hello, I am a Full-Stack developer with over 3+ years of experience in web development (PHP - Laravel, E-Commerce, word press and CI, NodeJS, HTML, Python, CSS, React Js, React Native, Mobile App Development, Kotlin, Plus
Hi, It is easy, I can do on time. I work online, where you can track progress of your project. I have 6 years of experience in development(websites, web applications, mobile apps, desktop applications, I/UX), using PHP Plus
Hi, Hope you are doing well. We are much expertise group of iOS, Android, Website developers and Designers Please review my profile - https://www.freelancer.in/u/rijutapatidar I understood the initial scope of Create a Plus
