Fermé

Simple Website Scraper Needed

Simple script needed to randomly generate six characters (letters and numbers in upper and lower case). This will be added to the end of a specific website URL that will be provided.

Website will provide a "page not found" or else will provide "title, user name and date".

This result will need to be pulled from the html and saved to a database.

Database should contain four items - generated six character string, title, user name, and date.

Script needs to check database to verify if the generated six string text is a duplicate already in the database. If its duplicate, but is saved as "page not found" then it can be updated with title, user name and date.

Would also like the option to turn off or comment out this duplicate check in case it becomes too CPU intensive.

Open to suggestions on how this is done and how the data is saved. Thanks.

Compétences : PHP, Web Scraping, MySQL, Javascript, Python

en voir plus : script researchers needed, script writers needed, php script writer needed, simple website scraper, script reader needed, paypal script amount needed balance, spider parsing database website scraper, spider parsing database website scraper extract public, clips4sale script clone needed, website scraper php script, simple vb script check sql database connection, type website needed regular updates needed, website photo video creation capabilities needed, medical script writer needed, script coder needed, action script flash needed, shell script expert needed, need custom ptc script features needed, We would like to have a responsive design in photoshop, no html. It needs to be a google perfect website, speed is important., I would like to turn the pine script into a MT4 automated

Concernant l'employeur :
( 21 commentaires ) Chicago, United States

Nº du projet : #22620826

56 freelance font une offre moyenne de $143 pour ce travail

mantislin

Hi there, This is Lin, i did more than 380+ scraping project, please view my profile page here https://www.freelancer.com/u/mantislin.html then you will know. Can we discuss more details about your project? then i ca Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(443 Commentaires)
7.9
mhmhz

Hi I can create a tool that check the URL that composed using the random six characters. Thanks

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 2 jours
(174 Commentaires)
7.9
gangabass

I can provide you a Python script that will work exactly like you want: it will generate a random sequence, check database if you already have saved it, next perform a web request and parse HTML. Result will be saved i Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 2 jours
(585 Commentaires)
7.6
zekovicm

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(125 Commentaires)
7.5
polarjin2017

Hello? How are you? I am excited to work with you on this project. I have done a lot of jobs with python like Django admin, Flask, python scrap, pysql, python tkinter GUI etc Here is on of my scrap with python wor Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(155 Commentaires)
7.2
CodeWolves

Hi, I am Wordpress, PHP , Woocommerce Expert i can do your task easily i have read your job post and i am sure, i can do that, i have more than 12 years experience in designing & development. Work: https://ironsidec Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(159 Commentaires)
7.6
chirgeo

Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields do Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 2 jours
(133 Commentaires)
7.4
maciekjanowski5

Hi. My name is Maciej. I am a Python developer with over 3 years of experience. I can develop for you a web scraping script, that will get the title, username, date or page not found, as well as generate a random six-c Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(113 Commentaires)
6.8
ineedWorkJob

Greetings sir, I have read your project details and i will develop the data scrapping software wuth 6 random strings for you. Sir, i can deliver this project sooner than you expect and will be over your satisfact Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(153 Commentaires)
6.9
cyberloh

hello, i'm a highly experienced web automation developer with 10+ years of creating scrappers and bots here - you can check my reviews. i have good python, node.js and database skills to provide you completely awesome Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(22 Commentaires)
6.6
mananraja

HEY, I can make a PROGRAM to do this process automatically and save the results as per your description. I would love to know more details with you in chat. Thanks.

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(182 Commentaires)
6.5
elbruninh

Hi, i'm interested, could you give me more details please? what website do you want scrape? can you send me a sample valid URL? i can make a php scraper + MySql database i have 18+ years of experience with PHP and scra Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(113 Commentaires)
6.5
schoudhary1553

Hello Sir, I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without cha Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(90 Commentaires)
6.8
nisharapath

Hello. As a web scraping and data mining expert by python and node.js, selenium web driver, I am glad to place the bid on your project. I have experienced LinkedIn profile scraping, amazon products scraping and ticket Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(66 Commentaires)
6.4
nvbishr

I can write chrom extension to do the work automatically..............................................................................

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(53 Commentaires)
5.8
khoadeveloper

Hi, Dear client. I am a web scraping/automation/bot/chrome extension expert with 6 years of experience in NodeJS, Puppeteer, Chromy, Selenium, Chrome-extension, Chrome-headless, Firefox-headless, SilmerJS, PhantomJS, Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(19 Commentaires)
5.7
songhku925

Hi. Do u have good weekend now? I have already finished lots of Web Crawling, Scraping and Automation project using python Scrapy, Bs4, Selenium. I can extract data you want from any site and I can store extracted data Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(22 Commentaires)
5.5
smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(90 Commentaires)
5.8
marcnealer

Hi I'm a python coder with 10+ years experience. Generating the codes and checking is not an issue. I can make multiple threads where one makes strings and checks the dB, then puts them on a queue. The second then ru Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 5 jours
(11 Commentaires)
5.9
osmanaydin

Hello sir, Please take a look at my reviews and portfolio. I have completed web/data scraping jobs for many times. I am interested in your project as well. I would like to discuss details via pm. I look forward to he Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% USD en 1 jour
(46 Commentaires)
5.6