En cours

Build 11 tiny scrapers to supplement main scrapers

Stagecoach Software Pty Ltd is developing a website to contain statistical profiles of a particular industry in Australia. Our stack is Ruby on Rails 4.2, Ruby 2.2, Passenger 4 and MySQL 5.5. We run a 3 server configuration on Engine Yard with dedicated instances for our db, web app and utilities. Our database receives about 30,000 new rows per day through scraping operations (22 different scrapers using nokogiri). Presently our app instance only provides admin operations; the consumer front end is under development.

Currently our team comprises 4 backend ruby developers and 1 front end developer.

Each of our scrapers records the URL of each relevant product. We wish to record the last date each product is advertised for sale. We therefore need 11 nokogiri micro scrapers developed that will log on to the URL of each current product and insert the current date into a designated column if the advertisement is still current.

Each scraper must run as a discrete *.rb file and be capable of running as a cron. Code must be included to make each scraper record start and stop times and number of columns populated on an admin page that is already doing the same for all existing cron jobs. Further instructions will be given to the successful bidder.

All code must be uploaded to github and approved by the lead developer before deployment.

This is one of a pipeline of projects in this enterprise. Further ruby projects will be available if the above tasks are carried out well. Applications from a freelancer experienced with Engine Yard are welcomed.

Compétences : Ruby, Web Scraping

Voir plus : web software development freelancer, website freelancer australia, website developers jobs, website developers australia, website developed ruby rails, website database developer australia, web page backend development, web jobs australia, web freelancer jobs, web development jobs australia, web development freelancer jobs, web development enterprise, web developers jobs, web developers freelancer, web developer profiles, web deployment freelancer, web app developer jobs, using freelancer australia, tiny freelancer, supplement jobs, successful freelancer profiles, statistical jobs australia, software jobs australia, software freelancer jobs, software development projects freelancer

Concernant l'employeur :
( 52 commentaires ) Idalia, Australia

N° du projet : #8483410

10 freelance ont fait une offre moyenne de 478 $ pour ce travail

srinichal

I am an expert in delivering custom software and scripts willing to discuss further abut the project details

578 $ AUD en 10 jours
(55 Commentaires)
6.6
mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

578 $ AUD en 6 jours
(114 Commentaires)
6.7
uumairkhalid

Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have huge scraping experience. look Plus

333 $ AUD en 10 jours
(136 Commentaires)
6.8
rubyonrailsdev21

Hi, I have done so many projects in ruby on rails, php, wordpress, joomla, andriod, in many more other skills and have +5 years experienced in ruby on rails, php and in mentioned technologies, you can have a look o Plus

555 $ AUD en 10 jours
(22 Commentaires)
4.8
colindao

Hi, I'm Colin. I am confident that I can work well with your team. I have 3+ years on Ruby on Rails and experience and I have experience with Nokorigi as well. I did web scraping job. example: https://gist.gith Plus

333 $ AUD en 10 jours
(13 Commentaires)
4.8
prem89k

Hi, I have 5+ years experience in ruby for creating web apps and web scraping. I recently scraped Amazon, Yell, Ebay and Zillow. Have experience using Mechanize, Nokogiri and Anemone. Let me know if you would be inte Plus

300 $ AUD en 5 jours
(7 Commentaires)
4.4
krunalcp

David, here I updated my bid amount as we discussed .................. .................. .................. ..................

550 $ AUD en 10 jours
(3 Commentaires)
2.9
smartwinz

HI Greeting of the day!! I am a self-motivated passionate full stack Ruby on Rails developer with background of Software Engineering.More than 3 years of experience in developing large scale rails projects with d Plus

555 $ AUD en 10 jours
(1 Commentaire)
2.4
NeelamNetucon

Hello there, I Neelam Mehta PHD in computer science from JRN Rajasthan Vidyapeeth University, Udaipur, India. I have 11+Years experience in this field with 91% of success ratio. Delivering top-level services is my spe Plus

444 $ AUD en 10 jours
(0 Commentaires)
0.0
meeasyhappy

A proposal has not yet been provided

555 $ AUD en 10 jours
(0 Commentaires)
0.0