I want to scrap the data from [login to view URL] site (not the rss feed)
I would need most of the important fields in all the ads on these sites (city, category, title, date posted, brief description, detail description, image links, etc). I want these sites to be scrapped and the data should be put in a csv file, or put into a mysql db (insert statements).
At the end of the project besides the data, I would also need the scripts so that I can scrap them on periodic basis. payment will be via paypal. Let me know the exact cost and time this will take. If you have done similar work in the past ..send me a sample deliverable.
I can do this. I'd prefer to write the write the program in Ruby, but if that's a problem, I'll use Perl. I can send the output to a CSV file; to a MySQL script; or insert it directly into a MySQL database. The choice is yours. Please see PMB for examples of similar work that I did.
Hi
I am new at GAF but I have four years of experience as Software Engineer. I have working experience of PERL, C, C++, PHP and MySQL. I am working to develop Web Crawlers for various video sharing sites like youtube, dailymotion, metacafe, AOL and many more using PERL and MySQL for the last 4 years. I have vast experience of PERL.