Find Jobs
Hire Freelancers

Web Scrapers - MANY MANY NEEDED

$30-250 USD

Fermé
Publié il y a plus de 13 ans

$30-250 USD

Payé lors de la livraison
What we are in need of is creating more "plugins" for our Media platform. The Plugins are basically "directory servers" to media content. eg: A plugin for Youtube, a plugin for YouPorn, a plugin for MLB, and so on. What changes the most between the plugins, are the actual scrapers. Now I am open to all kinds of content, torrents, videos sites of all kinds, sports, movies, music and so on. The platform the Media Application has been developed in is MONO/.NET. And the scraping is realtime. Basically broken down as: (Basic for understanding) Get_Root (root returns the Base level folder structure of the site being scraped). An example would be (because its easiest to explain) all the categories of video on the youporn site. I have an object defined which is the same for folders or individual items, only setting a flag as whether its a folder, sorted folder (same folder but url to sort - LONGEST, etc) or real item. it includes a number of properties (title,description, and so on), as well as the URI that would be needed to either then "scrape" that folder, or PLAY that item. Get_Folder(URI or other data needed to scrape,start item,reccount) Returns further folders/categorties, or individual items. Get_PlayURL(URI needed to convert), in some case, the immediate playable URL is not available from scraping the folder. (eg you porn, you need to goto the actual page to get the PLAY URL (mp4 download). So this function gets the page and return the PLAYURL. This function can return multiple URLs with media information. Get_Search(search term,startrec,reccount) All thse calls each return items or additional folders. Items returned may or may not contain the direct media link(s), as is the purpose of the Get_PlayURLs function. Now the scrapers can be any language, I dont care, so long as I can access them from with my .NET plugin. Or actual .NET code. LUA has a lib interface, .NET has things like HTMLAgility, and so on. Data can be returned as a NET OBJECT (We will provide this class and Scraper Interface to you) or as XML representing the same object class. We are interested in all obtainable media information (title, duration, description, ratings, publish date, etc) if availble. We will collect the media on our own for media processing, just need the means of browsing/searching for the data, and getting to the content with links. Scrapers may need to impersonate browsers (such as iPhone/iPad) to be able to get actual listings of content available. (eg we do not want SWF links. FLV is ok, MP4, 3GP, etc are always better) We would accept an SWF link if you could also provide the means to extract the FLV source from the SWF. What sites are we open too? Almost everything and anything if it has content. Please bid by providing the sites you wish to provide scrapers for, and the cost for each scraper listed. As we also do understand some scrapers will be easy and some harder. Once bids are received we will break this one project in multiple projects and award each party we have selected. Please request additional information if you have further questions, interest.
N° de projet : 935739

Concernant le projet

4 propositions
Projet à distance
Actif à il y a 13 ans

Cherchez-vous à gagner de l'argent ?

Avantages de faire une offre sur Freelancer

Fixez votre budget et vos délais
Soyez payé pour votre travail
Surlignez votre proposition
Il est gratuit de s'inscrire et de faire des offres sur des travaux
4 freelances proposent en moyenne $225 USD pour ce travail
Avatar de l'utilisateur
It requires you certainly narrow down the sites and let me know the exact specs
$250 USD en 5 jours
4,8 (99 commentaires)
7,0
7,0
Avatar de l'utilisateur
We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.
$250 USD en 10 jours
4,7 (67 commentaires)
6,9
6,9
Avatar de l'utilisateur
hi, i am experienced programmer. i can do this job well. i have made a lot of scrappers and web crawlers bots. Would you like to have a look at some of my past work? please check pmb for more details. Thanks yogesh D.
$150 USD en 3 jours
4,1 (16 commentaires)
4,6
4,6
Avatar de l'utilisateur
Hello Please see PM. Regards, Chandni
$250 USD en 5 jours
2,8 (1 commentaire)
2,6
2,6

À propos du client

Drapeau de UNITED STATES
Winter Springs, United States
4,8
28
Membre depuis juil. 26, 2009

Vérification du client

Merci ! Nous vous avons envoyé un lien par e-mail afin de réclamer votre crédit gratuit.
Une erreur a eu lieu lors de l'envoi de votre e-mail. Veuillez réessayer.
Utilisateurs enregistrés Total des travaux publiés
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Chargement de l'aperçu
Permission donnée pour la géolocalisation.
Votre session de connexion a expiré et vous avez été déconnecté. Veuillez vous connecter à nouveau.