In Progress

Scrape ads, modify them and send them back to the original server

Hi there,

we need a script on our server that fetches ads from other sites, makes them static html elements (an image or text with a link) and sends them back to the users of these sites asynchronously.

You will have to use a headless browser / webkit like phantomJS to do so. It has to be very fast and be able to handle millions of queries. The environment is amazon ec2.

We have access to both our server and to the source code of the website that is beeing queried.

Let's call our Server A and the other site B.

Example of one query:

1) Some human on this planet opens B in his/her browser

2) The PHP or JS code embedded in B sends a signal to A that it should start and provides the exactl URL

3) A uses a headless browser to load the url provided. It does not just scrape the source code, it renders the page (meaning JS will be executed)

4) A downloads the ads in the page as static text or static images

5) A now sends the ads back to the B site where they're asynchronously added to the page the user has already opened

Through this process, a dynamic (javascript) ad becomes a static html element.

Notes:

-- we need to decide if we need caching based on performance data. If we need it, it will be very simple, skip steps 1-4 and just send the cached ads

-- there will be only 2 types of ads, so the "ad-detection" will be simple

-- I'm a junior coder and can assist you to the best of my ability.

Looking forwards to your bid!

Compétences : AJAX, Javascript, node.js, PHP, Architecture Logicielle

en voir plus : the best php coder, planet source code, dynamic javascript website source code, downloads site html 5, call back from amazon, back page ads, amazon call back, server send message multi client linux, java socket server send multiple message, best server send mass emails, ubuntu server send mail, send thousands ads craig list, server send 100000 emails day, server send 100000 emails, java socket server send data client, j2me web server send data

Concernant l'employeur :
( 29 commentaires ) Fürstenfeldbruck, Germany

Nº du projet : #8464376

Décerné à:

johnpo

A proposal has not yet been provided

%selectedBids___i_sum_sub_7% %project_currencyDetails_sign_sub_8% USD en 14 jours
(25 Commentaires)
5.1

19 freelance font une offre moyenne de $1584 pour ce travail

kchg

Hello [login to view URL] freelancer ranking is top 6th and i am full stack developer. I am interested in your project and I hope to work with you. I have enough experience with WEB developing for 5+ years. Client satisfaction i Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 30 jours
(317 Commentaires)
9.0
madhavdutta

Hello Dear, Hope you are doing well!! We are in the top 10 freelancer here. I have gone through your project description and I come to know that you have required Scrape ads, modify theme and send them back to Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 25 jours
(153 Commentaires)
8.6
buraqtech

1. Tours Site + Booking Module We already designed and developed a complete portal for online tours listing with complete online bookings of tours with departures and much more other things in a complete cms based sol Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 22 jours
(100 Commentaires)
8.1
seekdeveloper

Hi, I have read your post and understood your requirement. I have great experience in handling /PHP/MySQL/HTML5/jQuery/Wordpress/Magento/Joomla/Drupal/AngularJS/node.js/CSS3/Java/Python/Django/Javascript/iOS/Andr Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 20 jours
(87 Commentaires)
8.2
patzzVJSOFT

Hello there, I'm clear with the requirements and we can send an request with php to server A when a user open at end server B. if we use js the page would have already load on user browser and only the javascripts e Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 25 jours
(103 Commentaires)
7.6
SRajpurohit

Hello there, It is good to see another serious posting from you. We have gone through the complete job description and are pretty sure to assist you with web app development as we are are a team of developers wor Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 30 jours
(126 Commentaires)
7.3
aistechnolabs

Greetings, Thanks for the opportunity. AIS Technolabs (Expert PHP Developers) is a dedicate team with over 5 years' experience and a strong workforce of 240+ Professionals. Almost 80% of the required technica Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 30 jours
(17 Commentaires)
7.0
iDCreativeUK

Hi, Mark here, I would be interested in discussing this project with you. Thanks for the consideration, I hope to hear from you soon Thanks, Mark

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 20 jours
(22 Commentaires)
6.7
phamtech211

Dear Sir/ Madam, My name is Henry - the owner of PHAMTECH Co. My team is really interested in this project as it is exactly within our scope of expertise: We are web/ app design & development company located in Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 40 jours
(17 Commentaires)
6.7
prashushinde9

I want to discuss this project with you further, let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, i used to be online 14 hrs in a day on this website so probably Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 30 jours
(43 Commentaires)
6.6
isensebd

A proposal has not yet been provided

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 28 jours
(67 Commentaires)
5.6
stefkev

Hello, I am experienced node js developer and i can create a service that you requested. I can utilize phatnom or any headless browser, turn ads to image and send asyncly to users. Caching can be also done for faste Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 10 jours
(16 Commentaires)
5.6
csensemedia

Hello how are you ? allow my team to help you in this project i would like to request you to kindly visit our portfolio hope you will like [login to view URL] waiting for a wonderful response f Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 20 jours
(12 Commentaires)
5.7
speedev196

Hi [login to view URL] name is JiaoMing. I am an expert in web develop such as NodeJS, AngulaJS,express, [login to view URL], MongoDb. I already checked your job. Your job is very interest. May I introduce myself? I am using new accoun Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 20 jours
(18 Commentaires)
4.9
livegoodlife

A proposal has not yet been provided

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 4 jours
(11 Commentaires)
4.4
ZhangWei99

Hello,sir I've read your job description and understood your requirements. As I am a senior angularjs,node.js ,PHP and mongodb expert, I am very interested in your project. I've many experiences and strong skills f Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 10 jours
(5 Commentaires)
3.2
radhe25shyam

A proposal has not yet been provided

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 20 jours
(7 Commentaires)
2.5
infynic

Hello sir, We are a software, web and mobile development company from Ahmedabad, India. We are working with team of young professionals developing for Mobile apps. We develop applications for iPhone, iPad, Andro Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 25 jours
(0 Commentaires)
0.0