Analysis and extraction of youtube data with python



1: We have to write the code in python for extracting the data which should be done in hadoop environment from youtube.


2: We have to load the file from local to hdfs and create hive and impala tables.

3: Now load the data of hive and impala.


4: Segmentation: Load the data from Hive or Impala using pyspark

5: Create dataframe

6: Build Analysis like:

A: Number of users who see videos related to money deposit in banks.

B: Number of users who transfer money within same banks and to external bank accounts.

C: Segmentation: Find the location, age, number of comments, likes, feedback of users who see the videos.

It will be better if you setup cloudera environment from there we can do everything in python.

Compétences : Hadoop, Hive, Python, Spark

Voir plus : python data entry, use python data website, python data website, python data extraction, upload data youtube, free money transfer bank, data encodingdata extraction

Concernant l'employeur :
( 0 commentaires ) United States

N° du projet : #12697400

8 freelance ont fait une offre moyenne de 276 $ pour ce travail


Hi, I am competitive to this kind of task, can take good care of this project. In fact, I already done related to this job before. Let me know the best of your time so we can discuss further based on your requirements Plus

199 $ USD en 3 jours
(13 Commentaires)

i am good in hadoop , spark , hive , sqoop and python . i would like to start this work as soon as possible . hope we can proceed

155 $ USD en 3 jours
(12 Commentaires)

Hello, I can complete your requirement in given time. I am experineced python developer. Looking for your answer. Thanks, Jigar

200 $ USD en 5 jours
(2 Commentaires)

I have 9 years of exeperience in IT industry with more than 2.5 years of experience in hadoop technologies like Hive,Pig,Sqoop,Map Reduce,Hbase and Spark

200 $ USD en 3 jours
(1 Commentaire)

PYTHON EXPERTS WITH 6+ YEARS EXPERIENCED! Hello, Thank you for sharing opportunities. we are a team of 70 full time freelancers having expertise on PHP and all CMS like WORDPRESS, PRESTASHOP, OPENCART, JOOMLA, S Plus

533 $ USD en 5 jours
(0 Commentaires)
222 $ USD en 4 jours
(0 Commentaires)

Advanced Python DEMOS: https://www.dropbox.com/s/vojuvky7pu6fdq8/OpenCVVideoSlicing.zip?dl=0 https://www.dropbox.com/s/d5sq6rq017j01xk/PhotoStitchPython.zip?dl=0 https://www.dropbox.com/s/viusckxh5jy3yt8/OpenCVImage Plus

611 $ USD en 23 jours
(0 Commentaires)

Hello, I am applying for this job because I've a keen interest in BigData technology and I’m considering your job post for me with the required capabilities. I have learned Hadoop and its components Hive, Pig, Sqoop, Plus

89 $ USD en 15 jours
(0 Commentaires)