Pyspark unit test cases

There is a simple project on Python testing.

Pyspark unit test cases need to be developed.

Roughly 10 functions and likely to take a few hours

for total work for experienced developer.

Any IDE like intellij or Pycharm will do.

Unit test library name is "Unittest" , using "mock".

Details of what the function does, variable details, and expected results.

Functions will involve pyspark dataframes and udfs (user defined functions).

Input1 (variable1) is json text data with multiple nested key value pairs.

Input2 is a list of keys from a json file (variable2) ,

output will be these attributes in json format (variable3).

Some functions will involve returning results.

Some are only to call other functions without a return value.

Set of python pyspark functions involving dataframes, uds,

general pyspark operations such as join, select, python lambdas,

reading and writing files from and to S3,

handling different spark data types like integers, arrays, strings

and different data formats such as csv, json.

Compétences : Python, PySpark, JSON, Tests de Logiciels

En voir plus : test cases auto insurance project, simple project python, write unit test cases java hsbc, automate unit test cases, how to copy test cases from one project to another in jira, copying test cases from one project to another in jira, how to move test cases from one project to another in jira, add unit test to existing c# project, copy test cases from one project to another in zephyr, moving test cases from one project to another in tfs, add unit test to existing mvc project, how to write unit test cases in java, qt unit test cases, how to run unit test cases in android studio, how to write unit test cases in react js, how to write unit test cases, unit test cases in c# for console application, unit test cases in asp.net core web api, how to write unit test cases in react js using jest, writing unit test cases react

Concernant l'employeur :
( 0 commentaires ) India

Nº du projet : #31461238

7 freelances font une offre moyenne de 9301 ₹ pour ce travail


hi I'm professional python developer with 6 plus years of experience and I have experience in test automation also. have used unittest, pytest and robot framework also..so I can do this task..

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% INR en 2 jours
(16 Commentaires)

Hi, I am an experienced Data Engineer with a solid background in Spark. I have also experience in writing units tests in Python and Scala. Let's have a call for more details about the project. Regards

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% INR en 3 jours
(1 Évaluation)

I have pursued my bachelor's degree in computer engineering I've completed the data science course by Greyatom and I've also worked on capstone projects like Sentiment analysis of Twitter data. I'm comfortable with cod Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% INR en 7 jours
(0 Commentaires)

Hello, Greetings for the day!!! I have gone through your requirement and understood every aspect of them. I can help you with your requirements and my work will be flawless. I have experience of more than 3 years. Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% INR en 30 jours
(0 Commentaires)

"Hi !! Nice to E-meet you. We have more than 5 years experienced in Android, iOS, Windows App and Web Design and Software Development. We Can develop entire project from scratch or modify existing code, fix bugs & ass Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% INR en 7 jours
(0 Commentaires)

A result-oriented, energetic professional having 7.6 years of experience in Functional and Automation testing in Selenium using Python & Core Java. ISTQB Foundation Level Certified with proficient in managing all phase Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% INR en 7 jours
(0 Commentaires)

Hi I am a Cloudera certified Hadoop Developer(CCD-410). I have 9 years of IT experience and 6 years of Bigdata technologies like Hadoop,Yarn,Hive,Pig,Spark,Scala,Python,Java,Snowflake and R. I am familiar with PySpar Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% INR en 4 jours
(0 Commentaires)