Deep Q network

Job Description:

The aim of this project is to develop a reinforcement learning agent that aims at the target container and pours all the objects into it without spillage. You are provided a scene with two cups and two cubes.

If you run the code, the cup should start rotating at a velocity randomly chosen from a predefined set (thee velocities are more diverse than in part two). Use the provided functions to move the pouring cup horizontally while rotating it.

Action Space:

The source cup can be moved along the X-axis by selecting an action from a predefined set [-2, -1,0, 1, 2]. You don’t have to move the cup in any other axis.

State Space:

The state space involves:

The position of two cubes

The position of source cup

Velocities of the two cubes(optional)


the Q-Learning algorithm to develop the Q-table. For most problems, it is impractical to represent the Q-function as a table containing values for each combination of state and action. Because of that, in this part, you have to train a Deep Q-Network to estimate the Q-values.


Submit your training and testing code

Submit a video that shows cubes are falling to the target after you run your code

Submit a .txt file that contain the log of the training, including the accumulated rewards for each episode, TD errors for each DQN update

Submit a .txt file with the following result:

How many times all the cubes fell successfully to the target in 100 trials if your state space consists only cup position?

How many times all the cubes fell successfully to the target in 100 trials if your state space consists both cup position and two cube’s position?

Compétences : Neural Networks, Deep Learning, Python, Machine Learning (ML)

Concernant le client :
( 0 commentaires ) Tampa, United States

Nº du projet : #35343335

Décerné à:


Hi, How are you? Very happy to bid your project because my skills are fitted in your project. I have 8 years experience in Machine learning ,Deep learning ,NLP and AI. I am very familiar deep Q learning. If you send t Plus

%selectedBids___i_sum_sub_7% %project_currencyDetails_sign_sub_8% USD en 2 jours
(53 Commentaires)

4 freelances font une offre moyenne de 175 $ pour ce travail


Greetings I saw your project and as an expert in Python/ML/AI/DL I am sure I can do your task. I have previously worked on various state of the art deep learning projects which includes making models for text, music in Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(16 Commentaires)

Hello, I have rich experience in Python coding for Q-learning. I have read all your explanations carefully and fully understand your requirements. So I am sure I can give you correct and good results. I would appreciat Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 3 jours
(0 Commentaires)

Hi, I have master's level qualification in AI/ML/DL and 5 years of industry experience. I have read your description. You need to build a Q-learning NN for your pouring agent. I can help you with this project. Let's d Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% USD en 7 jours
(0 Commentaires)