Find Jobs
Hire Freelancers

High-Performance Data Pipeline Creation

₹12500-37500 INR

Fermé
Publié il y a environ 1 mois

₹12500-37500 INR

Payé lors de la livraison
The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for: Analyzing existing data pipelines to understand their architecture, dependencies, and functionality. Working closely with data engineers to develop a migration strategy for converting pipelines from the current framework to the target framework. Designing, building, and testing new data pipelines in the target framework, ensuring they meet or exceed existing performance and reliability standards. Debugging and troubleshooting issues that arise during the migration process, working collaboratively with cross-functional teams to resolve them quickly. Communicating progress, challenges, and timelines to stakeholders on a regula Requirements The ideal candidate is a Data Engineer with considerable experience in migrations and Big Data frameworks. Must-Haves Scala programming language expertise Spark framework expertise Experience working with BigQuery Familiarity scheduling jobs in Airflow Fluency with Google Cloud Platform, in particular GCS and Dataproc Python programming language fluency Scalding framework fluency Pyspark framework fluency Dataflow(Apache Beam) framework fluency
N° de projet : 37972883

Concernant le projet

10 propositions
Projet à distance
Actif à il y a 7 jours

Cherchez-vous à gagner de l'argent ?

Avantages de faire une offre sur Freelancer

Fixez votre budget et vos délais
Soyez payé pour votre travail
Surlignez votre proposition
Il est gratuit de s'inscrire et de faire des offres sur des travaux
10 freelances proposent en moyenne ₹25 530 INR pour ce travail
Avatar de l'utilisateur
With a diversified skill set in research and technical writing, your project will benefit from my meticulous attention to detail and logical thinking. As a computer science degree holder and a certified Project Manager, I have spent over 5 years honing my skills in areas closely aligned with your requirement for this role. These include database management, software analyses and design, Python programming, and software engineering – not to mention my proficiency with the associated Big Data infrastructure. I pride myself on delivering excellent services and building good relations with clients, values that strongly align with your freelance project. By choosing me as your Data Engineer, you're choosing quality work that's time-conscious, reliable, committed, honest - just like your project deserves. It would be an honor to have the chance to contribute my expertise on this crucial migration project for your organization. Let's create better data pipelines together!
₹25 000 INR en 7 jours
4,6 (5 commentaires)
3,6
3,6
Avatar de l'utilisateur
I have rich experience in building the data pipelines in PySpark in AWS Glue environment, would be suitable for this role.
₹25 000 INR en 7 jours
5,0 (5 commentaires)
2,8
2,8
Avatar de l'utilisateur
Here is a Telecommunication Engr will provide you a 100% satisfactory work. I have already worked on a lot of projects relating PYTHON, PANDAS, DJANGO, PYSPARK, NUMPY, PYTORCH, TENSORFLOW, THEANO, APACHE SPARK, PYGLET, KERAS, SCIPY, MLPACK, DLIB, FASTEXT, OpenCV, ALGORITM, C Programming, SQL, JAVA SCRIPT, DATA MINING, REACT, HTML, ASP.NET, NODE.JS and MACHINE LEARNING as main skills. Feel free to contact Regards Alihussain
₹45 000 INR en 5 jours
5,0 (1 commentaire)
3,0
3,0
Avatar de l'utilisateur
Hello Ats A., Glad to say that we have already done a similar project before, would you like to see it? We already have similar experience in the same domain. We are an expert team which have 4 years of experience on Python, Data Processing, Scala, PySpark, GCP AI Lets connect in chat so that We discuss further. Regards
₹28 800 INR en 7 jours
0,0 (0 commentaires)
0,0
0,0
Avatar de l'utilisateur
EXPERT IN ((PySpark, Scala, Data Processing, GCP AI and Python)) DEAR EMPLOYER, I’ve completed the exact same projects before successfully((ProjectTitle)). Awarding me will be the fastest way to complete your task with the best rates possible. I CAN ASSURE YOU 100% THAT WE ARE FULLY CAPABLE OF EXECUTING ANY LEVEL OF TASK/PROJECT BASED ON THE SKILL REQUIRED. I am fully confident about our skills and my understanding of the project description and we are ready to go through any test or sample task you assign to acquire your trust. Let me know when are you available for an initial 15-30-minute discussion (FREE OF CHARGE) so we can discuss the requirement in detail and I can walk you through the mentioned systems to acquire your trust in my skill. REST ASSURED YOUR WORK IS IN VERY SAFE AND PROFESSIONAL HANDS. THANK YOU
₹12 500 INR en 2 jours
0,0 (0 commentaires)
0,0
0,0
Avatar de l'utilisateur
As a seasoned Data Engineer with an established track record in migrations and proficient in Big Data frameworks, I'm confident that I possess the essential skillset your project demands. I have an extensive and proven knowledge of Scala, Python, and Spark, which will be instrumental in efficiently migrating your legacy data pipelines to the target framework. My fluency with other tools like Airflow, GCP including GCS, Dataproc would further enhance the migration strategy. I have successfully executed similar projects before and consistently strive to surpass performance and reliability standards. By understanding the intricacies of your existing pipelines and having worked with Scalding framework previously, I am well-positioned to not just migrate but improve on their performance in Spark Scala. Moreover, my sharp troubleshooting skills coupled with effective collaboration would ensure swift resolutions when any migration issues arise. Most importantly, I understand the value of effective communication throughout a project's lifecycle - from keeping stakeholders informed about progress to addressing their concerns promptly. Thus, if given this opportunity, be assured of well-encrypted high-performance data pipelines that'll scale impeccably for your business needs. I look forward to leveraging my expertise for an impactful execution of your project.
₹25 000 INR en 7 jours
0,0 (0 commentaires)
0,0
0,0
Avatar de l'utilisateur
Hi, I hope this message finds you well. I recently came across your job postingand was immediately intrigued. With a strong background in Python development, I am enthusiastic about the opportunity to contribute to your team. I have extensive experience crafting robust solutions and deploying them across various platforms. Having successfully completed similar projects for clients in my area, I am confident in my ability to tackle your project head-on and deliver results within your specified timelines. I am eager to bring my proficiency to your team and make meaningful contributions to your projects. Thank you for considering my application. I look forward to the possibility of discussing how I can be of assistance. Best regards, Atiksh
₹30 000 INR en 30 jours
0,0 (0 commentaires)
0,0
0,0
Avatar de l'utilisateur
DATA ENTRY I have proven experienced in data entry or similar roles. I have an excellent typing speed and accuracy, proficient in using Excel and also have an experience.
₹14 000 INR en 6 jours
0,0 (0 commentaires)
0,0
0,0
Avatar de l'utilisateur
We are thrilled to submit our bid for the Data Engineer contractor role focused on migrating data pipelines from legacy infrastructure to modern frameworks. Our team is equipped with the expertise and experience necessary to seamlessly transition your pipelines to Spark Scala, ensuring enhanced performance and reliability.
₹25 000 INR en 15 jours
0,0 (0 commentaires)
0,0
0,0
Avatar de l'utilisateur
I am currently working as a data engineer in syren cloud. Handling large number of data pipelines and maintaining ETL process. I am best suits for this role.
₹25 000 INR en 7 jours
0,0 (0 commentaires)
0,0
0,0

À propos du client

Drapeau de INDIA
Nagercoil, India
0,0
0
Membre depuis avr. 8, 2024

Vérification du client

Merci ! Nous vous avons envoyé un lien par e-mail afin de réclamer votre crédit gratuit.
Une erreur a eu lieu lors de l'envoi de votre e-mail. Veuillez réessayer.
Utilisateurs enregistrés Total des travaux publiés
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Chargement de l'aperçu
Permission donnée pour la géolocalisation.
Votre session de connexion a expiré et vous avez été déconnecté. Veuillez vous connecter à nouveau.