Build an EL pipeline in Azure

Job Description:

We need a freelance Azure data engineer to develop a data pipeline for a large hotel chain.

The project would start with a proof-of-concept where the freelancer will develop the first few steps of the pipeline. If we evaluate that the collaboration worked well, we would then continue the partnership to develop the rest of the pipeline.

The full project scope is visualised in the picture attached

The first steps to be developed in this first iteration are:

- With a user and environment provided by us, deploy Azure Data Factory and Azure Blob Storage resources, requesting any necessary permissions for your user so we can provide them

- Using Azure Data Factory, deploy a process that runs on a daily basis to extract CSV files from an SFTP and load them into Azure Blob Storage as parquet files (SFTP credentials and data will be provided by us)

- Make sure to detail a naming convention for the parquet files and a folder structure for Azure Blob Storage

- All deployments must be done via infrastructure-as-code, so they can be redeployed in Production later

- All script code must be in Python whenever it is available

Your response to this proposal should include:

- The description of any additional steps you see as necessary to complete the goal of this iteration

- Any questions you may have

- A quote, ideally in terms of hours plus hourly rate

We’d like to initiate the project as soon as possible.

Thank you!

Compétences : Microsoft Azure, Data Engineer, Python, Data Architecture, Data Integration

Concernant le client :
( 0 commentaires ) Barcelona, Spain

Nº du projet : #36251247

25 freelances font une offre moyenne de 29 €/heure pour ce travail


Dear Employer, Many Thanks for giving us a chance to submit a proposal on your project. As mentioned in the project scope you can hire our experience Azure data engineer for developing the data pipeline for large hotel Plus

€20 EUR / heure
(21 Commentaires)

Hello. Experienced Full Stack devops developer here with 9+ years of hands-on experience in azure, frontend and backend development and have developed numerous pipeline in azure. I am confident that I am perfect for th Plus

€36 EUR / heure
(16 Commentaires)

Hey there, I have 4 years of working experience in web technologies and I have a strong working knowledge of every possible framework which is in the market. In terms of client-end I know: Microsoft Azure, Data Archit Plus

€22 EUR / heure
(38 Commentaires)

Hi there,I'm biddin on your project "Build an EL pipeline in Azure" I have read your project description and i'm an expert in Python and machine learning therefore i can do this project for you perfectly.I still have a Plus

€45 EUR / heure
(27 Commentaires)

Hello, How are you? I am a senior data engineer with extensive experience in Azure development, Python and data integration. I have developed multiple EL pipelines on Azure and have good understanding of Blob Storage Plus

€36 EUR / heure
(3 Commentaires)

Hello, Warm Greetings! I am pretty sure I can produce high-quality and perfect results for your project. By using Python, I used to make AI engines, BOT, Web Scraping Tools, and so on. PHP and Python are my majors, so Plus

€18 EUR / heure
(9 Commentaires)

Hello I am a professional python developer. My main specializations are automation, web scrapers and bots development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price Plus

€18 EUR / heure
(8 Commentaires)

Experienced data Engineer in azure with expertise in azure data factory, adls and certified databricks Spark Developer

€30 EUR / heure
(10 Commentaires)

Hello greetings, After going through your project description, I feel confident and excited to work on this project for you. But I have some important things and queries to clear out. Can you please leave a message on Plus

€27 EUR / heure
(5 Commentaires)

Hi, I am excited to apply for the Azure Data Engineer position for the hotel chain data pipeline project. As an experienced Azure data engineer, I am confident in my ability to develop a data pipeline and deploy it us Plus

€30 EUR / heure
(6 Commentaires)

=======Python Expert=========== Hi there, Here you can get a good partner. I always activate. I can show you demo. I have read your project description and it seems I can complete this project satisfying your requirem Plus

€27 EUR / heure
(0 Commentaires)

Oh, My best brand Tech. It's like shoes that match my skill area. could you help me. I hope to 'buy' it. Pls contact me.

€27 EUR / heure
(0 Commentaires)

Hello, I'm a Senior Data Engineer with 17+ years of IT experience. I've done many projects within Azure and AWS in several companies and different types of businesses. I'd like to add some steps for setting up a CI/CD Plus

€27 EUR / heure
(0 Commentaires)

Hi I am a Machine Learning Engineer. I am expert in python. I have worked in Microsoft Azure and confident that I can do this project for you. Your project requirements are clear at this stage. I need to do some resea Plus

€24 EUR / heure
(1 Évaluation)

11 years of IT experience- Python, Java, C++, Go, RestAPI, NodeJS, Golang, SQL, OpenSQL NoSQL, SD-WAN, Web Application Firewall, JavaScript, AWS, Azure, DevOps, Continuous Integration, Machine Learning, Artificial Inte Plus

€40 EUR / heure
(0 Commentaires)

I am the best candidate for this project as I am having 5 years of IT Experience in Azure Data Engineering and have undertaken many project where i worked on Azure Data Factory and Azure Blob Storage resources to extra Plus

€30 EUR / heure
(0 Commentaires)

Hello there, I am writing in response to your job posting, seeking a Python backend developer expert with experience in crypto bots. I am confident that I have the necessary skills and experience to meet your project r Plus

€18 EUR / heure
(0 Commentaires)

Hi, I have extensive experience in developing ETL pipelines using azure tech. My specialty is that I will build dynamic pipelines which can be used for multiple purposes. I will provide you with detailed documentat Plus

€27 EUR / heure
(0 Commentaires)

Hi there,I'm biddin on your project "Build an EL pipeline in Azure" I have gone though your project description and mysel an expert in Design and Develop end to end solution with azure data and integration space, A Plus

€65 EUR / heure
(0 Commentaires)