The practice of designing and building systems for collecting, storing, and analyzing data at scale. It is a broad field with applications in just about every industry. Organizations have the ability to collect massive amounts of data, and they need the right people and technology to ensure it is in a highly usable state by the time it reaches data scientists and analysts.


Often deal with the unknown by using more advanced data techniques to make predictions about the future. They might automate their own machine learning algorithms or design predictive modeling processes that can handle both structured and unstructured data. This role is generally considered a more advanced version of a data analyst. Some day-to-day tasks might include: Gathering, cleaning, and processing raw data; Designing predictive models and machine learning algorithms to mine big data sets; Developing tools and processes to monitor and analyze data accuracy; Building data visualization tools, dashboards, and reports; Writing programs to automate data collection and processing

Sur 1,097 commentaires, les clients ont évalué nos Data Engineers 4.92 sur 5 étoiles.
Embaucher des Data Engineers


Mes recherches récentes
Filtrer par :
    État du travail
    4 travaux trouvés au tarif de EUR

    - tutoring for the dp203 certification - learn about proper data engineering in the cloud - experience in the data engineering azure environment - help understanding the tricky questions of the test - i use python - we can agree on a number of sessions and I rebook after the first round

    €152 (Avg Bid)
    €152 Offre moyenne
    7 offres

    Design an architecture for a democratized data platform in AWS with a feature to bring your own compute for data transformation. The architecture should include Extraction, Transformation and Load jobs independent of each other. It should also have a solution for a data access federation. The project deliverable is expected as follows, 1) an Architecture diagram 2) a technical design document explaining each component of the proposed architecture Use cases: 1) The data platform design is such that we are able to provide our own EMR cluster for the transformations jobs.. 2) The extract jobs and their orchestration is separated from the transformation and load jobs. 3) Identify a modern data store for analytical use cases 4) It should be easy to onboard new Extraction / Transformation and ...

    €505 (Avg Bid)
    €505 Offre moyenne
    11 offres

    We need Data Engineer with Azure cloud experience to work for 2 hrs a day remotely. We will give 25 to 30k per month. Should work on all these technologies with 5+ yrs experience. 1 to 3 or more years of experience with Snowflake/synapse, Databricks, Kafka, eventHub, Spark.

    €317 (Avg Bid)
    €317 Offre moyenne
    8 offres

    Need to automate data quality redundant task in datawarehouse environment. To do batch, table to table, validation. Looking for framework to keep it separate from data pipelines. Can discuss more.

    €20 / hr (Avg Bid)
    €20 / hr Offre moyenne
    17 offres

    Articles recommandés juste pour vous

    Communication is the key to a successful project that generates great reviews.
    3 MIN READ
    Learn how to thrive and succeed as a digital nomad.
    3 MIN READ
    Freelancing while studying: make extra money & build your experience flexibly.
    4 MIN READ