Software Engineer I
Budget $35-50 USD / heure
Develop and validate solution architecture to support business requirements
Develop Spark applications to read transaction data and process business rules to report errors and transaction summary
Load and transform large sets of structured and semi structured.
Read data from Kafka and process data using Spark.
Adopt innovative architectural approaches to leverage in-house data integration capabilities.
Analyze existing processes and prepare functional and requirements documents.
Develop multiple spark streaming and core jobs with Kafka as a data pipe-line system.
Hive external tables on HBase using Insert Overwrite with S3 as data storage.
Troubleshoot developed Spark jobs.
Manage and review Yarn Application Logs, Spark Event Logs and Metrics sink CSV files.
Improve the performance and optimization of the existing jobs in Spark.
Develop solutions by utilizing commercial and open source software including Minifi and Nifi to interface big data and relational solutions.
16 freelances font une offre moyenne de 45 $/heure pour ce travail
Hello. I have a masters degree in AI and have worked with Hadoop, Spark, YARN, ... on a lot of projects. I can share some demos if you are interested. Thanks, Helmot
Hi, I have readymade video streaming software. If you want to get the demo. I will give a demo. I have been working for the last 10+ years in development. Please have a look at my [login to view URL] Skills and Experience Plus
Hi, I have 9 years of experience and working on hadoop, spark, Kafka, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud Plus
Hello! I'd like to optimize information aggregation. I'm familiar with python and theory of probabilities. I'll do the job blazingly fast. Please, give me a try!
Hello, hope you are well there, I've seen your requirements and I am interested in this. I'm ready to work from now on your app. I'm a full-stack developer. I've 7+ years of working experience in Mobile Apps Developm Plus
Hi there, I have quite some experience in most of the big data tech out there (Hadoop, Spark, Kafka, Cassandra, ...), since I have been specializing on Data Management, Data Consolidation etc. for quite a long time, no Plus
Hello, I read your project description and I think I'm fully qualified for this position. I'm a Software Developer with 5 years experience in technologies like: Java, Python, Spring, Hibernate, Redis, Gradle, Docker, Plus
Have the experience of over 5 years in developing Big data pipelines over multiple technologies, hold certification in Hortonworks and Cloudera platforms. Currently employed full time as analytics application engineer Plus