Elasticsearch hadoopemplois
Nous recherchons un collaborateur avec une personnalité qui se retrouvera dans notre philosophie d'entreprise; dynamique et avec un esprit entreprene...ceux-ci étaient les vôtres. • Au moins 3 ans d'expérience(s) professionnelle(s) en tant que développeur web ou 2 ans d'expérience et un diplôme en informatique • Compétences dans les technologies; Node.js // Vue.js • Bonnes connaissances en PHP/Symfony et Twig sont nécessaires • Capacité à créer entièrement une applications web • Maîtrise des bases de données MongoDB et MySQL • Connaissances en elasticsearch • Au moins une expérience dans la création d'API REST &b...
...dans des contextes de fortes volumétries. De formation BAC +5, vous justifiez d'une expérience de > 5 ans sur des projets SI avec de forts impacts métier. Vous justifiez d'une expérience significative en intégration de données complexes, depuis les phases de recueil de besoin, jusqu’à la conception et la réalisation. Vous avez une expérience sur les langages de la data : Python, Java, SQL, Elasticsearch ainsi que sur les outils de collectes ETL (Talend, Datastage, Informatica...) et de traitement de flux de données : Kinesis Kafka, Spark... Vous avez des connaissances dans les solutions Cloud : AWS, Azure, Google et des outils de déploiement d’infrastructure du type « ...
Nous recherchons quelqu'un capable d'intervenir sur une archi cloud AWS sous kubernetes. Mis en place et maintenance de rancher Gestions de : - droits IAM, - Scales automatiques des nodes k8s en fonction de la charge. - Gestions des ingress avec générations de Certificats automatiq...recherchons quelqu'un capable d'intervenir sur une archi cloud AWS sous kubernetes. Mis en place et maintenance de rancher Gestions de : - droits IAM, - Scales automatiques des nodes k8s en fonction de la charge. - Gestions des ingress avec générations de Certificats automatique. - Monitoring/alerte sur l'infra en particulier sur des outils comme kafka, ElasticSearch, couchbase, spark ... Des connaissances sur les archis : kafka, ElasticSe...
...et ne nous permet pas de répondre assez rapidement aux requêtes que l’on envoie dessus. L’objectif de la mission est que 90% des requêtes de l’API se fassent en moins de 300ms. Les technologies que nous utilisons sont : Symphony 3 et MySQL Nous avons besoin d’un freelance qui a une excellente connaissance de ces technos. Pour les requêtes à la base de données nous utilisons également ElasticSearch et nous allons bientôt migrer vers Neo4J. Avoir une connaissance sur ces 2 technos est un vrai plus pour la mission. Le freelance rejoindra une équipe de 4 développeurs back-end. Ils seront là pour répondre aux questions du freelance et de le faire monter en connaissance su...
Projet : Projet de développement de framework au sein de la Digitale Factory d'Airbus. Ce framework permet à plusieurs applications d'être lancées en mode local ou cloud. La mission consiste à apporter une expertise en termes de performance, et de support niveau 3 de l'application. Contexte : - Equipe agil...mode local ou cloud. La mission consiste à apporter une expertise en termes de performance, et de support niveau 3 de l'application. Contexte : - Equipe agile < 10 personnes comprenant un product owner - Sprints de 4 semaines - Remplacement d'une personne en partance => passation à prévoir - Date de démarrage visée : début juillet 2018 - Principales technologies utilisée...
Bonjour, Je recherche un haut profil à la fois architecte et intégrateur Big Data pour un projet ambitieux de mise en place d'une solution Data prep, viz et analytique au sein d'un grand ministère. La suite logicielle inclut DSS de Dataiku, Tableau Software, Vertica, Postgis, ElasticSearch. Le branchement d'une architecture Hadoop est prévu. La personne participera aux travaux de conception de l'architecture applicative avec les personnels du ministère et devra proposer une architecture physique en accord avec cette conception. La sécurité des données et la gestion des droits d'accès sont centrales. Des compétences Docker sont par ailleurs requises.
Bonour, Nous sommes une eune start up et nous recherchons un Développeur Full-Stack pour le front-office et une partie du back-office Technologies demandées : très bonne maîtrise du framework Symfony 3 / BDD PostgreSQL ou MariaDB ou MongoDB / UX-UI Responsive Design (HTML5/CSS3/JS, Twig, AngularJS ou ReactJS...Full-Stack pour le front-office et une partie du back-office Technologies demandées : très bonne maîtrise du framework Symfony 3 / BDD PostgreSQL ou MariaDB ou MongoDB / UX-UI Responsive Design (HTML5/CSS3/JS, Twig, AngularJS ou ReactJS) Les + : capacités d'intégrateur au niveau global de l'application (utilisation d'API en parallèle) ainsi que la connaissance supplémentaire de PYHON ...
Nous recherchons un expert Elasticsearch pour une mission ASAP.
je cherche un développeur big data qui a des compétences en linux( script shell) qui est a l'aise avec l’écosystème hadoop pour des missions très interessantes
Linux Autre ou pas sûr Show data on qlik view or Tableau from HDFS (hadoop)
Mission: - Développement d'un outil de validation utilisateurs - Développement d'un système d'envoi de sms - Développement d'un outil de validation d'annonces - Développement d'un backoffice affichant les analyses de données existantes Compétences nécessaires: - Php / MySQL / Framewo...de validation utilisateurs - Développement d'un système d'envoi de sms - Développement d'un outil de validation d'annonces - Développement d'un backoffice affichant les analyses de données existantes Compétences nécessaires: - Php / MySQL / Framework Symfony / Apache - Api Rest - Installation / Configuration serveur / VPN ...
Mettre en ligne un site PHP (éventuellement Elasticsearch) pour gérer des citations littéraires avec interaction des internautes... Destiné éventuellement à devenir un réseau social de la pensée
Bonjour, Nous montons une plateforme de services et de big data dans le jeu vidéo à vocation internationale avec un périmètre multilingue de départ. Nous avons besoin d'un freelance pour nous aider à développer notre plateforme, nous avons une infra AWS avec bdd Cassandra. Systèmes de batchs de données en masse multilingue, authentification, relat...développer notre plateforme, nous avons une infra AWS avec bdd Cassandra. Systèmes de batchs de données en masse multilingue, authentification, relations complexes entre bases... Idéalement : Au moins 3/4ans d'xp Java 8 : maîtrise des lambdas, dates, ... Plateforme localisées Spring : Spring core, Spring MVC, Spring da...
Traduire en java du pseudo code en utilisant le framework Hadoop pour le faire tourner sur Amazone EMR.
Ce projet consiste à développer un code source JEE pour la visualisation des données stockées dans ElasticSearch en temps réel(qui est installé sur la machine virtuelle Redhat). -Les données sont des lignes de fichiers logs qui sont déja traitées et mis sous format JSON et qui sont stockées dans ElasticSearch. -la visualisation des statistiques (pie,bar,table) n'est pas exigée. -Pour mieux comprendre,veuillez consulter le document attaché.
I am in need of a seasoned DevOps engineer who has hands-on experience in working with Elasticsearch and Grafana. Although I have already set up and configured both systems, I need to fetch key metrics from an on-premise Windows machine and feed them into Elasticsearch. Key Tasks: - Fetch specific metrics: I need the DevOps engineer to configure the system in a way that it can fetch CPU usage, memory usage, and disk usage metrics from the on-premise Windows machine. - System optimization: While I have already set up the system, I am looking for someone who can optimize the performance of the system and make it more efficient. Ideal Skills: - Proficient in Elasticsearch and Grafana: The freelancer should have proven experience in working with these systems. - Window...
Looking for an android developer Java,Kotlin,JSP, Servlets, MQ series, Hibernate, Python, Microservices, Swings, WebSphere-Portals, HTML5, Bootstrap, JavaScript, Bigdata, Linux Frameworks Android Mobile App Development, Spring boot, Struts, Hadoop This will be ongoing
...with SQL and NoSQL databases. Proficiency in software design patterns and principles. Experience with version control tools such as Git. Good understanding of Agile methodologies and a collaborative mindset. Excellent problem- solving and analytical skills. Experience in unit testing (eg. JUnit/ Mockito). Experience in cloud- based environments such as AWS or Azure. Experience with Kafka and Elasticsearch. Experience : 5+ years only...
We are looking for an expert in MongoDB + ElasticSearch infrastructure. We are looking to build from the ground up, in the cloud (AWS), a very complex infra with 500M Person object, 50M Company, and dozens more challenges. The dataset will be always evoling, with hundreds of thousands of updates a day on every object etc. Please see the screenshot that explain the technical setup wanted: []() The final goal is to have a full blown searchable database, with list feature, and respond time always staying below a clean 100ms. The main DB will be Mongo, that needs to be optimized (shard, cluster config, index...) properly. On top of that DB will live Elastisearch, which will require a near real-time
...ideal freelancer for this project should have proven experience in time series forecasting, Python programming, and developing interactive dashboards. A solid grasp of data visualization principles would be a plus. The output should be in a form of a python file with 4 models above and related dynamic visualizations. The text preprocessing is required and can be done in any necessary technologies (HADOOP/SPARK,NOSQL/SQL databases) - screenshots of the bash code are required....
I'm seeking intermediate level big data engineers who can tackle essential tasks within the d...capable of combining data from various sources to create a cohesive dataset. - Develop data visualization: The engineers will need to create meaningful and understandable visual representations of the analyzed data. The necessary skills for this role are: - Proficient in Python: The candidate should be well-versed in Python programming language to work with our system. - Knowledge of Hadoop: Experience with Hadoop is a must for this position to handle the data integration and data storage tasks. - Knowledge of Kafka Prior experience in big data engineering and a good understanding of data engineering principles will be vital. Please note that this project suits an intermedia...
Looking to implement an Elasticsearch Cluster primarily for improved data management and search ability for my app. The system must cater to handling and analyzing large amounts of structured data. Ideal Skills and Experience: - Strong Elasticsearch expertise - The system should integrate efficiently with both Logstash and MySQL. - Previous experience in cluster management - Proficient in tweaking and optimizing performance of cluster and data management
SCOPE OF SERVICE Support Service for cases of massive crashes of the ElasticSearch Search Platform (NodeJs + ElasticSearch). It must cover critical outages of Search Services outside of business hours, weekends and holidays (see details). The service must also include preventive analysis that will allow us to establish whether the platform is “healthy” in order to reduce these types of events. DETAIL OF EXTENDED SUPPORT The Extended Support service will have the following scope: • Support Hours: Monday to Friday from 18:00 to 23:00 and Saturdays, Sundays and Holidays from 9:00 to 23:00. The service will cover the resolution of critical incidents (service outage) in this time slot. • The committed SLA, for this time slot, will be 3 hours from the repor...
need someone to assist with elastic search queries. i need someone who has worked with elasticsearch queries.
I'm seeking a professional to help migrate my existing Grafana 8 alerts to Grafana 10. Your proposal should include detailed project plans and timelines for completing the following tasks: - Alert Configuration: This includes setting up and configuring alerts based on specific metrics, thresholds and conditions. - Al...the necessary alert notifications to ensure they are received by the relevant parties promptly and efficiently. Ideal candidates should have: - Extensive experience with Grafana and its alerting system - A proven track record of successful alert migration projects - Excellent communication skills and a proactive approach to problem-solving. While not mandatory, experience with Prometheus, Elasticsearch, and MySQL would be a plus given the data sources we'...
...speed when doing site search, using finder plugin and when navigating the subcategories on layered navigation. E.g. click “Shop Parts” , then click one of the menus on the left categories such as “Braking System”. Paging through category pages also same speed issues. a. I’ve tried enabling Ajax and still same issue with performance. b. Site search is using Elasticsearch but still very slow c. Need to aim for 1-2 seconds load time. 3 . Magento Checkout: a. Fix bug on Checkout page regarding address. “Error occurred” when we add an address in Magento admin, then customer tries to use the account to make a purchase. b. Implement Google address auto-complete. c. Add an “Order Notes/ Purchase Order Number” field in...
Seeking a skilled developer to optimize and enhance the architecture of our existing web scraper application. The application is currently built using NestJS and PostgreDB, and we are looking to scale it up and leverage cloud functionality for improved p...error handling, rate limiting, and IP rotation. - Strong problem-solving skills and ability to optimize application performance. - Excellent communication and collaboration skills. Nice to have: - Experience with PostgreDB and database optimization techniques. - Knowledge of additional programming languages like Python or Java. - Familiarity with data processing frameworks like Apache Spark or Hadoop. - Experience with data visualization and reporting tools. Potential for ongoing collaboration based on performance and future req...
...Master's degree with 10 – 12 years related experience, of which at least 7 + years in development, 4+ years of product engineering experience Experience in Analytics and Business Intelligence is a plus Strong design and coding experience Expertise with the Go Lang platform or higher Experience with integration, data handling technologies and other open source frameworks such as Spring, Kafka, Elasticsearch, Solr etc Experience in NLP, Data Science and Text analysis is a plus. Good Knowledge for Python and GoLang. Experience in building event driven cloud native micro services architectures Experience in building ELK stack Hands on experience in Mongo, Redis, Cassendra, Neo4j, Postgres is a plus Experience with massive-scale performance and scalability engine...
I need someone to create the dag and trigger it I am working on a migration project from hadoop to bigquery....more details will be shared via chat
I'm looking for a Java springboot expert who can seamlessly add additional fields to an existing API. The exact fields to be added are not defined at this stage, giving the successful freelancer the opportunity to demonstrate innovation and flexibility. The API interface is built using elasticsearch. Ideal Skills and Experience: • Proven experience in Java Springboot, preferably with elasticsearch. • Excellent problem-solving abilities. • Strong understanding of API structure and functionality. Application Instructions: While exact past experience and detailed project proposals are not necessary for this job, any relevant work or skills showcasing your proficiency in Java Springboot and APIs would be beneficial in your application. Java Springboot Ver...
Install Elasticsearch on Centos server. Elasticsearch is installed but there is error as in the pic. Elastic Service will not start. Access to server via Anydesk only !
I'm seeking a skilled developer to build an advanced classifieds website using Wordpress, Elasticsearch, and a suitable theme. The features I want incorporated include: * Advanced search options - Users should be able to easily search, filter, and sort listings. * User registration and login functionalities. * Ad posting and management capability - Users should have the ability to post and manage their ads effectively. The classifieds on the site will be categorized mainly into: * Real Estate. * Jobs. * Vehicles. The ideal candidate for this job will have previous experience with Wordpress and Elasticsearch, as well as creating similar classifieds-type websites.
I am seeking a skilled data engineering trainer, speed in using Hadoop, Apache Spark, and SQL is paramount. Your expertise will guide me through nuanced uses of these technologies, with a particular focus on data migration. Key Requirements: - Proficiency in Hadoop, Apache Spark, and SQL - More than 10 hours availability weekly - Proven experience in real-world data migration projects Ideal candidates should have a flair for explaining complex concepts in simple language. This engagement will focus on moving data from diverse sources into a data warehouse, thereby making it readily available for business intelligence functions.
I'm in need of a proficient professional versed in Java Hadoop cluster. Please place your bids immediately. $20 for this project
I am in urgent need of Hadoop/Spark developer who is proficient in both Scala and Python for a data processing task. I have a huge volume of unstructured data that needs to be processed and analyzed swiftly and accurately. Key Project Responsibilities: - Scrubbing and cleaning the unstructured data to detect and correct errors. - Designing algorithms using Scala and Python to process data in Hadoop/Spark. - Ensuring effective data processing and overall system performance. The perfect fit for this role is a professional who has: - Expertise in Hadoop and Spark frameworks. - Proven experience in processing unstructured data. - Proficient coding skills in both Scala and Python. - Deep understanding of data structures and algorithms. - Familiarity with data ...
...programming expert, proficient in either Ruby or Python, with intermediate-level ElasticSearch querying capabilities. The primary task involves intelligently executing aggregations and nested queries in ElasticSearch, extracting data, in JSON format, and then transposing it into Excel or CSV format. I'm open to whichever format you are more comfortable with, so long as it is either of the two mentioned. In addition to this, having familiarity with job automation via GitHub is critical for this project role. This background should include understanding how to automate and schedule tasks to regularly extract, convert, and save this data. Ideal Skills: - Proficiency in Ruby or Python - Intermediate level ElasticSearch querying - Experience with JSON to Excel/CS...
I'm in need of a technical expert who can design a system for automatic content category of news articles based on their titles. This unique project's central purpose lies in enhancing and streamlining the way my information gets organized. Here's a detailed look at what the project involves: - Designing a system cap...languages suitable for text categorization, like Python or R. - Excellent problem-solving abilities to face potential challenges in the development process. I am looking forward to embarking on this journey towards more automated and efficient content organization with a skilled freelancer. Apply now, and let's start this exciting journey to enhance content categorization. We are open to use elasticsearch for the text classification or any ot...
...optimize front-end web applications. - Develop user interfaces with a focus on user experience. - Integral part of the development process, from ideation to deployment. Skills & Experience: - Expert in React and modern front-end development practices - 5+ years of software development experience in the following languages and/or technologies: Python, - JS, React, Angular, Java, C#, MySQL, Elasticsearch, or equivalent - Strong communication skills are essential for collaboration with leads and stakeholders - Fluent in software fundamentals including software design, algorithm development, data structures, code modularity, and maintainability - Strong experience with Azure cloud services, Azure DevOps, and CI/CD pipelines PS: Please attach your resume and live project or por...
...and natural language processing 3. Strong proficiency in programming languages such as Python, Java, and C++, as well as web development frameworks like Node.js and React 4. Experience with cloud computing platforms such as AWS, Azure, or Google Cloud, and containerization technologies like Docker and Kubernetes 5. Familiarity with data engineering and analytics tools and techniques, such as Hadoop, Spark, and SQL 6. Excellent problem-solving and analytical skills, with the ability to break down complex technical challenges into manageable components and solutions 7. Strong project management and communication skills, with the ability to collaborate effectively with both technical and non-technical stakeholders 8. Familiarity with agile development methodologies and best pr...
I'm experiencing some issues with my Elasticsearch setup and am needing a knowledgeable Linux network administrator to assist with troubleshooting. I'm unsure exactly what the problem is as I've been dealing with several potential symptoms. - Potential Elasticsearch issue symptoms - Connection errors; Slow performance; Data indexing errors The problems with Elasticsearch could be affecting us in several ways: - Slowing down search queries; Data inconsistency; High resource usage If you wish to apply, it's advisable that you - Showcase your past work - Relay your experience with similar projects - Provide a detailed project proposal Realize that I'm looking for a quick, effective resolution. If you think you can help, ...
We are looking for an Informatica BDM developer with 7+ yrs of experience, who can support us for 8 hours in a day from Mon - Friday. Title : Informatica BDM Developer Experience : 5 + Yrs 100%Remote Contract : Long term Timings: 10:30 am - 07:30 pm IST Required Skills: Informatica Data Engineering, DIS and MAS • Databricks, Hadoop • Relational SQL and NoSQL databases, including some of the following: Azure Synapse/SQL DW and SQL Database, SQL Server and Oracle • Core cloud services from at least one of the major providers in the market (Azure, AWS, Google) • Agile Methodologies, such as SCRUM • Task tracking tools, such as TFS and JIRA
I'm experiencing some issues with my Elasticsearch setup and am needing a knowledgeable Linux network administrator to assist with troubleshooting. I'm unsure exactly what the problem is as I've been dealing with several potential symptoms. - Potential Elasticsearch issue symptoms - Connection errors; Slow performance; Data indexing errors The problems with Elasticsearch could be affecting us in several ways: - Slowing down search queries; Data inconsistency; High resource usage If you wish to apply, it's advisable that you - Showcase your past work - Relay your experience with similar projects - Provide a detailed project proposal Realize that I'm looking for a quick, effective resolution. If you think you can help, ...
...which will include parameters such as patient age ranges, geographical regions, social conditions, and specific types of cardiovascular diseases. Key responsibilities: - Process distributed data using Hadoop/MapReduce or Apache Spark - Developing an RNN model (preferably Python) - Analyzing the complex CSV data (5000+ records) - Identifying and predicting future trends based on age, region, types of diseases and other factors - Properly visualizing results in digestible diagrams Ideal candidates should have: - Experience in data analysis with Python - Solid understanding of Hadoop/MapReduce or Apache Spark - Proven ability in working with Recurrent Neural Networks - Excellent visualization skills to represent complex data in static or dynamic dashboards - Experien...
I am looking for an experienced Senior Data Engineer for interview training. Your primary responsibility would be data cleaning and preprocessing, design and optimize database and implem...preprocessing, design and optimize database and implement ETL processes. Key responsibilities include: - Clean and preprocess data to ensure its quality and efficiency. - Design and optimize databases, aiming for both flexibility and speed. - Implement ETL (Extract, Transform, Load) processes to facilitate the effective and secure moving of data. Skills and Experience: - Proficient in Python, SQL, and Hadoop. - Expertise in handling medium-sized databases (1GB-1TB). - Proven track record in ETL processes handling. Your expertise in these areas will be crucial to the successful completion of thi...
For an ongoing project, I'm in need of a skilled Laravel developer who has experience with database integration and ElasticSearch. Key Requirements: - Proficiency in Laravel, focusing largely on its user authentication features. - Real experience with ElasticSearch integration, especially with user profile data. We need this for real-time user data indexing. - Expertise in handling user profiles data. You'll be responsible for implementing systems that effectively store and manage this kind of data. - A proven track record in back-end development, specifically with database design and integration. This role is certainly challenging and would suit someone who thrives in a fast-paced environment. If this sounds like you, don't hesitate to bid. Looking forward...
I have encountered a problem with my Hadoop project and need assistance. My system is showing ": HADOOP_HOME and are unset", and I am not certain if I've set the HADOOP_HOME and variables correctly. This happens creating a pipeline release in devops. In this project, I am looking for someone who: - Has extensive knowledge about Hadoop and its environment variables - Can determine whether I have set the HADOOP_HOME and variables correctly and resolve any issues regarding the same - Able to figure out the version of Hadoop installed on my system and solve compatibility issues if any I will pay for the solution immediately.
... Install PHP 7.2 to 8 - ONE site uses Magento 1.9 - uses PHP 7.2 - TWO Sites are Magento 2.4.3 - uses PHP 7.4 - ONE Site is Magento 2.4.7p - uses PHP 8 4. Install and configure Modsecurity & CSF firewalls 5. Change port number for added security - enable two factor verification 6. Install and configure libosodium correctly for all cpanels 7. Install and configure Elasticsearch 7 8. Install and configure RabbitMQ8. 9. Install and Configure Litespeed for 4 sites. 10. Optimize Server - Increase speed for Magento sites which load painfully slow. :: All sites have E ratings - horrible. Se...
...on GCP. Create GCP and Install Magento 2 Open Source - see details See list below - Setup from scratch a Google Cloud Platform VM all the way to installation of the Magento 2 Open Source - that's it. I will deal with front end development separately. 1. Operating System: Ubuntu 22.04.4 LTS (Jammy Jellyfish) 2. LAMP Stack: Apache 2.4.55, MySQL 8.0.33 or the newest version, PHP 8.2.3 3. Elasticsearch 8.7.1 4. APIs: REST API, GraphQL API, Helcim API 5. Google Cloud Platform Setup: GCP Project, Compute Engine (VMs), Cloud Storage, Cloud SQL (Managed MySQL), Additional GCP Services (Optional): Cloud Load Balancing, Cloud CDN, Cloud DNS 6. Magento Installation: Download and Setup, Web Server Configuration, Database Setup, Magento Installer Ideal skills: - Previous experien...
...and security updates for several years. Ubuntu LAMP Stack: Apache 2.4.55: The latest stable release of the Apache web server. Apache MySQL 8.0.33 or the newest version of MySQL PHP 8.2.3: OR. The most current stable release of PHP. PHP Optional Technologies: Redis 7.0.12: The latest release of the popular in-memory cache. Redis Elasticsearch 8.7.1: The most recent version of this powerful search engine. Elasticsearch APIs REST API: Understanding of RESTful APIs as utilized in Magento's architecture for customizations. GraphQL API: Familiarity with Magento's GraphQL API for data retrieval. Helcim API: Knowledge of Helcim's API as per the latest specifications. Helcim API Google Cloud Platform Setup GCP Project: Set...
