Our client is looking for a Data Engineer to join them on an exciting project in St Denis, France.
Context of the mission
The Data Engineer will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
The ideal candidate is an experienced data pipeline builder who enjoys optimizing data systems and building them from the ground up.
The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
Resource must be self-directed and comfortable supporting the data needs of multiple teams, systems and products and able to learn cutting edge technologies on job.
Mission objectives and tasks
The profile sought will be particularly involved in the following day to day activities:
Develop and maintain large scale data processing system
Ensure ETL pipelines constructed will support high volume data streams
Discover opportunities for data acquisition, storage and querying in a performant way
Develop data set processes for data modeling, mining and production
Employ variety of languages tools (awareness to opensource apache data related frameworks is a must have competence)
Able to understand, customize and maintain opensource projects and contribute to development of new state of the art frameworks
Experience in DevOps (based on docker and Kubernetes)
Source code (application components and unit tests)
Experience with big data tools: Hadoop, Spark, Kafka, NoSQL DBs, NiFi, Beam, Zookeeper …
Construct data ETL pipelines that are scalable and fault tolerant based on big data technologies
Knowledge of teamwork on a dev platform
Agile approach (SCRUM, SAFE), DevOps
Inference implementation based on deep learming models with frameworks like Apache MXNet, Tensorflow, Keras
Fluency in English and French essential
|Job Category||Data Engineer|