Descriptif de la mission :

Key responsibilities :

• Implementing new or modified functionality on the data platform and building data pipelines on this data platform

• Working with other data engineers, a functional analyst, solution architect, technical architect, and QA engineer. Together, they form an agile team.

• Relying on your technical knowledge and skills in Confluent Data Platform, Python, Airflow, NIFI, etc., to build functionality and data pipelines.

• Programming and delivering working code

• Consulting with colleagues

• Validating solutions and reviewing colleagues' code, following up on operational issues

• Writing documentation

• Evaluating and estimating user stories.

Expected skills and experience :
Must have

• Knowledge of DBT

• Knowledge of Python

• Knowledge of Airflow (or a similar orchestration tool)

• Knowledge of an API builder (FastAPI, Flask, ...)

Is a plus

• Knowledge of Spark and PySpark

• Knowledge of Cloudera Data Platform (installed on-premise)

• Knowledge of Spark Streaming

• Knowledge of Kafka and Kafka streams

• Knowledge of JDK languages (Java, Scala, Groovy, ...)

• Knowledge of JavaScript (Angular, d3, ...)

• Knowledge of event processing and JSON

• Knowledge of Apache AVRO & Parquet, Apache Iceberg and Apache Impala

• Knowledge of Vault Speed

• Knowledge of SingleStore

Languages :

• Dutch - Fluent - Must have

• English - Professional - Must have