Role - Data Engineer

Location - Brussels, Belgium (Hybrid)

Type - Permanent

Job Description:

Responsibilities

Design, develop, and maintain data pipelines and architectures that enable fast data transformation and processing.
Work with cross-functional teams to identify and prioritize data transformation requirements.
Ensure data quality, integrity, and security throughout the data transformation process.
Collaborate with data scientists and analysts to develop and optimize data models and algorithms.
Optimize data pipeline performance, scalability, and reliability.
Develop and maintain technical documentation for data pipelines and architectures.

Qualifications

Bachelor's degree in computer science, Engineering, or a related field.
Language – Pyspark and Java
Data modelling , Data Ingestion , Data Warehouse
Real time Service - Kafka Spark Steaming , flink
Disturbed processing – Hadoop , HDFS , Cloudera , Hive
At least 5 years of experience in data engineering, software development, or related field.
Experience in working on Azure platform
Experience with data processing technologies such as Apache Beam, Apache Spark, or similar.
Experience with cloud-based data platforms such as Google Cloud, Amazon Web Services, or Microsoft Azure.
Experience with containerization technologies

Familiarity with machine learning and data science concepts.