Data Engineer

As a Data Engineer, you will be the architect and owner of our crucial data pipelines. You play a central role in our ambition to process billions of records daily and elevate our data infrastructure. You are responsible for the entire process: from data ingestion to delivering final insights.

Key Responsibilities:

• Design & Build: Design, build, and deploy new end-to-end data pipelines from scratch to integrate diverse and high-volume data sources.

• Massive Processing: Write efficient and scalable processing logic using (Py)Spark (in AWS Glue) to process, clean, and transform billions of records daily.

• Infrastructure as Code (IaC): Manage and define the entire data infrastructure (AWS Glue jobs, S3 buckets, Lambda functions) as code using Terraform. This forms the core of your "ownership."

• Quality & Performance: Be responsible for the quality, monitoring, and performance of the pipelines you build, ensuring data lands accurately and on time in our Data Lakehouse.

• Data Democratization: Actively assist in onboarding new data sources, ensuring your work directly leads to more insights and tangible value across the organization.

Skills and Experience Required:

Essential Skills (Hard Requirements):

• Proven experience in Python.

• Hands-on experience with AWS Glue is a must.

• Solid understanding of the AWS data ecosystem (S3, IAM, Lambda's, CloudWatch).

• Proven experience with Infrastructure as Code (IaC) is mandatory, preferably Terraform.

• Proficiency in using (Py)Spark for large-scale data processing.

Nice-to-Haves (Preferred Experience):

• Experience with Snowflake.

• Experience with Hudi (or similar technologies for data lake transactions).

What We Offer:

We offer a dynamic work environment with plenty of room for creativity and innovation. In addition to the opportunity to work with a state-of-the-art data stack and make your mark on our data architecture, we offer:

• A competitive market salary between € 3,500 and € 5,500 gross per month (based on 40 hours), depending on your experience and seniority level.

• Extensive opportunities for personal and professional development and training.

• The necessary support and resources to perform your job optimally.

• A workplace with driven professionals where there is also room for fun and relaxation.

If you are interested and believe you are the Data Engineer who can turn complex challenges into reliable, smart solutions, please apply directly via our website!