Overslaan naar content

Data Engineer

  • On-site
    • Capelle aan den IJssel, Zuid-Holland, Netherlands
  • Product

Job description

As a Data Engineer, you will be the architect and owner of our crucial data pipelines. You play a central role in our ambition to process billions of records daily and elevate our data infrastructure. You are responsible for the entire process: from data ingestion to delivering final insights.

Key Responsibilities:

  • Design & Build: Design, build, and deploy new end-to-end data pipelines from scratch to integrate diverse and high-volume data sources.

  • Massive Processing: Write efficient and scalable processing logic using (Py)Spark (in AWS Glue) to process, clean, and transform billions of records daily.

  • Infrastructure as Code (IaC): Manage and define the entire data infrastructure (AWS Glue jobs, S3 buckets, Lambda functions) as code using Terraform. This forms the core of your "ownership."

  • Quality & Performance: Be responsible for the quality, monitoring, and performance of the pipelines you build, ensuring data lands accurately and on time in our Data Lakehouse.

  • Data Democratization: Actively assist in onboarding new data sources, ensuring your work directly leads to more insights and tangible value across the organization.

Job requirements

  • Proven experience in Python.

  • Solid understanding of Data Engineering in cloud environments, preferably the AWS data ecosystem (Glue, S3, IAM, Lambda's, CloudWatch).

  • Proficiency in using (Py)Spark for large-scale data processing.

Nice-to-Haves (Preferred Experience):

  • Experience with Snowflake.

  • Experience with Hudi (or similar technologies for data lake transactions).

  • Experience with Infrastructure as Code (IaC) is mandatory, preferably Terraform.

What We Offer:

We offer a dynamic work environment with plenty of room for creativity and innovation. In addition to the opportunity to work with a state-of-the-art data stack and make your mark on our data architecture, we offer:

  • A competitive market salary depending on your experience and seniority level.

  • Extensive opportunities for personal and professional development and training.

  • The necessary support and resources to perform your job optimally.

  • A workplace with driven professionals where there is also room for fun and relaxation.

If you are interested and believe you are the Data Engineer who can turn complex challenges into reliable, smart solutions, please apply directly via our website!

or