
Data Engineer
- Madrid
- Permanente
- Tiempo completo
- Maintain and improve current data pipelines for ingestion and transformation.
- Design and deploy new pipelines using Python and Databricks.
- Develop and manage data models with DBT, using SQL and Jinja to support business intelligence and analytics.
- Ensure data quality and reliability throughout all pipelines and datasets.
- Work with data analysts and business stakeholders to translate business needs into technical requirements.
- Orchestrate pipelines and automate workflows using an orchestration system.
- Help manage our infrastructure using tools like Terraform in our AWS environment.
- Uphold data governance, security, and privacy standards, with a focus on GDPR compliance.
- Deep knowledge of Python for scripting and data manipulation.
- Strong skills in DBT, including writing complex SQL and using Jinja templating.
- Hands-on experience with Databricks and Spark.
- Experience with a workflow orchestration tool like Airflow.
- Familiarity with AWS services (like S3 and EC2).
- Experience with infrastructure-as-code principles and Terraform.
- Some experience with Scala is a plus.
- Understanding of data governance, security, and privacy regulations (GDPR experience required).
- A business-minded approach and a history of thriving in fast-paced environments.
- Excellent communication skills, with the ability to bridge technical and non-technical teams.