Databricks Data Engineer (f/m/d)

Axpo

  • Comunidad de Madrid
  • Permanente
  • Tiempo completo
  • Hace 1 día
Who We AreAxpo is driven by a single purpose – to enable a sustainable future through innovative energy solutions. As Switzerland's largest producer of renewable energy and a leading international energy trader, Axpo leverages cutting-edge technologies to serve customers in over 30 countries. We thrive on collaboration, innovation, and a passion for driving impactful change.About the TeamYou will report to the Head of Development and collaborate closely with the Chief Data & Analytics Office (CDAO) and business data teams. Together, we share the goal of unlocking data and enabling self-service analytics capabilities across Axpo, within a cross-functional operating model that ensures data quality, semantics, and governance align with enterprise standards. You’ll work closely with the CDAO office and contribute to the definition and provision of data pipeline templates, used for the ingestion of source data as source-aligned Data Product, aligned with business semantics, domain ownership, and enterprise data governance strategy. Our decentralized approach means close collaboration with various business hubs across Europe, ensuring local needs shape our global platform. You’ll find a mindset committed to innovation, collaboration, and excellence.What You Will DoAs a Databricks Data Engineer, you will:
  • Be a core contributor in Axpo’s data transformation journey by using Databricks as our primary data and analytics platform.
  • Design, develop, and operate scalable data pipelines on Databricks, integrating data from a wide variety of sources (structured, semi-structured, unstructured).
  • Leverage Apache Spark, Delta Lake, and Unity Catalog to ensure high-quality, secure, and reliable data operations.
  • Apply best practices in CI/CD, DevOps, orchestration (e.g., Dragster, Airflow), and infrastructure-as-code (Terraform).
  • Build re-usable frameworks and libraries to accelerate ingestion, transformation, and data serving across the business.
  • Work closely with data scientists, analysts, and product teams to create performant and cost-efficient analytics solutions.
  • Drive the adoption of Databricks Lakehouse architecture and ensure that data pipelines conform to governance, access, and documentation standards defined by the CDAO office
  • Ensure compliance with data privacy and protection standards (e.g., GDPR).
  • Actively contribute to the continuous improvement of our platform in terms of scalability, performance, and usability.
What You Bring & Who You AreWe’re looking for someone with:
  • A university degree in Computer Science, Data Engineering, Information Systems, or a related field.
  • Strong experience with Databricks, Spark, Delta Lake, and SQL/Scala/Python.
  • Proficiency in dbt, ideally with experience integrating it into Databricks workflows.
  • Familiarity with Azure cloud services (Data Lake, Blob Storage, Synapse, etc.).
  • Hands-on experience with Git-based workflows, CI/CD pipelines, and data orchestration tools like Dragster and Airflow.
  • Deep understanding of data modeling, streaming & batch processing, and cost-efficient architecture.
  • Ability to work with high-volume, heterogeneous data and APIs in production-grade environments.
  • Experience working within enterprise data governance frameworks, and implementing metadata management and observability practices in alignment with governance guidance.
  • Strong interpersonal and communication skills, with a collaborative, solution-oriented mindset.
  • Fluency in English.
Technologies You’ll Work With
  • Core: Databricks, Spark, Delta Lake, Python, dbt, SQL
  • Cloud: Microsoft Azure (Data Lake, Synapse, Storage)
  • DevOps: Bitbucket/GitHub, Azure DevOps, CI/CD, Terraform
  • Orchestration & Observability: Dragster, Airflow, Grafana, Datadog, New Relic
  • Visualization: Power BI
  • Other: Confluence, Docker, Linux
Nice to Have
  • Experience with Unity Catalog and Databricks Governance Frameworks
  • Exposure to Machine Learning workflows on Databricks (e.g., MLflow)
  • Knowledge of Microsoft Fabric or Snowflake
  • Experience with low-code analytics tools like Dataiku
  • Familiarity with PostgreSQL or MongoDB
  • Front-end development skills (e.g., for data product interfaces)
Benefits:At our company, we strive to create a culture of continuous learning, personal growth, and international community involvement. We're passionate about providing our employees with the tools and resources they need to succeed, and we're confident that you'll love being part of our team!
  • Working Hours
We offer flexible working hours to accommodate your work schedule. 60% on remote and 40% at our offices in Madrid, Torre Europa.
  • Meal allowances
You can enjoy delicious meals on us, no matter if you are working remotely or on-site. Equivalent to 11 € net/daily.
*Option to use it for public transportation or childcare instead.
  • Internet Compensation
We cover the cost of your home internet connection, as we understand how essential connectivity is in the modern workplace. Equivalent up to 48.40 € net/month.
  • Microsoft ESI Certifications
Access to the ESI (Enterprise Skills Initiative) program certification, provides hands-on training for learning and enhancing technical skills and knowledge of Microsoft and Azure technologies.
  • Training courses
Our company is committed to helping our employees grow and develop their skills, which is why we offer a variety of industry specific training courses and a learning channel.
  • Gym Coverage
Stay active and healthy with our 90% coverage benefit, which provides access to the nearby gym: Forus Selection to keep you energized throughout the day
  • Health Insurance
We take the health and wellbeing of our employees seriously, which is why we offer a comprehensive health insurance plan and the option to extend it to your spouse and children.Axpo's ambition is to provide society with a sustainable future through innovative energy solutions. Axpo is the largest Swiss producer of renewable energy and an international pioneer in energy trading and the marketing of solar and wind power. More than 7,000 employees combine experience and know-how with a passion for innovation and the joint search for ever better solutions. Axpo relies on innovative technologies to meet the ever-changing needs of its customers in over 30 countries in Europe, North America and Asia.

Axpo