Offre d'emploi Senior Databricks Engineer

Senior Databricks Engineer - Long Term Mission - Full Remote

Avanda is a Swiss IT Consultancy. We are currently looking for a Senior Databricks Engineer to join our international team at our global end client. This is a long-term opportunity. You can work remotely with a few business trips to Zurich, CH.
 
THE ROLE

You will join a B2B Sales Data Aggregation programme built on Databricks. The goal is to unify CRM data from Salesforce, Microsoft Dynamics 365, and Excel/SharePoint into a single harmonised platform and deliver high-quality data products and KPI dashboards for senior leadership.
 

YOUR RESPONSIBILITIES
 

• Design and build ETL pipelines and CDC/incremental connectors for Salesforce & Dynamics 365 using Databricks-native patterns (Auto Loader / Structured Streaming / Jobs)
  


• Implement Bronze → Silver transformations using Delta Lake and reusable SQL/Notebook templates
  


• Develop PySpark notebooks and apply Delta Lake optimisations (compaction, Z-order, caching)
  


• Build automated data-quality checks and deliver KPI dashboards for C-level stakeholders
  


• Set up monitoring, alerting, and job orchestration (Databricks Jobs / Observability)
  


• Document architecture and data lineage (Unity Catalog / Delta time-travel)
  

Requirements

• 5+ years of data engineering experience
  


• 3+ years with Databricks and Delta Lake
  


• Strong PySpark / Python and SQL skills
  


• Proven experience integrating Salesforce & Dynamics 365 (APIs, CDC, Bulk API)
  


• Solid background in data modelling, ETL design, and incremental/CDC approaches
  


• Experience with Azure cloud services and Databricks workspace administration
  


• Experience building data quality frameworks and monitoring
  


• English mandatory; German is a plus