
Partager cette offre
IS Data & Middleware · [Company]
Mission title Lead Data Engineer
Location Hybrid, 1 day per week in the office (London or Brussels)
Department IS Data & Middleware
Reports to Engineering Manager – Data & Analytics
Leads 5–7 data engineers working on data platform capabilities and data products
Mission length 12 months, renewable
Role balance 50% people and team leadership, 50% technical leadership and hands-on engineering
Key technologies Databricks, Python, PySpark, SQL, dbt, Azure
Who we are looking for
We want a technically strong engineer with a clear view of how data engineering should be done, and the leadership to bring people with them. You set the standard for quality, design and data modelling, and you earn and keep the trust of engineers, external partners and the business.
Read the profile below. If you recognise yourself in it, we would like to hear from you.
You are
• Technically strong: You are hands-on and credible with Databricks, Spark, Python and SQL. You can solve the hardest problems yourself and review others' work with authority.
• Someone with a strong engineering vision: You have firm, well-reasoned opinions on how things should be built, and you turn them into standards, templates and patterns that others follow.
• Focused on quality, design and modelling: You care about doing things properly. You believe good data modelling is the foundation of trusted data products, and you design before you build.
• A leader people trust: You talk to engineers, external partners and business stakeholders with equal ease. You build trust quickly, keep it, and use it to guide decisions and raise the team's level.
• A builder of foundations: You would rather build a reusable template once than solve the same problem ten times. You make data AI-ready and secure by design, not as an afterthought.
This role is not for you if
• You want to lead only through others and step away from code and design.
• You prefer pure hands-on engineering with no responsibility for people or stakeholders.
Context
The Data & Middleware team runs [Company]'s data systems, which power analytics and the corporate data platforms, and its middleware systems, the custom connectors and shared services that move data between applications.
Our platform is built on Databricks. We are moving our data products into a new, governed workspace designed to be AI-ready. We make them usable through AI data agents such as Databricks Genie, and we support a growing community of technical analysts and analytics engineers in the business who build on the platform themselves. Engineers work in small delivery teams with a Scrum Master and deliver in increments, building, demonstrating and iterating with business stakeholders.
What you will do
You will lead 5–7 data engineers who own data platform capabilities and data products for business areas such as Commercial, Operations, Rolling Stock and Customer. Your time will be split evenly between leading people and leading the technical work.
Lead the team (~50%)
• People: Set clear expectations, coach and develop engineers, and feed into performance conversations led by the Engineering Manager.
• Delivery: Work with the Engineering Manager, Scrum Master and data product owners to prioritise the backlog, allocate work and meet commitments.
• Stakeholders: Be the main technical contact for your business areas.
• Analytics engineering community: Set the standards that business analytics engineers work to, review their code and designs, and own their onboarding.
• Hiring: Run technical interviews and own technical onboarding for new joiners.
Lead the engineering (~50%)
• Engineering standards: Set and enforce coding, review, testing and CI/CD standards. Stay hands-on in code, design and review, and own the run and cost of your team's products.
• Reusable templates: Build and maintain project templates (Databricks Asset Bundles), shared libraries and CI/CD pipelines, so every new data product follows a proven path.
• AI-ready data: Add rich metadata and semantic definitions, curate Genie spaces, and help take AI data agents from proof of concept into reliable production use.
What you will bring
Essential
• 7+ years in data engineering, including at least 2 years leading or mentoring engineers.
• Deep hands-on experience with Databricks and Spark (Unity Catalog, Delta Lake, Lakeflow / DLT), advanced Python and SQL.
• Excellent data modelling skills and experience building data as a product.
• A track record of building reusable templates, shared libraries and CI/CD that other engineers adopt.
• Software engineering discipline applied to data: versioning, testing, pipelines as code.
• Working knowledge of AI data agents (e.g. Databricks Genie) and what makes data AI-ready.
• Clear, persuasive communication with technical and non-technical people.
Nice to have
• AI agent architecture (LLM agents, RAG, MCP) or experience operationalising ML models.
• Azure data services alongside Databricks, dbt, and data contracts (ODPS, ODCS).
• FinOps on Databricks, Scrum delivery, and leading hybrid teams across the UK and continental Europe.
Profil recherché
Who we are looking for
We want a technically strong engineer with a clear view of how data engineering should be done, and the leadership to bring people with them. You set the standard for quality, design and data modelling, and you earn and keep the trust of engineers, external partners and the business.
Read the profile below. If you recognise yourself in it, we would like to hear from you.
You are
Technically strong: You are hands-on and credible with Databricks, Spark, Python and SQL. You can solve the hardest problems yourself and review others' work with authority.
Someone with a strong engineering vision: You have firm, well-reasoned opinions on how things should be built, and you turn them into standards, templates and patterns that others follow.
Focused on quality, design and modelling: You care about doing things properly. You believe good data modelling is the foundation of trusted data products, and you design before you build.
A leader people trust: You talk to engineers, external partners and business stakeholders with equal ease. You build trust quickly, keep it, and use it to guide decisions and raise the team's level.
A builder of foundations: You would rather build a reusable template once than solve the same problem ten times. You make data AI-ready and secure by design, not as an afterthought.
This role is not for you if
You want to lead only through others and step away from code and design.
You prefer pure hands-on engineering with no responsibility for people or stakeholders.
Essential
7+ years in data engineering, including at least 2 years leading or mentoring engineers.
Deep hands-on experience with Databricks and Spark (Unity Catalog, Delta Lake, Lakeflow / DLT), advanced Python and SQL.
Excellent data modelling skills and experience building data as a product.
A track record of building reusable templates, shared libraries and CI/CD that other engineers adopt.
Software engineering discipline applied to data: versioning, testing, pipelines as code.
Working knowledge of AI data agents (e.g. Databricks Genie) and what makes data AI-ready.
Clear, persuasive communication with technical and non-technical people.
Nice to have
AI agent architecture (LLM agents, RAG, MCP) or experience operationalising ML models.
Azure data services alongside Databricks, dbt, and data contracts (ODPS, ODCS).
FinOps on Databricks, Scrum delivery, and leading hybrid teams across the UK and continental Europe.
Environnement de travail
IS Data & Middleware
Télétravail: 1 sur sur site est demandé
Postulez à cette offre !
Trouvez votre prochaine mission parmi +10 000 offres !
Fixez vos conditions
Rémunération, télétravail... Définissez tous les critères importants pour vous.
Faites-vous chasser
Les recruteurs viennent directement chercher leurs futurs talents dans notre CVthèque.
100% gratuit
Aucune commission prélevée sur votre mission freelance.
Lead Data Engineer
MEETSHAKE
