Find your next tech and IT Job or contract Data Engineering

This Senior Data Engineer role sits within MI6, working in mission-focused teams to bring Artificial Intelligence into critical areas, supporting complex intelligence and national security work. What you’ll be doing Building and maintaining scalable data pipelines and models Working with sensitive data, ensuring secure and ethical handling Supporting the deployment of AI models and integrating APIs Turning complex technical ideas into practical, reliable tools Contributing to engineering best practices and knowledge sharing Experimenting with new tools to keep capabilities cutting-edge

This Lead Data Engineer role sits within MI6, working on mission-focused AI initiatives, designing and delivering the data systems that enable complex decision-making in a fast-moving, high-impact environment. What you’ll be doing Leading the design and build of secure, scalable data pipelines Ensuring data is onboarded, processed and used safely and effectively Working across teams to integrate new data sources and AI capabilities Translating complex requirements into practical, high-impact solutions Supporting the use of AI and LLM workflows , including governance and ethics Driving best practice and contributing to the wider engineering community

About the job Job summary Would you like to work with cutting edge of cloud-first technologies? Do you have experience with modern software development lifecycles in product delivery and test? Have you deep technical breath, supported by a good knowledge of the functional requirements and activities? If so, we’d love to hear from you! At the Driver and Vehicle Licensing Agency (DVLA), we take testing very seriously. We have Software Development Engineers in Test (SDETs) and Test Engineers embedded in our delivery squads and specialists in our Performance and Independent testing teams. As a Senior Test Engineer, you will be a critical part of our team, overseeing and coordinating the independent testing activities across multiple simultaneous deliveries. You will be actively involved with suppliers, partners, and our engineers in ensuring testing activities are performed and reported. You will have an excellent understanding of modern testing and development approaches. We follow an agile methodology, targeting cloud-first deployments. You will often need open communication with several delivery squads and a pragmatic approach to problem solving is essential. A significant part of this role will be working on deliveries designed to transform our IT estate but is likely to also include deliveries necessitated by legislation on the legacy estate. You will report to the Test Manager and represent the capability internally and externally. Joining our department comes with many benefits, including: Employer pension contribution of 28.97% of your salary. Read more about Civil Service Pensions 25 days annual leave, increasing by 1 day each year of service (up to a maximum of 30 days annual leave), plus 8 bank holidays and a privilege day for the King’s birthday Flexible working options where we encourage a great work-life balance. Read more in the Benefits section below! Find out more about what it's like working at: Job description In this role you will be part of the Quality Engineering team responsible for continually driving all aspects of quality improvements. You will be working across several of our delivery teams and performance teams. Your responsibilities will include, but aren’t limited to: Select, use and guide others in using the most appropriate technical tooling, engineering approaches, test types and techniques to identify and address risks early Extend, standardise and build reusable frameworks and tools that support testing Communicate and document chosen approaches, tools, techniques and outcomes to the team and appropriate stakeholders Contribute to and agree engineering standards Great line management is important to us as an organisation, and we will equip and support line managers to develop the skills they need. We aim to empower line managers to create teams where people can flourish and deliver excellent outcomes for the public. For further information on the role, please read the attached role profile. Please note that the role profile is for information purposes only - whilst all elements are relevant to the role, they may not all be assessed during the recruitment process. This job advert will detail exactly what will be assessed during the recruitment process.

This Lead Data Engineer role sits within DVLA’s data platform team, working on modern, large-scale data systems that drive better decisions, insights and digital services. Why this role stands out Lead engineering for high-impact data products across DVLA Work with modern technologies including Databricks, Spark, and lakehouse architectures Shape standards and best practice across a growing data function Collaborate with product teams, analysts and data scientists Play a key role in improving digital services at national scale What you’ll be doing Leading the design and build of data pipelines and data products Developing robust data models and integrations across systems Ensuring data is processed efficiently for analytics and business intelligence Driving best practice and standards across data engineering teams Supporting performance optimisation and balancing cost, scalability and reliability Working across teams to enable reuse of data and improve delivery

Looking to apply your data engineering skills to work that directly informs decision-making across the UK? This opportunity sits within the Office for National Statistics, working on large-scale data platforms that support national priorities, from crisis response to economic insight. Why this role stands out Work on AI-augmented data products and pipelines Contribute to national statistics and cross-government data platforms Play a role in high-impact work such as COVID data insights and cost-of-living analysis Collaborate with analysts and data scientists to unlock the value of complex datasets Be part of a team building reusable, automated data engineering solutions What you’ll be doing Designing and building scalable data pipelines Preparing and linking complex datasets for analysis Improving data quality through cleansing, validation and enhancement Translating business needs into technical solutions Supporting and mentoring others in a collaborative team environment

Use data engineering to support better outcomes for children, learners and educators across the UK. Join the Department for Education (DfE) Data Directorate and help build the data systems that inform decisions across government, the education sector and beyond. What you’ll be working on Designing and delivering data solutions that support national education services Building data products used across government, schools and the wider sector Working with modern cloud technologies to transform how data is used and shared Supporting better decision-making through high-quality, reliable data What you’ll be doing Developing end-to-end data solutions in a complex environment Translating user needs into robust, production-ready data pipelines Collaborating with multidisciplinary teams using Agile and DevOps practices Troubleshooting data issues and improving quality Contributing to knowledge sharing and innovation across the data community

As a Senior Data Engineer, you will design and lead the implementation of data flows that link operational systems, analytics & BI platforms. You will be part of the Data Services team, which handles ingesting, storing, maintaining and exposing a variety of datasets. These datasets are used by analysts and data scientists to generate insights and support decision-making. The team is growing, and your role will involve bringing in new datasets, maintaining existing ones, and ensuring data is clean, accessible and high-quality

At CGI, we help organisations transform how they use data to deliver smarter decisions and lasting value. As a Senior Data Engineer, you’ll play a key role in building and evolving a modern, large-scale data platform, designing reliable and scalable pipelines that support critical business outcomes. Working closely with data leaders and delivery teams, you’ll help shape engineering standards, improve data quality, and enable trusted insights. You’ll be encouraged to take ownership, apply creative thinking to complex challenges, and grow your impact within a collaborative, supportive environment. CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK ‘Best Employer’ by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you’ll be part of an open, friendly community of experts. We’ll train and support you in taking your career wherever you want it to go. Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This is a hybrid position, with an on-site presence in Swansea two days per week.

Drive measurable change by shaping and delivering large-scale data products and platforms using Palantir Foundry and cloud-native tooling. In this role you’ll engineer scalable pipelines, transform complex datasets into operational decision-making assets, and partner with clients to unlock efficiency and insight across critical programmes. You’ll join multi-disciplinary teams where pragmatic ownership, creative solutioning and strong technical craft translate directly into business outcomes—building reusable patterns, improving observability and accelerating client roadmaps for modern data adoption. CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK ‘Best Employer’ by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you’ll be part of an open, friendly community of experts. We’ll train and support you in taking your career wherever you want it to go. Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This is a hybrid position.

At CGI, we’re helping to transform the future of healthcare through the power of data. As a Senior Data Engineer, you’ll play a pivotal role in designing, building, and optimising data platforms that underpin critical national services. Working at the heart of our Healthcare team, you’ll use your expertise in AWS, Databricks, and Python to deliver high-impact solutions that improve outcomes, enhance decision-making, and drive innovation across the sector. You’ll collaborate with experts who share your passion for problem-solving, ownership, and technical excellence—empowered to shape the data foundations of tomorrow. CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK ‘Best Employer’ by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you’ll be part of an open, friendly community of experts. We’ll train and support you in taking your career wherever you want it to go. Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This is a hybrid position based in Leeds.

At CGI, you’ll help protect critical systems by designing and operating data pipelines that enable real-time security insight across complex defence environments. Working on a secure programme, you’ll take ownership of on-premise data ingestion and processing solutions that underpin a SIEM platform built on the Elastic Stack. You’ll collaborate closely with security and infrastructure specialists, apply creative problem-solving to diverse log sources, and continuously improve how data is captured, enriched and analysed. Supported by experienced colleagues and trusted to make meaningful technical decisions, you’ll deliver resilient, high-impact solutions that directly contribute to national security outcomes. CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK ‘Best Employer’ by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you’ll be part of an open, friendly community of experts. We’ll train and support you in taking your career wherever you want it to go. Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This position requires 5 days on site working in Chippenham.

Database Engineer with SQL Server and SSIS Our Client is a bank based in Central London who are looking to recruit a Database Engineer with the ability to work with SSIS. You must have solid expertise of at least 5 years experience of working with MS SQL Server and SSIS – SSIS is very important for this position. Responsible for the development and delivery of new systems to automate and streamline processes required by different departments. To support the internal IT department with changes and upgrades to software platforms. To be primary contact for all technical questions relating to in-house bespoke systems and interfacing. Database Support Supporting budgeting and financial planning processes for Finance department, including loading and refreshing of data based on requirements. Understand and conduct the front-end functionality to amend and change hierarchical structures within the environment. Debug and analyse errors and anomalies within Hyperion system as raised by Finance and to pinpoint areas of failure and correct any issues. Liaise with Finance on a daily basis to ensure smooth running of the Hyperion environment. Build data flows within the SQL environment in SSIS packages. Risk & Regulatory Duties Maintain knowledge of all applicable regulatory requirements including the Bank’s Risk and Compliance policies and procedures and adhere to these to avoid exposing the Bank to undue risk. Report policy/procedure breaches and areas of potential non-compliance and suspicions promptly upon identification in accordance with the Bank's Risk and Compliance policies. Accurately execute all controls within own area to minimise risk of policy, procedure, and/or regulatory breaches. Identify new risks/control gaps within own area and escalate accordingly to your Line Manager and/or Head of Department. Qualifications/Experience Degree level qualified or equivalent. SQL Programming. Knowledge and Skills Software analysis and design. SQL query language. Data warehouse design concepts, (Inmon or Kimball) Must have solid experience of working with SSIS and building data warehouses and some knowledge of reporting using SSRS. The Client is a Bank based in the Central London. This is a 12 month FTC position with a salary of circa £55K - £70K. You will be required to be in the office at least 3 days week. Do send your CV to us in Word format along with your salary and availability.

At CGI, we design and deliver powerful data platforms that enable organisations to unlock insight, accelerate innovation, and achieve measurable business outcomes. As a Data Platform Engineer, you will play a key role in shaping scalable, cloud-based data ecosystems that transform how clients use and value their data. Working across modern data platform technologies (Azure/AWS etc), you will help build high-impact solutions while contributing to a culture that values ownership, encourages creative thinking, and supports continuous growth and collaboration. This is an opportunity to work on meaningful projects, influence technical direction, and deliver real-world impact in a fast-evolving data landscape. CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK ‘Best Employer’ by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you’ll be part of an open, friendly community of experts. We’ll train and support you in taking your career wherever you want it to go. Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This is a hybrid position.

Scala Engineer /Data Engineer (CIP) 6 Month contract initially Based: Remotely Rate: £500 - £585 p/d (via Umbrella company) We have a great opportunity with a world leading organisation where you will be provided with all of the support and development to succeed. A progressive organisation where you can really make a difference. We have a great opportunity for a Scala Engineer /Data Engineer to join the team. Key Responsibilities: Participate in the design and creation of scalable software Design and develop clean functioning, testable code on the frontends and backends, write effective APIs, develop and manage well-functioning databases and applications with security and data protection settings Collaborate with the CIR product owner, business analyst, data engineers and the wider CIP teams to ideate software solutions Peer reviewing pull requests Testing and fixing bugs or other coding issues Set up, maintain and improve continuous integration Support live services with troubleshooting and monitoring Write technical documentation Knowledge & experience Knowledge of frontend languages (HTML, CSS, JavaScript) Knowledge of multiple backend languages (e.g. Scala, Java, Python) and libraries Familiarity with databases (e.g. Postgres, MongoDB, Splunk) Familiarity with big data tools (Spark, Presto, AWS EMR) Proven experience as a Full Stack Developer or similar role Experience coding in continuous integration context AWS suite experience Understands the importance of testing and automation Working in a lean, agile environment Working in a "you build it you run it" team Experience coding in continuous integration context Excellent communication Team player Great attention to detail An analytical mind Skills & technologies Key Skills & Experience: Scala/Java Play Framework (or other MVC/Rest API frameworks) SQL DB (e.g. Aurora, Postgres) NoSQL DB (e.g. MongoDB) Linux/Unix AWS (S3, ECS, Lambda, etc.) HTML/CSS/JavaScript Terraform SBT Continuous Integration (Jenkins) Agile methodologies Desirable: Python Airflow Docker Kibana Grafana This is an excellent opportunity on a great project of work, If you are looking for your next exciting opportunity, apply now for your CV to reach me directly, we will respond as soon as possible. LA International is an award-winning partner of choice for many of the world's most influential companies and government organisations. Holding Enhanced Government Security Accreditation, we are recognised as the European market leader in the delivery of Security Cleared talent to organisations that demand the very highest levels of security, compliance and assurance. A multiple award-winning organisation, having secured the prestigious Queens Award for Enterprise: International Trade over consecutive years. We are committed to fostering an inclusive, equitable and accessible workplace where everyone feels valued and supported. We welcome applications from all individuals, regardless of background or identity, and we encourage candidates who may not meet every listed requirement to still apply. If you require any adjustments or support during the recruitment process, please let us know and we will work with you to ensure a fair and accessible experience. Please Note: If a high volume of applications is received, only candidates shortlisted will be contacted.

Key Responsibilities: · Develop, maintain, and optimize data pipelines using SAS (SAS Enterprise Guide, and SAS Viya where applicable). · Design and implement SQL-based data transformations, ensuring accuracy, performance, and scalability. · Collaborate with business analysts and stakeholders to interpret and translate Business Requirements into robust technical solutions. · Perform unit testing and validation of data processes to ensure data quality, reliability, and compliance with standards. · Troubleshoot and resolve data issues, identifying root causes and implementing long-term fixes. · Document data workflows, logic, and processes, ensuring transparency and maintainability across the team. · Support migration or modernization initiatives, including transitioning workloads to SAS Viya or other platforms when beneficial Required Skills: · Hands-on use of SAS Enterprise Guide for data manipulation and workflow automation. · Ability to write complex queries, joins, aggregations, and performance-tuned SQL code · Exposure to cloud-enabled SAS environments and Viya-based analytics. · Experience performing unit testing, data validation, and reconciliation to ensure accuracy and completeness. · Strong ability to interpret Business Requirements and translate them into technical specifications · Understanding of data models, data flows, and business processes · Ability to work independently and collaboratively in agile or hybrid teams. Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take a minimum 10 weeks. LA International is an award-winning partner of choice for many of the world's most influential companies and government organisations. Holding Enhanced Government Security Accreditation, we are recognised as the European market leader in the delivery of Security Cleared talent to organisations that demand the very highest levels of security, compliance and assurance. An award-winning organisation, having secured the prestigious Queens Award for Enterprise: International Trade over multiple years. We are committed to fostering an inclusive, equitable and accessible workplace where everyone feels valued and supported. We welcome applications from all individuals, regardless of background or identity, and we encourage candidates who may not meet every listed requirement to still apply. If you require any adjustments or support during the recruitment process, please let us know and we will work with you to ensure a fair and accessible experience. Please Note: If a high volume of applications is received, only candidates shortlisted will be contacted.

We are seeking a Senior Data Modeling Engineer to coordinate and participate to the design and implementation of robust, scalable, and business-aligned data models that will serve diverse analytical needs including BI, reporting, and data science. 1. Data Modeling Design o Coordinate and act as Expert for the Definition of the data modeling standards and best practices related to star schema modelling and tailored to Energy Retail business o Coordinate and act as Expert for the Design of the logical and physical data models to support integration from CRM, billing, and other operational systems o Use modeling tools like DB Schema to document and maintain star schema tables, and relationship modeling 2. Data Modeling Development o Coordinate and participate to the creation of the data models according to the standards and best practices defined and the data platform best practices (environments, code, etc.) o Work with ETL tools (e.g., Databricks, Dataiku) to transform the data according to specifications o Document your development according to the best practices defined o Ensure models are optimized for performance, cost, scalability, and usability across BI and data science use cases 3. Collaboration o Collaborate with data engineers and architects to understand the structure of the data ingested in Databricks o Partner with business and data stakeholders to understand data requirements and translate them into modeling solutions o Support data governance and quality initiatives by ensuring models reflect business rules and definitions