Here are some jobs that could be of interest.
Find your next tech and IT Job or contract role.
Our job search is powered by , part of the Free-Work group.
Tip
Use commas to search for several terms at the same time.
Example : sql, php corresponds to sql OR php
Job Vacancy
Data Engineer
Role: BI Data Engineer Location: City of London Salary : £80,000 WFH: 3 days a week in the office A well-known property giant is looking for a BI Data Engineer to join their team. This is an exciting opportunity to join a prestigious company and to take your career to the next level: Keys skills/Experience: Strong Visualisation experience using Power BI Solid experience working with MS Fabric Comfortable setting up complex ETL processes Strong experience around SSIS and Azure Data Factory Azure Synapse, Azure Data Factory & Data Lakes DevOps and Deployments knowledge and exposure Solid communication skills and comfortable liaising with senior stakeholders Solid SQL skills If this role sounds of interest and you would like to know more do not hesitate to submit your CV to
Job Vacancy
Data Engineer
Data Engineer Bath, Manchester, or Leeds - mostly remote Competitive Salary + Bonus + Healthcare + Life Assurance + Income Protection + Shares Options + More! Excellent opportunity for a Data Engineer with experience of Azure to join a world-leading manufacturer offering a great benefits package, career growth and progression, and the chance to work on some of the most interesting Data projects in the UK! This company are undergoing one of the biggest business change and transformation programs in the world. They are currently rolling out an entirely new range of ERPs, CRMs, and Cloud platforms and as a part of these processes their entire Data Infrastructure is changing. In this role you will report to the Data Engineering Lead. You'll join a small but specialised team of Data Engineers working on the design, implementation, and optimisation of everything from Data Ingestion, to CI/CD Pipeline build, to Data Governance policy and procedures. You'll work predominantly from home but you will spend some time in the office each week. The ideal candidate will be a Data Engineer with Azure experience. Candidates must be confident building CI/CD pipelines using Python and building Databases from scratch. Candidates must be happy to commute to the office at least once a week, dependant on the project. This is a fantastic opportunity to join a global leader offering great benefits, technically fascinating project-based work, and brilliant progression opportunities throughout the business. The Role: *Data Engineering *Database and CI/CD Pipeline Build *Azure-focused stack *At least one day a week on-site, project dependant The Person: *Data Engineering experience *Azure experience *Confident building CI/CD pipelines and databases from scratch *Happy to commute to the office a minimum of one day a week Reference Number: BBBH238490 To apply for this role or for to be considered for further roles, please click \"Apply Now\" or contact Tommy Williams at Rise Technical Recruitment. Rise Technical Recruitment Ltd acts as an employment agency for permanent roles and an employment business for temporary roles. The salary advertised is the bracket available for this position. The actual salary paid will be dependent on your level of experience, qualifications and skill set. We are an equal opportunities employer and welcome applications from all suitable candidates.
Freelance job
Data Engineer
Data Engineer - Azure / .Net - (£550 - £650 Per Day) - Outside IR35 - Remote Overview: An excellent opportunity has arisen with an established financial services organisation, to work on an exciting greenfield project. We are looking for an experienced Data Engineer with a particular focus on the Azure stack but also some experience of being technically hands on coding with .Net. The role is remote, working in a small team of experienced contractors. The codebase is an all .Net Core affair running on Azure. Essential Skills & Requirements: Azure ETL Azure Data Factory Azure SQL / SQL Server Azure Function Apps .Net / C# Excel / Access VBA Highly numerate, analytical Contract details: 6 month contract (long term) £550 - £650 per day - outside IR35 Fully remote Data Engineer - Azure / .Net - (£550 - £650 Per Day) - Outside IR35 - Remote
Job Vacancy
Data Engineer
DWP. Digital with Purpose. Do you want to utilise best-in-class technologies to deliver data products? Are you looking for ongoing professional development while designing and building modern cloud-based data products? DWP is the UK's largest government department. We help people into work and make payments worth over £195bn a year to support some of the most vulnerable people in our society. We're carrying out a once-in-a-generation digital transformation of DWP product and services, used by millions of people. If you are looking to develop your skills, work on some of the most challenging and rewarding IT projects, shape solutions and contribute to new thinking, all with a great work life balance, we would love to hear from you. Required skills and experience: Enterprise-level experience of SQL, Shell/BASH, Linux and command line Enterprise-level experience in developing and enhancing efficient, scalable, automated ETL/ELT pipelines including error handling, re-start and data quality Experience of translating technical concepts into non-technical language You understand how to communicate with internal and external stakeholders and can change your style of communication to suit technical and non-technical audiences Data with Power. You'll join our Integrated Risk and Intelligence Service (IRIS) team which is a collaboration between DWP Digital, Counter Fraud, Compliance and Debt and Cyber Resilience Centre. Our agile IRIS team is central to DWP's Fraud and Error Strategy and is radically transforming how we detect and prevent fraud and error in the welfare system. You'll play a vital role in delivering innovative and insightful data products, and work across the data engineering lifecycle. Integrating a variety of source data, you'll use your judgement to figure out the best approach, so that appropriate data quality, integrity and alerting is built into all our solutions. You will conduct proof of concept and discovery work and evaluating proposed changes that might impact data performance, models or reports. You'll also have chance to pass on your skills. You'll coach and mentor more junior colleagues, helping to build data engineering knowledge and capability within the team. Working closely with stakeholders to develop and maintain robust data products and services, our team support the continuous improvement of data engineering standards and engage with stakeholders at all stages of the data engineering lifecycle. Your main responsibilities will include: Reviewing and transforming business requirements into reusable, production-ready code Integrating a variety of source data, using judgement and guidance to determine the appropriate approach Conducting proof of concept and discovery work to provide information and advice Playing an active role in code development activities for delivery of data transformation products Developing automated data ingest routines, workflows and mappings for structured and unstructured data Completing design specifications and technical documentation Details. Wages. Perks. Location: You'll join us based at one of our brilliant digital hubs in either Birmingham, Blackpool, Leeds, London, Manchester, Newcastle or Sheffield Hybrid working: We operate a hybrid working model with a mix of home working and some time in the office. Pay : In return for your skills, we offer pay up to £58,347. This is comprised of salary up to £43,347 (£47,986 in London) and a Digital Allowance of up to £15,000 per annum available for exceptional candidates. Pension: You'll be eligible for a brilliant civil service pension with employer contributions worth 28.97% (worth up to £12,557 a year). Holidays: You'll get a generous leave package starting at 26 days, plus all the usual bank holidays, and the option to take extra days off on flexi leave. We also have a broad benefits package built around your work-life balance which includes: Flexible working, flexi hours and flexi days Hybrid working: some time in a hub with the team, some time at home Family-friendly policies Time off volunteering and charitable giving Bring your authentic self to work with 'I Can Be Me in DWP' Discounts and savings on shopping, fun days out and more Interest-free loans to buy a bike or a season ticket Sports and social activities Working in an award-winning environment and culture Professional development, coaching, mentoring and career progression opportunities Click 'Apply' for more information and to start an application on Civil Service Jobs. Please note, this role requires you to pass Security Check clearance
Job Vacancy
Data Engineer
DWP. Digital with Purpose. Do you want to utilise best-in-class technologies to deliver data products? Are you looking for ongoing professional development while designing and building modern cloud-based data products? DWP is the UK's largest government department. We help people into work and make payments worth over £195bn a year to support some of the most vulnerable people in our society. We're carrying out a once-in-a-generation digital transformation of DWP product and services, used by millions of people. If you are looking to develop your skills, work on some of the most challenging and rewarding IT projects, shape solutions and contribute to new thinking, all with a great work life balance, we would love to hear from you. Required skills and experience: Enterprise-level experience of SQL, Shell/BASH, Linux and command line Enterprise-level experience in developing and enhancing efficient, scalable, automated ETL/ELT pipelines including error handling, re-start and data quality Experience of translating technical concepts into non-technical language You understand how to communicate with internal and external stakeholders and can change your style of communication to suit technical and non-technical audiences Data with Power. You'll join our Integrated Risk and Intelligence Service (IRIS) team which is a collaboration between DWP Digital, Counter Fraud, Compliance and Debt and Cyber Resilience Centre. Our agile IRIS team is central to DWP's Fraud and Error Strategy and is radically transforming how we detect and prevent fraud and error in the welfare system. You'll play a vital role in delivering innovative and insightful data products, and work across the data engineering lifecycle. Integrating a variety of source data, you'll use your judgement to figure out the best approach, so that appropriate data quality, integrity and alerting is built into all our solutions. You will conduct proof of concept and discovery work and evaluating proposed changes that might impact data performance, models or reports. You'll also have chance to pass on your skills. You'll coach and mentor more junior colleagues, helping to build data engineering knowledge and capability within the team. Working closely with stakeholders to develop and maintain robust data products and services, our team support the continuous improvement of data engineering standards and engage with stakeholders at all stages of the data engineering lifecycle. Your main responsibilities will include: Reviewing and transforming business requirements into reusable, production-ready code Integrating a variety of source data, using judgement and guidance to determine the appropriate approach Conducting proof of concept and discovery work to provide information and advice Playing an active role in code development activities for delivery of data transformation products Developing automated data ingest routines, workflows and mappings for structured and unstructured data Completing design specifications and technical documentation Details. Wages. Perks. Location: You'll join us based at one of our brilliant digital hubs in either Birmingham, Blackpool, Leeds, London, Manchester, Newcastle or Sheffield Hybrid working: We operate a hybrid working model with a mix of home working and some time in the office. Pay : In return for your skills, we offer pay up to £58,347. This is comprised of salary up to £43,347 (£47,986 in London) and a Digital Allowance of up to £15,000 per annum available for exceptional candidates. Pension: You'll be eligible for a brilliant civil service pension with employer contributions worth 28.97% (worth up to £12,557 a year). Holidays: You'll get a generous leave package starting at 26 days, plus all the usual bank holidays, and the option to take extra days off on flexi leave. We also have a broad benefits package built around your work-life balance which includes: Flexible working, flexi hours and flexi days Hybrid working: some time in a hub with the team, some time at home Family-friendly policies Time off volunteering and charitable giving Bring your authentic self to work with 'I Can Be Me in DWP' Discounts and savings on shopping, fun days out and more Interest-free loans to buy a bike or a season ticket Sports and social activities Working in an award-winning environment and culture Professional development, coaching, mentoring and career progression opportunities Click 'Apply' for more information and to start an application on Civil Service Jobs. Please note, this role requires you to pass Security Check clearance
Job Vacancy
Data Engineer
DWP. Digital with Purpose. Do you want to utilise best-in-class technologies to deliver data products? Are you looking for ongoing professional development while designing and building modern cloud-based data products? DWP is the UK's largest government department. We help people into work and make payments worth over £195bn a year to support some of the most vulnerable people in our society. We're carrying out a once-in-a-generation digital transformation of DWP product and services, used by millions of people. If you are looking to develop your skills, work on some of the most challenging and rewarding IT projects, shape solutions and contribute to new thinking, all with a great work life balance, we would love to hear from you. Required skills and experience: Enterprise-level experience of SQL, Shell/BASH, Linux and command line Enterprise-level experience in developing and enhancing efficient, scalable, automated ETL/ELT pipelines including error handling, re-start and data quality Experience of translating technical concepts into non-technical language You understand how to communicate with internal and external stakeholders and can change your style of communication to suit technical and non-technical audiences Data with Power. You'll join our Integrated Risk and Intelligence Service (IRIS) team which is a collaboration between DWP Digital, Counter Fraud, Compliance and Debt and Cyber Resilience Centre. Our agile IRIS team is central to DWP's Fraud and Error Strategy and is radically transforming how we detect and prevent fraud and error in the welfare system. You'll play a vital role in delivering innovative and insightful data products, and work across the data engineering lifecycle. Integrating a variety of source data, you'll use your judgement to figure out the best approach, so that appropriate data quality, integrity and alerting is built into all our solutions. You will conduct proof of concept and discovery work and evaluating proposed changes that might impact data performance, models or reports. You'll also have chance to pass on your skills. You'll coach and mentor more junior colleagues, helping to build data engineering knowledge and capability within the team. Working closely with stakeholders to develop and maintain robust data products and services, our team support the continuous improvement of data engineering standards and engage with stakeholders at all stages of the data engineering lifecycle. Your main responsibilities will include: Reviewing and transforming business requirements into reusable, production-ready code Integrating a variety of source data, using judgement and guidance to determine the appropriate approach Conducting proof of concept and discovery work to provide information and advice Playing an active role in code development activities for delivery of data transformation products Developing automated data ingest routines, workflows and mappings for structured and unstructured data Completing design specifications and technical documentation Details. Wages. Perks. Location: You'll join us based at one of our brilliant digital hubs in either Birmingham, Blackpool, Leeds, London, Manchester, Newcastle or Sheffield Hybrid working: We operate a hybrid working model with a mix of home working and some time in the office. Pay : In return for your skills, we offer pay up to £58,347. This is comprised of salary up to £43,347 (£47,986 in London) and a Digital Allowance of up to £15,000 per annum available for exceptional candidates. Pension: You'll be eligible for a brilliant civil service pension with employer contributions worth 28.97% (worth up to £12,557 a year). Holidays: You'll get a generous leave package starting at 26 days, plus all the usual bank holidays, and the option to take extra days off on flexi leave. We also have a broad benefits package built around your work-life balance which includes: Flexible working, flexi hours and flexi days Hybrid working: some time in a hub with the team, some time at home Family-friendly policies Time off volunteering and charitable giving Bring your authentic self to work with 'I Can Be Me in DWP' Discounts and savings on shopping, fun days out and more Interest-free loans to buy a bike or a season ticket Sports and social activities Working in an award-winning environment and culture Professional development, coaching, mentoring and career progression opportunities Click 'Apply' for more information and to start an application on Civil Service Jobs. Please note, this role requires you to pass Security Check clearance
Job Vacancy
Foundry Data Engineer
Information Services and Security have a vital role to play in a crucial national mission. We're here to enable the organisation to deliver through the use of technology. As AWE transforms itself to meet the needs of the UK's next-generation nuclear deterrent, we need to adapt to deliver data-driven decision making, flexible and future-proofed IT services, adaptable cyber security, support to a multi-billion Pound building programme, and many more. IS Modernisation's role is to provide an integrated Information Services and Security, project and programme delivery team to deliver the right business capabilities to support AWE's Mission Delivery. A diverse team, with roles throughout the project and programme management environment, delivering a variety of projects within the technical space. With the vision to increase the tempo of delivery without impacting on safety and security here at AWE. Location - Reading area Salary - £38,350 - £50,000 DOE AWE (one of the best 25 big companies to work for in the UK) offers an attractive array of benefits which include: Market leading contributory pension scheme Generous holiday entitlement (270 hours a year including bank holidays, plus every other Friday off) Flexible working hours Salary sacrifice scheme Consideration for either full time or part time hours. Just let us know on your application if you wish to work part time Relocation package available (terms and conditions apply) Responsibilities: Learn how to use best-in-class data integration software that is recognised across industry. Work closely with internal customers to understand their greatest problems and design and implement data-driven solutions using the Foundry platform. Take ownership of high-stakes projects, leading end-to-end execution with small teams. Engage in architectural discussions with fellow engineers to drive effective solutions. Wrangle massive-scale data, ensuring its quality and usability. Develop custom web applications to provide user-friendly interfaces for data access and analysis. Collaborate efficiently with both technical and non-technical individuals in a dynamic environment with evolving objectives and user iteration. What We Value: A highly analytical approach and a keen desire to solve technical problems using data structures, storage systems, cloud infrastructure, front-end frameworks, and other technical tools. Experience or curiosity about working with and utilizing large-scale data to tackle valuable business problems. Ability to collaborate effectively in teams with individuals from both technical and non-technical backgrounds. A self-starter with ability to get stuck into complex problems to find real business value and require little oversight, comfortable with making decisions on the edge in line with the team's objectives and values. Comfortable working in a dynamic environment with evolving objectives and a focus on iteration with users. You Will Have: Strong engineering background, preferably in fields such as Computer Science, Mathematics, Software Engineering, Physics, or Data Science. Proficiency in at least one programming language such as Python, Java, C++, TypeScript/JavaScript, or similar. Hands-on experience with Foundry - Desirable All Candidates must be willing and able to obtain and maintain the necessary security clearance for the role.
Job Vacancy
Data Engineer
DWP. Digital with Purpose. Do you want to utilise best-in-class technologies to deliver data products? Are you looking for ongoing professional development while designing and building modern cloud-based data products? DWP is the UK's largest government department. We help people into work and make payments worth over £195bn a year to support some of the most vulnerable people in our society. We're carrying out a once-in-a-generation digital transformation of DWP product and services, used by millions of people. If you are looking to develop your skills, work on some of the most challenging and rewarding IT projects, shape solutions and contribute to new thinking, all with a great work life balance, we would love to hear from you. Required skills and experience: Enterprise-level experience of SQL, Shell/BASH, Linux and command line Enterprise-level experience in developing and enhancing efficient, scalable, automated ETL/ELT pipelines including error handling, re-start and data quality Experience of translating technical concepts into non-technical language You understand how to communicate with internal and external stakeholders and can change your style of communication to suit technical and non-technical audiences Data with Power. You'll join our Integrated Risk and Intelligence Service (IRIS) team which is a collaboration between DWP Digital, Counter Fraud, Compliance and Debt and Cyber Resilience Centre. Our agile IRIS team is central to DWP's Fraud and Error Strategy and is radically transforming how we detect and prevent fraud and error in the welfare system. You'll play a vital role in delivering innovative and insightful data products, and work across the data engineering lifecycle. Integrating a variety of source data, you'll use your judgement to figure out the best approach, so that appropriate data quality, integrity and alerting is built into all our solutions. You will conduct proof of concept and discovery work and evaluating proposed changes that might impact data performance, models or reports. You'll also have chance to pass on your skills. You'll coach and mentor more junior colleagues, helping to build data engineering knowledge and capability within the team. Working closely with stakeholders to develop and maintain robust data products and services, our team support the continuous improvement of data engineering standards and engage with stakeholders at all stages of the data engineering lifecycle. Your main responsibilities will include: Reviewing and transforming business requirements into reusable, production-ready code Integrating a variety of source data, using judgement and guidance to determine the appropriate approach Conducting proof of concept and discovery work to provide information and advice Playing an active role in code development activities for delivery of data transformation products Developing automated data ingest routines, workflows and mappings for structured and unstructured data Completing design specifications and technical documentation Details. Wages. Perks. Location: You'll join us based at one of our brilliant digital hubs in either Birmingham, Blackpool, Leeds, London, Manchester, Newcastle or Sheffield Hybrid working: We operate a hybrid working model with a mix of home working and some time in the office. Pay : In return for your skills, we offer pay up to £58,347. This is comprised of salary up to £43,347 (£47,986 in London) and a Digital Allowance of up to £15,000 per annum available for exceptional candidates. Pension: You'll be eligible for a brilliant civil service pension with employer contributions worth 28.97% (worth up to £12,557 a year). Holidays: You'll get a generous leave package starting at 26 days, plus all the usual bank holidays, and the option to take extra days off on flexi leave. We also have a broad benefits package built around your work-life balance which includes: Flexible working, flexi hours and flexi days Hybrid working: some time in a hub with the team, some time at home Family-friendly policies Time off volunteering and charitable giving Bring your authentic self to work with 'I Can Be Me in DWP' Discounts and savings on shopping, fun days out and more Interest-free loans to buy a bike or a season ticket Sports and social activities Working in an award-winning environment and culture Professional development, coaching, mentoring and career progression opportunities Click 'Apply' for more information and to start an application on Civil Service Jobs. Please note, this role requires you to pass Security Check clearance
Job Vacancy
Data Engineer
DWP. Digital with Purpose. Do you want to utilise best-in-class technologies to deliver data products? Are you looking for ongoing professional development while designing and building modern cloud-based data products? DWP is the UK's largest government department. We help people into work and make payments worth over £195bn a year to support some of the most vulnerable people in our society. We're carrying out a once-in-a-generation digital transformation of DWP product and services, used by millions of people. If you are looking to develop your skills, work on some of the most challenging and rewarding IT projects, shape solutions and contribute to new thinking, all with a great work life balance, we would love to hear from you. Required skills and experience: Enterprise-level experience of SQL, Shell/BASH, Linux and command line Enterprise-level experience in developing and enhancing efficient, scalable, automated ETL/ELT pipelines including error handling, re-start and data quality Experience of translating technical concepts into non-technical language You understand how to communicate with internal and external stakeholders and can change your style of communication to suit technical and non-technical audiences Data with Power. You'll join our Integrated Risk and Intelligence Service (IRIS) team which is a collaboration between DWP Digital, Counter Fraud, Compliance and Debt and Cyber Resilience Centre. Our agile IRIS team is central to DWP's Fraud and Error Strategy and is radically transforming how we detect and prevent fraud and error in the welfare system. You'll play a vital role in delivering innovative and insightful data products, and work across the data engineering lifecycle. Integrating a variety of source data, you'll use your judgement to figure out the best approach, so that appropriate data quality, integrity and alerting is built into all our solutions. You will conduct proof of concept and discovery work and evaluating proposed changes that might impact data performance, models or reports. You'll also have chance to pass on your skills. You'll coach and mentor more junior colleagues, helping to build data engineering knowledge and capability within the team. Working closely with stakeholders to develop and maintain robust data products and services, our team support the continuous improvement of data engineering standards and engage with stakeholders at all stages of the data engineering lifecycle. Your main responsibilities will include: Reviewing and transforming business requirements into reusable, production-ready code Integrating a variety of source data, using judgement and guidance to determine the appropriate approach Conducting proof of concept and discovery work to provide information and advice Playing an active role in code development activities for delivery of data transformation products Developing automated data ingest routines, workflows and mappings for structured and unstructured data Completing design specifications and technical documentation Details. Wages. Perks. Location: You'll join us based at one of our brilliant digital hubs in either Birmingham, Blackpool, Leeds, London, Manchester, Newcastle or Sheffield Hybrid working: We operate a hybrid working model with a mix of home working and some time in the office. Pay : In return for your skills, we offer pay up to £58,347. This is comprised of salary up to £43,347 (£47,986 in London) and a Digital Allowance of up to £15,000 per annum available for exceptional candidates. Pension: You'll be eligible for a brilliant civil service pension with employer contributions worth 28.97% (worth up to £12,557 a year). Holidays: You'll get a generous leave package starting at 26 days, plus all the usual bank holidays, and the option to take extra days off on flexi leave. We also have a broad benefits package built around your work-life balance which includes: Flexible working, flexi hours and flexi days Hybrid working: some time in a hub with the team, some time at home Family-friendly policies Time off volunteering and charitable giving Bring your authentic self to work with 'I Can Be Me in DWP' Discounts and savings on shopping, fun days out and more Interest-free loans to buy a bike or a season ticket Sports and social activities Working in an award-winning environment and culture Professional development, coaching, mentoring and career progression opportunities Click 'Apply' for more information and to start an application on Civil Service Jobs. Please note, this role requires you to pass Security Check clearance
Job Vacancy
Senior Data Engineer
We are searching for an experienced Senior Data Engineer someone to help deliver an ambitious and exciting data transformation programme for one of our technology clients. The position is offered on a remote basis with very occasional trips to the office (this is likely to be less than 2 or 3 times per year). This is an extremely exciting Senior Data Engineer role which would be ideal for an experienced professional, someone who is ready to lead and innovate. Our client is a 100% data-driven company who pride themselves on deploying the best engineering practices across their products, solutions and services. In this role, you will: Assemble large, complex data sets. You will craft and manage data sets that meet both functional and non-functional business requirements. Build advanced data solutions - you will develop software and infrastructure for optimal data extraction, transformation and loading using leading cloud technologies including Azure and AWS. Leverage Big Data Technologies - you will utilise tools such as Hadoop, Spark and Kafka to design and manage large-scale data processing systems. Extend and maintain the data Warehouse - you will be supporting and enhancing the data warehouse platform which is used for all reporting solutions. Ensure cost efficiency - you will help to keep the data platform and its solutions within agreed cost models and budgets. Lead by example - you will provide thought leadership, helping to inspire and guide your team and colleagues through your excellence. About You We are looking for a passionate Senior Data Engineer with the ability to inspire and mentor more junior team members. You will ideally have the following experience and skill set: - Extensive experience in data engineering, in both Cloud & On-Prem environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Exceptional coding skills. Strong analytic and problem-solving abilities. Good understanding of Quality and Information Security principles. Azure and/or AWS experience (coding, configuration, automation, monitoring and security) Big Data expertise. Advanced Database and SQL skills. Effective communication, ability to explain technical concepts to a range of audiences. Strong understanding of the principles of data model design and implementation. Able to provide coaching and training to less experienced members of the team. Essential skills: ETL Tools - Azure Data Fabric, Azure Data Factory and Databricks or similar. Languages - Python, Spark, Java, PySpark, Spark SQL or similar. Lakes - Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. SQL and/or data warehousing design patterns and implementation. Highly desirable skills (not essential) Geospatial data experience The role comes with an excellent benefits package, including an incredibly good holiday allowance, good pension, healthcare options, professional development and a bonus! Please note - to be considered for this role you MUST be able to work in the UK without company sponsorship and you MUST be UK based (you cannot be based overseas even though the role is remote). Keywords Data Engineer, Lead Data Engineer, Senior Data Engineer, Cloud Data Platform, Data Transformation, Data Insights, CI/CD, Deployment Pipelines, Data Pipelines, Data Architectures, Architecture Patterns, Cloud Data Migration, Data Governance, ETL, Databricks, Azure Data Fabric, Azure Data Factory, Azure Data, Delta Lake, Databricks Lakehouse, Python, PySpark, Spark SQL, SQL, Data Warehousing. Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this position. No terminology in this advert is intended to discriminate against any of the protected characteristics that fall under the Equality Act 2010. Bowerford Associates Ltd is acting as an Employment Agency in relation to this vacancy.
Job Vacancy
Data Engineer
DWP. Digital with Purpose. Do you want to utilise best-in-class technologies to deliver data products? Are you looking for ongoing professional development while designing and building modern cloud-based data products? DWP is the UK's largest government department. We help people into work and make payments worth over £195bn a year to support some of the most vulnerable people in our society. We're carrying out a once-in-a-generation digital transformation of DWP product and services, used by millions of people. If you are looking to develop your skills, work on some of the most challenging and rewarding IT projects, shape solutions and contribute to new thinking, all with a great work life balance, we would love to hear from you. Required skills and experience: Enterprise-level experience of SQL, Shell/BASH, Linux and command line Enterprise-level experience in developing and enhancing efficient, scalable, automated ETL/ELT pipelines including error handling, re-start and data quality Experience of translating technical concepts into non-technical language You understand how to communicate with internal and external stakeholders and can change your style of communication to suit technical and non-technical audiences Data with Power. You'll join our Integrated Risk and Intelligence Service (IRIS) team which is a collaboration between DWP Digital, Counter Fraud, Compliance and Debt and Cyber Resilience Centre. Our agile IRIS team is central to DWP's Fraud and Error Strategy and is radically transforming how we detect and prevent fraud and error in the welfare system. You'll play a vital role in delivering innovative and insightful data products, and work across the data engineering lifecycle. Integrating a variety of source data, you'll use your judgement to figure out the best approach, so that appropriate data quality, integrity and alerting is built into all our solutions. You will conduct proof of concept and discovery work and evaluating proposed changes that might impact data performance, models or reports. You'll also have chance to pass on your skills. You'll coach and mentor more junior colleagues, helping to build data engineering knowledge and capability within the team. Working closely with stakeholders to develop and maintain robust data products and services, our team support the continuous improvement of data engineering standards and engage with stakeholders at all stages of the data engineering lifecycle. Your main responsibilities will include: Reviewing and transforming business requirements into reusable, production-ready code Integrating a variety of source data, using judgement and guidance to determine the appropriate approach Conducting proof of concept and discovery work to provide information and advice Playing an active role in code development activities for delivery of data transformation products Developing automated data ingest routines, workflows and mappings for structured and unstructured data Completing design specifications and technical documentation Details. Wages. Perks. Location: You'll join us based at one of our brilliant digital hubs in either Birmingham, Blackpool, Leeds, London, Manchester, Newcastle or Sheffield Hybrid working: We operate a hybrid working model with a mix of home working and some time in the office. Pay : In return for your skills, we offer pay up to £58,347. This is comprised of salary up to £43,347 (£47,986 in London) and a Digital Allowance of up to £15,000 per annum available for exceptional candidates. Pension: You'll be eligible for a brilliant civil service pension with employer contributions worth 28.97% (worth up to £12,557 a year). Holidays: You'll get a generous leave package starting at 26 days, plus all the usual bank holidays, and the option to take extra days off on flexi leave. We also have a broad benefits package built around your work-life balance which includes: Flexible working, flexi hours and flexi days Hybrid working: some time in a hub with the team, some time at home Family-friendly policies Time off volunteering and charitable giving Bring your authentic self to work with 'I Can Be Me in DWP' Discounts and savings on shopping, fun days out and more Interest-free loans to buy a bike or a season ticket Sports and social activities Working in an award-winning environment and culture Professional development, coaching, mentoring and career progression opportunities Click 'Apply' for more information and to start an application on Civil Service Jobs. Please note, this role requires you to pass Security Check clearance
Job Vacancy
Data Engineer
DWP. Digital with Purpose. Do you want to utilise best-in-class technologies to deliver data products? Are you looking for ongoing professional development while designing and building modern cloud-based data products? DWP is the UK's largest government department. We help people into work and make payments worth over £195bn a year to support some of the most vulnerable people in our society. We're carrying out a once-in-a-generation digital transformation of DWP product and services, used by millions of people. If you are looking to develop your skills, work on some of the most challenging and rewarding IT projects, shape solutions and contribute to new thinking, all with a great work life balance, we would love to hear from you. Required skills and experience: Enterprise-level experience of SQL, Shell/BASH, Linux and command line Enterprise-level experience in developing and enhancing efficient, scalable, automated ETL/ELT pipelines including error handling, re-start and data quality Experience of translating technical concepts into non-technical language You understand how to communicate with internal and external stakeholders and can change your style of communication to suit technical and non-technical audiences Data with Power. You'll join our Integrated Risk and Intelligence Service (IRIS) team which is a collaboration between DWP Digital, Counter Fraud, Compliance and Debt and Cyber Resilience Centre. Our agile IRIS team is central to DWP's Fraud and Error Strategy and is radically transforming how we detect and prevent fraud and error in the welfare system. You'll play a vital role in delivering innovative and insightful data products, and work across the data engineering lifecycle. Integrating a variety of source data, you'll use your judgement to figure out the best approach, so that appropriate data quality, integrity and alerting is built into all our solutions. You will conduct proof of concept and discovery work and evaluating proposed changes that might impact data performance, models or reports. You'll also have chance to pass on your skills. You'll coach and mentor more junior colleagues, helping to build data engineering knowledge and capability within the team. Working closely with stakeholders to develop and maintain robust data products and services, our team support the continuous improvement of data engineering standards and engage with stakeholders at all stages of the data engineering lifecycle. Your main responsibilities will include: Reviewing and transforming business requirements into reusable, production-ready code Integrating a variety of source data, using judgement and guidance to determine the appropriate approach Conducting proof of concept and discovery work to provide information and advice Playing an active role in code development activities for delivery of data transformation products Developing automated data ingest routines, workflows and mappings for structured and unstructured data Completing design specifications and technical documentation Details. Wages. Perks. Location: You'll join us based at one of our brilliant digital hubs in either Birmingham, Blackpool, Leeds, London, Manchester, Newcastle or Sheffield Hybrid working: We operate a hybrid working model with a mix of home working and some time in the office. Pay : In return for your skills, we offer pay up to £58,347. This is comprised of salary up to £43,347 (£47,986 in London) and a Digital Allowance of up to £15,000 per annum available for exceptional candidates. Pension: You'll be eligible for a brilliant civil service pension with employer contributions worth 28.97% (worth up to £12,557 a year). Holidays: You'll get a generous leave package starting at 26 days, plus all the usual bank holidays, and the option to take extra days off on flexi leave. We also have a broad benefits package built around your work-life balance which includes: Flexible working, flexi hours and flexi days Hybrid working: some time in a hub with the team, some time at home Family-friendly policies Time off volunteering and charitable giving Bring your authentic self to work with 'I Can Be Me in DWP' Discounts and savings on shopping, fun days out and more Interest-free loans to buy a bike or a season ticket Sports and social activities Working in an award-winning environment and culture Professional development, coaching, mentoring and career progression opportunities Click 'Apply' for more information and to start an application on Civil Service Jobs. Please note, this role requires you to pass Security Check clearance
Freelance job
Senior Data Engineer
AWS Data Engineer - £600 - £700pd - 6 Months - London (Hybrid/Remote) - Financial Services Overview: A market leading organization operating within the payments/ financial services space are looking for three Data Engineers to help them build and implement a data platform over the next 12 months. These roles are hybrid/ remote and the client is based in London. Technical Requirements: Strong experience operating as a Senior Data Engineer for a number of years. Strong experience with the AWS platform and related Data Engineering toolset. Experience working with WebFOCUS. Previous experience working with Tableau. Kafka and Data Bricks experience is a must. Ideally professional experience working with Snowflake. Rate & Duration: £600 - £700pd 6 Months London (Hybrid/Remote) AWS Data Engineer - £600 - £700pd - 6 Months - London (Hybrid/Remote) - Financial Services
Freelance job
Lead Data Engineer
Overview Fixed Term Contract - 24-month The Lead Data Engineer will lead agile data engineering activities as a technical leader, delivering data and insights products to the rail industry. You will understand the business and IT strategy to align technical solutions with outcomes, develop APIs and integrations to transfer data between systems and deliver aggregated data solutions. You will develop both quick prototypes and high-quality products, judging which is needed. The role will also coach data engineers and undertake code reviews to ensure the team can continue to deliver sustainable solutions. Responsibilities Lead ambiguous and complex data engineering projects as a technical leader. Design, code, test, and document data applications, applying software engineering best practices. Initiate the development and management of scalable APIs, machine learning endpoints, data integration pipelines and data storage solutions. Influence the information strategy and platform architecture to align technical solutions with outcomes. Influence new Data Engineering tools, frameworks, standards, and processes to improve the productivity and quality of outputs for Data Engineers across the team. Ensure that agreed standards and tools are applied to achieve well-engineered outcomes, and that own work and that of colleagues meets coding standards, through code review processes. Ensure technical solutions support the accessibility, retrievability, security, quality, retention, and ethical handling of specific sets of data. Qualifications Essential : BSc in a scientific or computer science discipline. Experience of strategies and design approaches for APIs and data pipelines. Experience designing and implementing data-driven tools and solutions. Experience developing scalable data pipelines in Spark/Python using orchestrators such as Airflow. Experience using SQL, Python, and other scripting/programming to solve a wide array of data challenges. Experience working with a diverse range of data infrastructure and systems, such as PostgreSQL; SQL Server; Azure data lakes; Data Bricks; Kubernetes. Communicate effectively and share thoughts and ideas through methods appropriate to the audience. Adapt and respond effectively when embracing new opportunities, change and in navigating uncertainty. Actively contribute as part of a team and work towards achieving team goals and outcomes. Take responsibility and demonstrate accountability in completing tasks and achieving objectives , actively seeking to resolve problems and identify opportunities. Committed to customer service and placing customer satisfaction at the heart of our success to ensure we deliver against our shared goals. Can work collaboratively within an evolving industry, gaining stakeholder confidence through understanding their goals and motivations and demonstrating credibility as an expert. Make timely , informed decisions taking account of the benefits and constraints involved . Desirable: Experience developing scalable APIs in Python using frameworks such as Fast API or Flask. We are committed to investing in our staff and offer formal and informal learning opportunities for development . We value diversity and equal opportunities in employment and are committed to creating a workplace which is inclusive to everyone. As a member of the Disability Confident Scheme , we encourage candidates with disabilities who meet the minimum criteria, to apply for our jobs. If you have applied under the Disability Confident Scheme, please let us know in advance by emailing Find out more about Diversity and Inclusion at RSSB: Rail Safety and Standards Board Careers - VERCIDA If you require any reasonable adjustments with respect to our selection process including information in an alternative format, please contact us at We understand the importance of work-life balance and we offer our staff the flexibility to work within our core hours and the option to vary their location between both the office and home. If you are looking for further flexibility, speak to us at interview stage so that we can consider your request. We value our staff and we offer a competitive benefits package to ensure our staff can achieve their best throughout their journey with us. This includes 30 days annual leave (plus bank holidays); a holiday buy and sell scheme; private medical and dental cover; a season ticket loan and travel subsidy; access to a cycle to work scheme; volunteer leave; a performance related bonus and pension.
Job Vacancy
Lead Data Engineer / Manager Python SQL AWS
Lead Data Engineer / Manager (Python SQL AWS) London / WFH to £100k Are you a Data technologist with leadership skills who enjoys collaborating and working on complex systems with cutting edge technology? You could be joining a hugely profitable Hedge Fund that invest in sports betting markets and progressing your career in a senior, hands-on role where you'll lead and collaborate to solve problems and influence technology choices and best practice in partnership with the Head of Data. As a Lead Data Engineer / Manager you'll remain hands-on whilst managing a team of four junior to mid-level Data Engineers with oversight of the design, implementation and maintenance of scalable data pipelines. You'll plan, prioritise and manage multiple data engineering projects, collaborating closely with the Data Analytics team and business stakeholders to understand data requirements and deliver high quality, scalable data pipelines and ETL processes within an AWS environment. Location / WFH: You'll be based in fantastic offices in a vibrant area of London with in-house gym and steam room, games room with pool tables and dart boards, library and free high quality catering (breakfast, lunch, dinner) from the onsite chef with flexibility to work from home two days a week. About you: You're a technologist Data Engineer with experience of leading the design and development of large-scale data processing applications and infrastructure You have expertise with designing scalable end-to-end data engineering process You have advanced Analytics skills and a track record of providing strategic insights You have advanced technical skills with Python and SQL You have experience with AWS, Docker, RedShift, Kafka, S3 You have experience of coaching and mentoring more junior Data Engineers What's in it for you : As a Lead Data Engineer / Manager (Python SQL AWS) you will earn a competitive package: Salary to £100k Pension and Life Assurance Private medical care and wellness days Training and conference budget to support your personal development Social events Volunteering / charity day Apply now to find out more about this Lead Data Engineer / Manager (Python SQL AWS) opportunity. At Client Server we believe in a diverse workplace that allows people to play to their strengths and continually learn. We're an equal opportunities employer whose people come from all walks of life and will never discriminate based on race, colour, religion, sex, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. The clients we work with share our values.
Job Vacancy
Data Engineer
Overview:A leading UK bank is seeking a skilled Data Engineer to support the Product Lifecycle Catalogue (hardware and software) underpinning IT Asset Management (ITAM) in ServiceNow. This role is driven by regulatory requirements and involves close collaboration with the Solution Architect and Data Analytics teams. The Data Engineer will be responsible for building and maintaining data systems that ensure data accuracy, accessibility, and security.Key Responsibilities:* Data System Development: Design, build, and maintain robust data systems, including data pipelines, data warehouses, and data lakes, to efficiently collect, store, process, and analyze large volumes of data.* Data Governance: Implement and enforce data governance practices, ensuring data integrity, compliance with regulatory standards, and adherence to the bank's data policies.* Collaboration: Work closely with the Solution Architect and Data Analytics teams to align data engineering efforts with broader IT and business objectives.* Machine Learning & Data Mining: Apply machine learning techniques and data mining processes to enhance data processing capabilities and extract valuable insights.* Secure Coding Practices: Ensure that all data systems are developed with secure coding practices to protect sensitive information and comply with security protocols.* Change & Transformation: Support change and transformation initiatives by developing scalable and adaptable data solutions that can evolve with the bank's needs.* Database Management: Design and manage database structures that support efficient data storage, retrieval, and analysis.* Strategic Thinking: Contribute to the development of data strategies that align with the bank's long-term goals and digital transformation efforts.* Risk & Controls: Identify potential risks in data processes and implement controls to mitigate these risks, ensuring compliance with internal and external regulations.* Professional Collaboration: Engage with cross-functional teams to ensure that data solutions are fully integrated and support business processes effectively.Mandatory Requirements:* DevOps: Experience with DevOps practices to support continuous integration and deployment of data systems.* Data Governance: Strong knowledge of data governance frameworks and their application in a financial environment.* Requirements Analysis: Ability to conduct detailed requirements analysis to inform data system design and development.* Machine Learning: Proficiency in applying machine learning techniques to data processing and analysis.* Data Mining: Experience with data mining techniques to extract valuable insights from large datasets.* Strategic Thinking: Ability to align data engineering efforts with the bank's strategic objectives.* Data Warehousing (DW): Expertise in designing and managing data warehouses that support large-scale data analysis.* Change & Transformation: Experience in supporting change initiatives through the development of flexible and scalable data solutions.* Database Structures: Strong skills in designing and managing database structures that ensure efficient data storage and retrieval.* Secure Coding Practices: Proficiency in secure coding practices to protect sensitive data.* Risk & Controls: Knowledge of risk management and control measures specific to data systems in a financial context.* Data Engineering: Proven experience in data engineering, with a focus on building and maintaining data systems in a complex, regulated environment.This role is critical for ensuring that the bank's data systems are robust, secure, and aligned with regulatory requirements, supporting the bank's strategic goals and digital LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.
Submit your CV
-
Manage your visibility
Salary, remote work... Define all the criteria that are important to you.
-
Get discovered
Recruiters come directly to look for their future hires in our CV library.
-
Join a community
Connect with like-minded tech and IT professionals on a daily basis through our forum.