Find your next tech and IT Job or contract role.

The Senior Data Engineer role will plan and drive forward the design and implementation of data pipelines, data stores, and APIs to acquire and prepare data for downstream applications, such as analytics, data insights, and data-driven tools. You will be a hands-on data engineer, who will contribute to the wider teams' outputs by ensuring data standards and architectures are applied, and by coaching colleagues on approaches to problem-solving and quality of deliverables. Additionally, you will be responsible for integrating data with various applications to ensure seamless data flow and accessibility. The data domain will cover RSSB, rail industry, and national data sources in the areas of health, safety, quality, operational performance, and sustainability. It will also cover internal business datasets, ensuring that data is effectively integrated with applications to support business processes and decision-making. Responsibilities Ensure data made available for downstream applications is reliable, accessible, and in the appropriate format through active engagement with Product Management and key stakeholders. Plan and drive forward the development of data solutions, ensuring a balance between functional and non-functional requirements. Advise on best approaches to solving novel data problems, leveraging Python-based solutions. Ensure that data standards and architectures are applied to achieve well-engineered outcomes, and that solutions are reliable and perform optimally. Conduct complex data quality checks and monitoring, applying necessary remediation to maintain data integrity. Undertake necessary maintenance and optimisation activities to ensure the performance and reliability of data pipelines, APIs, and applications. Develop both quick prototypes and high-quality products, judging which approach is needed based on the context. Design, code, test, and document complex data engineering scripts and applications, applying software engineering best practices with a focus on SQL and Python. Collaborate effectively with cross-functional teams, including Product Management and key stakeholders, to understand business requirements and translate them into technical solutions. Communicate technical concepts and solutions effectively to both technical and non-technical audiences. Mentor and coach colleagues on approaches to problem-solving and quality of deliverables, fostering a collaborative and innovative team environment. Qualifications / Experience Essential BSc in a scientific, computer science, or related discipline. Extensive experience with data analysis, data modelling, and quality assurance techniques. Proficiency in using SQL and Python to solve a wide array of data challenges. Experience developing data pipelines in Python using orchestrators such as Airflow. Experience making data available in data science and data visualization tools such as Databricks and Power BI/Fabric. Experience with data extraction from a variety of systems, including familiarity with web-oriented architecture. Ability to analyse and document technical solutions effectively. Communicate effectively and share thoughts and ideas through methods appropriate to the audience. Adapt and respond effectively when embracing new opportunities, change and in navigating uncertainty. Actively contribute as part of a team and work towards achieving team goals and outcomes. Take responsibility and demonstrate accountability in completing tasks and achieving objectives, actively seeking to resolve problems and identify opportunities. Committed to customer service and placing customer satisfaction at the heart of our success to ensure we deliver against our shared goals. Can work collaboratively within an evolving industry, gaining stakeholder confidence through understanding their goals and motivations and demonstrating credibility as an expert. Make timely, informed decisions taking account of the benefits and constraints involved. Desirable Experience developing and deploying APIs in Python using frameworks such as FastAPI. Familiarity with cloud platforms such as AWS, Azure, or GCP. Knowledge of containerization and orchestration tools like Docker and Kubernetes. Experience with version control systems such as Git. Understanding of Agile methodologies and experience working in Agile teams. We are committed to investing in our staff and offer formal and informal learning opportunities for development . We value diversity and equal opportunities in employment and are committed to creating a workplace which is inclusive to everyone. As a member of the Disability Confident Scheme , we encourage candidates with disabilities who meet the minimum criteria, to apply for our jobs. If you have applied under the Disability Confident Scheme, please let us know in advance by emailing Find out more about Diversity and Inclusion at RSSB: If you require any reasonable adjustments with respect to our selection process including information in an alternative format, please contact us at We understand the importance of work-life balance and we offer our staff the flexibility to work within our core hours and the option to vary their location between both the office and home. If you are looking for further flexibility, speak to us at interview stage so that we can consider your request. We value our staff and we offer a competitive benefits package to ensure our staff can achieve their best throughout their journey with us. This includes 30 days annual leave (plus bank holidays); a holiday buy and sell scheme; private medical and dental cover; a season ticket loan and travel subsidy; access to a cycle to work scheme; volunteer leave; a performance related bonus and pension.

Location(s): London or Manchester BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments. Job Title: Data Engineer Requistion ID: 120494 Location: London or Manchester - Hybrid working offered, with consideration for both full and part-time applicants - please speak to your recruiter about options Grade: GG08 - GG13 We are looking for experienced Data Engineers to join our team following continuous growth and success. As a Data Engineer you will be involved in: Design, develop, test and support data collection, data integration and ETL applications to make information and data available to key client stakeholders and technical interfaces Model data requirements, data sources and data flows to bring order and structure to programmes of work Defining how and where data is created, mastered and destroyed to ensure proper control over the lifecycle of corporate data assets Using categories of products that can be used to collect, integrate, store, visualise and govern data and metadata Define metadata to provide search ability and governance (including Records Management) for unstructured data. Not only will your team be directly making a huge impact upon the systems you work on, you'll be doing it for an organisation who makes a huge impact to the security of the UK. About you You will have experience in many of the following: Data Engineering, Analysis or Science, with a solid understanding of programming languages along with experience of applying them in your previous role Experience in using Data Engineering tools and technology ETL tools including Python and a number of the Big Data Applications. Rather than specifying a list of technologies we look for, demonstrable ability in what you have used previously, along with adaptability and willingness to learn is what we value A good understanding of Open Source software for Data Engineering and can evaluate these platforms against products. Given a customer problem you can analyse and evaluate options and recommend solutions. An understanding of maintaining and applies up to date, specialist knowledge of database concepts (including unstructured, NoSQL and "big data" platforms), object and data modelling techniques. Previous experience working in the domain of Cyber Security and Intelligence is desirable, but not essential. Applicants will need to be eligible to work in the UK and hold an active eDV UK security clearance. How we will support you Work-life balance is important; you can work around core hours with flexible and part-time working, and many of our roles include hybrid working enabling a mix of working from home and in the office Youll get 25 days holiday a year and the option to buy/sell and carry over from the year before Our flexible benefits package includes private medical and dental insurance, a competitive pension scheme, cycle to work scheme, taste cards and more Youll have a dedicated Career Manager to help you develop your career and guide you on your journey through BAE Youll be part of our company bonus scheme You are welcome to join any/all of our Diversity and Support groups. These groups cover everything from gender diversity to mental health and wellbeing. About our team Our people are what differentiates us, they are resourceful, innovative and dedicated. We have a mix of generalists and specialists and recognise that this diversity contributes to our success. We recognise the benefits of forming teams from a mix of disciplines, which allows us to come up with cutting edge, high quality solutions. Our breadth of work across the Public Sector provides diverse opportunities for our people to develop their careers in new areas of expertise and with new clients. You'll be part of a big company, but we try to create a culture that feels like a small one. The work will stretch you and be challenging, but we encourage a healthy work-life balance. Most of all, we know teams who work well together also perform well. We'll do everything we can to ensure you have fun at work, and in social activities outside of it whether that's virtually or in person, as conditions allow. We have a rich history of working within National Security. In fact, we have over 40 years' experience of delivering advice and solutions to our customers in this sector, supporting them in carrying out their vital missions. Life at BAE Systems Digital Intelligence We are embracing Hybrid Working. This means you and your colleagues may be working in different locations, such as from home, another BAE Systems office or client site, some or all of the time, and work might be going on at different times of the day. By embracing technology, we can interact, collaborate and create together, even when we're working remotely from one another. Hybrid Working allows for increased flexibility in when and where we work, helping us to balance our work and personal life more effectively, and enhance well-being. Diversity and inclusion are integral to the success of BAE Systems Digital Intelligence. We are proud to have an organisational culture where employees with varying perspectives, skills, life experiences and backgrounds - the best and brightest minds - can work together to achieve excellence and realise individual and organisational potential. Division overview: Capabilities At BAE Systems Digital Intelligence, we pride ourselves in being a leader in the cyber defence industry, and Capabilities is the engine that keeps the business moving forward. It is the largest area of Digital Intelligence, containing our Engineering, Consulting and Project Management teams that design and implement the defence solutions and digital transformation projects that make us a globally recognised brand in both the public and private sector. As a member of the Capabilities team, you will be creating and managing the solutions that earn us our place in an ever changing digital world. We all have a role to play in defending our clients, and this is yours.

Location(s): UK, Europe & Africa : UK : Leeds BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments. Job Title: Data Engineer Location: Leeds - We offer a range of hybrid and flexible working arrangements - please speak to your recruiter about the options for this particular role. Grade: GG09-GG10 Referral Bonus: £5000 What You'll Be Doing: CPS engaged Mobilise to embark upon a discovery/proof-of-concept for business intelligence/data warehouse over 4 years. This period was interspersed with multiple breaks whilst CPS re-prioritised and determined next steps. Mobilise helped CPS gain a better understanding of the technology options suitable for the CPS's desired technology roadmap/ecosystem by putting in place a proof-of-concept which showcased an end-to-end capability and vision of 'what' and 'how' CPS's vision could be realised. Working together and using an agile delivery methodology CPS gained a richer and deeper understanding of its own organisations data and learnt more about the Microsoft technology stack allowing them to improve their internal reporting and their understanding of their business. CPS now wish to transform a PoC solution into a fully productionised and supported system. This is anticipated to be achieved using one or more agile teams in a phased approach to deliver key technology deliverables on their enhancement journey. Skills & Experience: Azure Data Factory (ADF) Create dimensions incrementally, reducing processing and data needs with a hopeful reduction in the incurred costs for compute, data and network processing. Changing the authentication method between ADF and SQL Server to use either a managed identity or service principal to enhance security and manageability. Establishing parallelism within existing and new ADF pipeline activities. Template elements of an existing pipeline to support the ingestion of new datasets through the platform Azure SQL Integrating Database Access with Microsoft Entra ID for enhanced security. Implementing STAR schemas on Data Models. Establishing naming conventions for database objects. Transitioning data processing from Power BI to Azure SQL. Segregating data serve level data into multiple schemas or views. Data segregation and redaction techniques, such as data masking and data pseudonymisation. Benefits: As well as a competitive pension scheme, BAE Systems also offer employee share plan, an extensive range of flexible discounted health, wellbeing and lifestyle benefits including including a green care scheme, private health plans and shopping discounts - you may also be eligible for an annual incentive. Why BAE Systems? This is a place where you'll be able to make a real difference. You'll be part of an inclusive culture which values diversity, rewards integrity and merit, and where you'll be empowered to fulfil your potential. We welcome candidates from all backgrounds and particularly from sections of the community who are currently under-represented within our industry including women, ethnic minorities, people with disabilities and LGBTQ+ individuals. We also want to make sure that our recruitment processes are as inclusive as possible. If you have a disability or health condition (for example dyslexia, autism, an anxiety disorder etc.) that may affect your performance in certain assessment types, please speak to your recruiter about potential reasonable adjustments. Please be aware that many roles at BAE Systems are subject to both security and export control restrictions. These restrictions such as your nationality, any nationalities which you previously may have held and your place of birth can restrict the roles you are able to perform within the organisation. All applicants must as a minimum achieve Baseline Personnel Security Standard. Many roles also require higher levels of National Security Vetting where applicants must typically have 5 to 10 years of continuous residency in the UK depending on the vetting level required for the role, to allow for meaningful security vetting checks. Life at BAE Systems Digital Intelligence We are embracing Hybrid Working. This means you and your colleagues may be working in different locations, such as from home, another BAE Systems office or client site, some or all of the time, and work might be going on at different times of the day. By embracing technology, we can interact, collaborate and create together, even when we're working remotely from one another. Hybrid Working allows for increased flexibility in when and where we work, helping us to balance our work and personal life more effectively, and enhance well-being. Diversity and inclusion are integral to the success of BAE Systems Digital Intelligence. We are proud to have an organisational culture where employees with varying perspectives, skills, life experiences and backgrounds - the best and brightest minds - can work together to achieve excellence and realise individual and organisational potential.

Lead Data Engineer Remote UK £75,000 - £90,000 + Progression + Pension An excellent opportunity awaits an experienced Data Engineer/Architect looking for a hands-on lead role where you will take ownership of and lead the data solutions, with progression, autonomy, and great growth potential This company is an established business focused on operational and management solutions, specialising in monitoring services. In this role, you will join the existing data team and lead the design, build, and delivery of the company's data solutions. You will take ownership of the data architecture, including modelling and warehousing, and work closely with senior stakeholders to define data strategy, governance, and structure. This is a remote position based in the UK. The ideal candidate will have extensive experience working in the Azure Data stack, with Azure Data Factory and Azure Synapse, designing and implementing ETL/ELT pipelines, data modelling, and building scalable data architecture. The right candidate for this role will have a strong understanding of the operational and commercial implications of data-driven decision-making and will play a key role in driving this within the business. This is a fantastic opportunity for an experienced Data Engineer/Architect looking to play a leading role in an exciting position offering great growth, autonomy, and progression opportunities. The Role: *Hands on Lead focusing on Data Architecture, Build and Delivery *Define Data Strategy, Governance and Structure *Lead the development and maintenance of data models and warehousing *Remote based role in the UK The Person: *Strong experience in Data Architecture, Engineering, and Warehousing within the Azure Stack *Hands-on experience with Azure Data Factory, Azure Synapse, and data pipelines *Ability to make data-driven decisions based on commercial and operational implications *Based in the UK Reference Number: BBBH 250656 To apply for this role or for to be considered for further roles, please click \"Apply Now\" or contact Marcel Cerek at Rise Technical Recruitment. Rise Technical Recruitment Ltd acts as an employment agency for permanent roles and an employment business for temporary roles. The salary advertised is the bracket available for this position. The actual salary paid will be dependent on your level of experience, qualifications and skill set. We are an equal opportunities employer and welcome applications from all suitable candidates.

Lead Data Engineer Remote UK £75,000 - £90,000 + Progression + Pension An excellent opportunity awaits an experienced Data Engineer/Architect looking for a hands-on lead role where you will take ownership of and lead the data solutions, with progression, autonomy, and great growth potential This company is an established business focused on operational and management solutions, specialising in monitoring services. In this role, you will join the existing data team and lead the design, build, and delivery of the company's data solutions. You will take ownership of the data architecture, including modelling and warehousing, and work closely with senior stakeholders to define data strategy, governance, and structure. This is a remote position based in the UK. The ideal candidate will have extensive experience working in the Azure Data stack, with Azure Data Factory and Azure Synapse, designing and implementing ETL/ELT pipelines, data modelling, and building scalable data architecture. The right candidate for this role will have a strong understanding of the operational and commercial implications of data-driven decision-making and will play a key role in driving this within the business. This is a fantastic opportunity for an experienced Data Engineer/Architect looking to play a leading role in an exciting position offering great growth, autonomy, and progression opportunities. The Role: *Hands on Lead focusing on Data Architecture, Build and Delivery *Define Data Strategy, Governance and Structure *Lead the development and maintenance of data models and warehousing *Remote based role in the UK The Person: *Strong experience in Data Architecture, Engineering, and Warehousing within the Azure Stack *Hands-on experience with Azure Data Factory, Azure Synapse, and data pipelines *Ability to make data-driven decisions based on commercial and operational implications *Based in the UK Reference Number: BBBH 250656 To apply for this role or for to be considered for further roles, please click \"Apply Now\" or contact Marcel Cerek at Rise Technical Recruitment. Rise Technical Recruitment Ltd acts as an employment agency for permanent roles and an employment business for temporary roles. The salary advertised is the bracket available for this position. The actual salary paid will be dependent on your level of experience, qualifications and skill set. We are an equal opportunities employer and welcome applications from all suitable candidates.

Who we are 🩵 We're the people behind the global loyalty currency, Avios, and home to three ambitious, growing businesses; IAG Loyalty, BA Holidays and The Wine Flyer . Each business has its own goals and strategy, but collectively we create brilliant experiences for our global customers. We're on a truly exciting journey of growth and transformation - we're going places! This is where you come in. The Opportunity We're looking for a Data Engineer to join the Core Data team within the Redemption function at IAG Loyalty. At IAG Loyalty, data is central to everything we do-driving decisions, innovation, and impact across the business. In this role, you'll join a product squad focused on building data solutions that power the Redemption space-how customers turn Avios points into meaningful rewards. Whether it's understanding booking behavior or improving the reward experience, your work will have a direct impact on our products and decision-making. We've made great progress migrating from legacy systems to a modern data stack, and you'll help us continue that journey-building new platforms and evolving the tools we've already delivered. Though we're a large business by revenue, our data team operates like a fast-moving scale-up. We're looking for someone who's curious, adaptable, and ready to challenge the status quo. If you're excited to make a real impact, we'd love to hear from you. What you'll get up to 🌠 You'll work across the full data lifecycle-from analysis and design to development, testing, and ongoing support of our data products. You'll play a key role in enhancing our existing platforms and infrastructure, contributing to inner-source projects that help standardise and scale data capabilities across IAG Loyalty. You'll also build applications that unlock new ways to activate and leverage our data. Working within a small, focused team using Kanban principles, you'll deliver impactful, iterative data products, while also creating clear documentation and training materials to support end users and drive adoption of new solutions. What we need from you 💡 Strong SQL development skills experience with Snowflake is a big plus, and bonus points if youve worked with dbt or SQLMesh. A track record of designing and delivering complex, high impact data solutions. Solid understanding of ELT processes and the technologies that enable them. Comfortable working with cloud infrastructure, particularly AWS. Experience using Infrastructure as Code at scale; we use Terraform to manage and standardise our environments. Proficiency in at least one data focused programming language ideally Python (our primary language), or Go for performance critical tasks. Excellent communication and collaboration skills, with the ability to work effectively across both technical and non technical teams. A proactive, improvement driven mindset always looking for smarter, better ways to work. Strong attention to detail and a deep commitment to quality in everything you deliver. The role has a blended base, between our Central London office and home. We trust you to make the right decision about the type of work that is best done in each location. We expect you'll achieve a 50/50 split between the two and there may be times where you'll want to visit our other locations to tell their stories, too (fully reimbursed). We might not be right for you if: You prefer to stick strictly to your own tasks were a small, high performing team, and collaboration is key to our success You prioritise perfection over progress we move fast, learn as we go, and value iteration over polish You want to create but not build this is an end to end role, and youll own your work from initial idea through to delivery and iteration If you think you have what it takes but don't meet every single point above, please do still apply. We'd love to chat and see if you could be a great fit. Equity, Diversity and Inclusion at IAG Loyalty Our vision, 'to create the world's most rewarding experiences,' applies not only to our customers but for our colleagues too. It's about taking belonging seriously, actively fostering a culture where everyone feels welcomed and valued by embracing diverse identities, personal histories, and perspectives. This commitment makes IAG Loyalty a rewarding place to work and enhances our ability to solve complex problems, drive innovation, and better serve our customers and communities. Please let us know if we can make any reasonable adjustments to support your interview process with us.

It is a 12 month contract 3 days on site per week The role is based around Tipperary county with the following requirements - • AI experience (Up to date on lates trends and Technologies) • Experience in data analytics • User Interface Creation • Mapping for Alerts Commonality • Task Digitalisation /Automation • An understanding of Manufacturing processes is important (MES data BMRAM Data SAP Data Machine Data etc) • Use of Historian Databases • SAS Modules • Graph Database Technology (NEO4J) • Python Programming • Qlik Sense SAS Programming • Machine Learning (Regression analysis) If interested please could you apply with your most up to date CV. Please click here to find out more about our Key Information Documents. Please note that the documents provided contain generic information. If we are successful in finding you an assignment, you will receive a Key Information Document which will be specific to the vendor set-up you have chosen and your placement. To find out more about Computer Futures please visit XX XX XX XX XX Computer Futures, a trading division of SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 8 Bishopsgate, London, EC2N 4BQ, United Kingdom | Partnership Number | OC387148 England and Wales

Senior Data Engineer Hybrid working (3 days per week onsite in London) 6 Month contract initially, good scope for extension Market rates (Umbrella-PAYE) One of our blue chip clients are looking for a number Senior Data Engineer to join the team on a long term programme of work. Key Responsibilities: • ETL Pipeline Development: Develop, optimize, and maintain ETL pipelines to efficiently extract, transform, and load data from various sources, ensuring high data quality. • Monitor and troubleshoot production data pipelines, ensuring their performance and reliability. • Mentor junior engineers and lead technical discussions to drive best practices and innovation within the team. • Stay up to date with the latest trends and technologies in data engineering and recommend solutions to improve data processing capabilities. • Query Optimization & Data Transformation: Write and optimize SQL queries, ensuring data integrity, performance, and scalability, using best practices and techniques • Data vault Model implementation: Implement flexible Data vault model in Snowflake to support large • scale analytics and business intelligence. • Cross • Team Collaboration: Collaborate with Data Engineers, Product Managers, and Data Scientists to deliver solutions that support data • driven insights and innovation. • Stakeholder Engagement: Engage with business stakeholders to understand requirements and translate them into technical solutions that add value. • Data Quality & Governance: Implement and enforce data governance and quality processes, ensuring accurate and consistent data flows across all systems. • Cloud & Infrastructure Support: Work with cloud platforms such as AWS/Azure and DBT with Snowflake to build and maintain scalable data solutions. • Continuous Improvement: Proactively look for ways to improve data systems, processes, and tools, ensuring efficiency and scalability. Key Skills / Experience: • ETL/ELT & Data Pipelines: Solid understanding of ETL/ELT processes, along with hands • on experience building and maintaining data pipelines using DBT, Snowflake, Python, SQL, Terraform and Airflow • Experience in designing and implementing data products and solutions on cloud • based architectures. • Cloud Platforms: Experience working with cloud data warehouses and analytics platforms, such as Snowflake, and AWS/Azure • GitHub Skills and Experience: Proficiency in using GitHub for version control, code collaboration and managing data engineering projects • Data Governance and Compliance: Expertise in implementing data governance frameworks in Alation, including data quality management and compliance with industry regulations. • Effective Communication and Collaboration: Excellent communication skills for interacting with stakeholders, presenting technical concepts, and collaborating with cross • functional teams. • Collaboration & Communication: Strong interpersonal skills with the ability to work cross • functionally with stakeholders, engineers, and analysts. • SQL Proficiency: Expertise in writing complex SQL queries, query optimization, and database design for analytics. • Problem • Solving & Analytical Thinking: Ability to think critically and solve complex problems, translating business requirements into actionable insights. Desirable skills/knowledge/experience: • Knowledge of Data Visualization Tools: Experience with tools such as MicroStrategy / Power BI • Terraform: Experience with Terraform and Terragrunt for infrastructure as code • GenAI: Experience with Generative AI technologies This is a great opportunity on a long running programme of work. Apply now for your CV to reach me directly and we will reply as soon as possible. LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds. Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.

REQUIRED: DATA ENGINEER - SC CLEARED LOCATION: FULLY REMOTE WITH OCCASIONAL TRAVEL TO CENTRAL LONDON IR35 STATUS: INSIDE DURATION: 6 MONTH INITIAL CONTRACT Seeking a Data Engineer who has a strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc • Strong understanding of complex JSON manipulation • Experience working with Data Pipelines using a custom Python/PySpark frameworks • Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. • Strong understanding of Data Security principles • data owners, access controls • row and column level, GDPR etc including experience of handling sensitive datasets • Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction to resolve) • Experience working in a support role would be beneficial, particularly able to demonstrate incident triage and handling skills/knowledge (SLAs etc) • Fundamental linux system administration knowledge • ssh keys and config etc, Bash CLI and scripting, Environment variables • Experience using browser based IDEs (Jupyter Notebooks, RStudio etc) • Experience working in a dynamic Agile environment (SAFE, scrum, sprints, JIRA etc) Languages / Frameworks • JSON • YAML • Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.) • SQL • PySpark • Delta Lake • Bash (both CLI usage and scripting) • Git • Markdown • Scala (bonus, not compulsory) • Azure SQL Server as a HIVE Metastore (bonus) Technologies • Azure Databricks • Apache Spark • Delta Tables • Data processing with Python • PowerBI (Integration / Data Ingestion) • JIRA Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks. LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds. Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.

Job Description Database Engineer with SQL Server and SSIS Our Client is a bank based in Central London who are looking to recruit a Database Engineer with the ability to work with SSIS. You must have solid expertise of at least 5 years experience of working with MS SQL Server and SSIS - SSIS is very important for this position. Responsible for the development and delivery of new systems to automate and streamline processes required by different departments. To support the internal IT department with changes and upgrades to software platforms. To be primary contact for all technical questions relating to in-house bespoke systems and interfacing. Database Support Supporting budgeting and financial planning processes for Finance department, including loading and refreshing of data based on requirements. Understand and conduct the front-end functionality to amend and change hierarchical structures within the environment. Debug and analyse errors and anomalies within Hyperion system as raised by Finance and to pinpoint areas of failure and correct any issues. Liaise with Finance on a daily basis to ensure smooth running of the Hyperion environment. Build data flows within the SQL environment in SSIS packages. Risk & Regulatory Duties Maintain knowledge of all applicable regulatory requirements including the Bank's Risk and Compliance policies and procedures and adhere to these to avoid exposing the Bank to undue risk. Report policy/procedure breaches and areas of potential non-compliance and suspicions promptly upon identification in accordance with the Bank's Risk and Compliance policies. Accurately execute all controls within own area to minimise risk of policy, procedure, and/or regulatory breaches. Identify new risks/control gaps within own area and escalate accordingly to your Line Manager and/or Head of Department. Qualifications/Experience Degree level qualified or equivalent. SQL Programming. Knowledge and Skills Software analysis and design. SQL query language. Data warehouse design concepts, (Inmon or Kimball) Must have solid experience of working with SSIS and building data warehouses and some knowledge of reporting using SSRS. The Client is a Bank based in the Central London. This is a 12 month FTC position with a salary of circa £55K - £70K. You will be required to be in the office at least 3 days week. Do send your CV to us in Word format along with your salary and availability.

Description Starling is the UK's first and leading digital bank on a mission to fix banking! Our vision is fast technology, fair service, and honest values. All at the tap of a phone, all the time. Starling is the UK's first and leading digital bank on a mission to fix banking! We built a new kind of bank because we knew technology had the power to help people save, spend and manage their money in a new and transformative way. We're a fully licensed UK bank with the culture and spirit of a fast-moving, disruptive tech company. We're a bank, but better: fairer, easier to use and designed to demystify money for everyone. We employ more than 3,000 people across our London, Southampton, Cardiff and Manchester offices. Our technologists are at the very heart of Starling and enjoy working in a fast-paced environment that is all about building things, creating new stuff, and disruptive technology that keeps us on the cutting edge of fintech. We operate a flat structure to empower you to make decisions regardless of what your primary responsibilities may be, innovation and collaboration will be at the core of everything you do. Help is never far away in our open culture, you will find support in your team and from across the business, we are in this together! The way to thrive and shine within Starling is to be a self-driven individual and be able to take full ownership of everything around you: From building things, designing, discovering, to sharing knowledge with your colleagues and making sure all processes are efficient and productive to deliver the best possible results for our customers. Our purpose is underpinned by five Starling values: Listen, Keep It Simple, Do The Right Thing, Own It, and Aim For Greatness. Hybrid Working We have a Hybrid approach to working here at Starling - our preference is that you're located within a commutable distance of one of our offices so that we're able to interact and collaborate in person. Our Data Environment Our Data teams are aligned to divisions covering the following Banking Services & Products, Customer Identity & Financial Crime and Data & ML Engineering. Our Data teams are excited about delivering meaningful and impactful insights to both the business and more importantly our customers. Hear from the team in our latest blogs or our case studies with Women in Tech . We are looking for talented data professionals at all levels to join the team. We value people being engaged and caring about customers, caring about the code they write and the contribution they make to Starling. People with a broad ability to apply themselves to a multitude of problems and challenges, who can work across teams do great things here at Starling, to continue changing banking for good. Responsibilities: Analyse source data from source databases (PostgreSQL) to understand structures, relationships and semantics. Design and implement streaming data pipelines using AWS EMR and PySpark to generate real time (fast moving) features for the feature store. Develop and maintain batch processing pipelines using DBT and BigQuery to generate batch (slow moving) features, ensuring data quality, consistency and reliability. Work with Feast feature store, manage feature life cycle and maintain data quality. Collaborate with data scientists, ML engineers and software engineers to identify requirements, define feature schemas and ensure efficient integration into Feast feature store. Requirements Good knowledge of programming languages such as Python or Java. Strong experience with streaming technologies (Spark, PySpark, Flink, KSQL or similar) for developing data transformation pipelines. Solid understanding and practical experience with SQL and relational databases (PostgreSQL preferred). Proficiency with AWS EMR for running and managing Spark workloads. Experience in SQL based transformation workflows, particularly using DBT in BigQuery. Experience with Terraform to define and manage cloud infrastructure through code. Desirables: Familiarity with AWS, GCP or other cloud providers. Experience with containerisation technologies (Docker, Kubernetes). Familiarity with streaming data ingestion technologies (Kafka, Debezium). Exposure to feature store concepts and practices (Feast or similar). Interview process Interviewing is a two way process and we want you to have the time and opportunity to get to know us, as much as we are getting to know you! Our interviews are conversational and we want to get the best from you, so come with questions and be curious. In general you can expect the below, following a chat with one of our Talent Team: Stage 1 30 mins with one of the team Stage 2 Take home challenge Stage 3 60 mins technical interview with two team members Stage 4 45 min final with two data executives Benefits 25 days holiday (plus take your public holiday allowance whenever works best for you) An extra days holiday for your birthday Annual leave is increased with length of service, and you can choose to buy or sell up to five extra days off 16 hours paid volunteering time a year Salary sacrifice, company enhanced pension scheme Life insurance at 4x your salary & group income protection Private Medical Insurance with VitalityHealth including mental health support and cancer care. Partner benefits include discounts with Waitrose, Mr&Mrs Smith and Peloton Generous family friendly policies Perkbox membership giving access to retail discounts, a wellness platform for physical and mental health, and weekly free and boosted perks Access to initiatives like Cycle to Work, Salary Sacrificed Gym partnerships and Electric Vehicle (EV) leasing About Us You may be put off applying for a role because you don't tick every box. Forget that! While we can't accommodate every flexible working request, we're always open to discussion. So, if you're excited about working with us, but aren't sure if you're 100% there yet, get in touch anyway. We're on a mission to radically reshape banking - and that starts with our brilliant team. Whatever came before, we're proud to bring together people of all backgrounds and experiences who love working together to solve problems. Starling Bank is an equal opportunity employer, and we're proud of our ongoing efforts to foster diversity & inclusion in the workplace. Individuals seeking employment at Starling Bank are considered without regard to race, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, medical condition, ancestry, physical or mental disability, military or veteran status, or any other characteristic protected by applicable law. When you provide us with this information, you are doing so at your own consent, with full knowledge that we will process this personal data in accordance with our Privacy Notice. By submitting your application, you agree that Starling Bank will collect your personal data for recruiting and related purposes. Our Privacy Notice explains what personal information we will process, where we will process your personal information, its purposes for processing your personal information, and the rights you can exercise over our use of your personal information.

Who we are 🩵 We're the people behind the global loyalty currency, Avios, and home to three ambitious, growing businesses; IAG Loyalty, BA Holidays and The Wine Flyer . Each business has its own goals and strategy, but collectively we create brilliant experiences for our global customers. We're on a truly exciting journey of growth and transformation - we're going places! This is where you come in. The Opportunity We're looking for a Senior Data Engineer to take a leading role in the development of our Member Data Product, the hub for all member data within IAG Loyalty. You'll be at the forefront of delivering critical reports and datasets that drive business performance and enable our partners-British Airways, Aer Lingus, Iberia, and Vueling-to serve millions of loyalty program members. This is a high-impact role with the chance to shape the future of our data capabilities. What you'll get up to 🌠 As a Senior Data Engineer, you will play a key role within the data product team to design and build out new data features in the core data product. You will collaborate with cross-functional teams, including analysts, data modellers and engineers, to design, develop, and deliver a robust and scalable data product, aligning technical efforts with business goals. You will support the Tech Lead providing technical guidance to the data product team, you will ensure the successful execution of the roadmap by driving the implementation of data pipelines, data processing algorithms, and analytics frameworks. Additionally, you will oversee testing, quality assurance, and deployment processes to ensure the reliability and performance of the data product. By adopting and enforcing coding standards, architectural principles, and development best practices, you will maintain a high-quality, maintainable, and efficient codebase. You will play a support role in creating a culture of innovation, continuous learning, and knowledge sharing within the team. You will encourage and promote an inclusive environment that values new ideas, encourages experimentation, and supports ongoing growth and development. In addition to providing guidance and frameworks to data engineers and analysts, you will offer technical guidance, coaching, and performance feedback to help them excel in their roles. What we need from you 💡 Data Product Delivery: Experience bringing data features to market, making data driven decisions. Team Leadership: Proven ability to lead diverse teams of engineers and analysts. Data Knowledge: Strong understanding of business data models, data flows, and governance principles. Technical Skills: Familiar with data architecture and warehousing. Tool Proficiency: Skilled in Snowflake, Tableau/Quicksight, and AWS Data tools (Glue, Lambda, S3, etc.). Communication: Excellent at engaging technical and business stakeholders. Documentation: Skilled at creating clear technical documentation. Problem Solver: Strong analytical skills to tackle data challenges. Team Builder: Experience managing onshore and offshore teams. Agile Mindset: Comfortable with Agile methods and fast iteration. The role has a blended base, between our Central London office and home. We trust you to make the right decision about the type of work that is best done in each location. We expect you'll achieve a 50/50 split between the two and there may be times where you'll want to visit our other locations to tell their stories, too (fully reimbursed). We might not be right for you if: You only want to focus on your to do list; were a small, high performing team, we help each other to succeed. You value perfection over fast iteration and progress; IAG Loyalty moves fast, we learn and iterate as we go; our environment isnt right for everyone. Youre looking to create but not build; this is an end to end role, you need to be comfortable owning your space, from ideation through to delivery and review. If you think you have what it takes but don't meet every single point above, please do still apply. We'd love to chat and see if you could be a great fit. Equity, Diversity and Inclusion at IAG Loyalty Our vision, 'to create the world's most rewarding experiences,' applies not only to our customers but for our colleagues too. It's about taking belonging seriously, actively fostering a culture where everyone feels welcomed and valued by embracing diverse identities, personal histories, and perspectives. This commitment makes IAG Loyalty a rewarding place to work and enhances our ability to solve complex problems, drive innovation, and better serve our customers and communities. Please let us know if we can make any reasonable adjustments to support your interview process with us.

Senior Azure Data Engineer Position Description Challenge yourself and change lives, unlocking complex system solutions as part of a highly motivated and supportive team. Our Data Engineers are trusted to work closely with a wide range of clients on exciting projects with real-world purpose and impact. CGI was recognised in the Sunday Times Best Places to Work List 2023 and has been named one of the 'World's Best Employers' by Forbes magazine. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a Partner not just an employee. CGI are on the hunt for a dynamic Senior Data Engineer to join our consulting team and drive innovative, high-impact data transformation solutions for our diverse client base. In this role, you will design, build, and optimize robust ETL pipelines and staging systems for complex data migration projects using Azure Data Factory and Azure Databricks, while also integrating key Google Cloud Platform services such as BigQuery, Cloud Dataflow, and Cloud Dataproc. Your extensive experience in processing large-scale data, managing millions of customer records, and developing Spark-based transformations will be crucial in converting legacy data models into structured, actionable insights. Your future duties and responsibilities In addition to your technical expertise, you will work closely with data architects and client stakeholders to ensure alignment with target data models and drive seamless data migrations. Your role will involve automating cleansing workflows, implementing data quality frameworks, and troubleshooting issues to maintain data integrity. The ideal candidate will have a strong multi-cloud background, deep technical skills, and proven consulting experience, enabling you to deliver tailored, strategic solutions that propel business transformation and client success. Required qualifications to be successful in this role • Strong experience in ETL development, data pipeline automation, and large-scale data processing. • Proficiency in Azure Data Factory (ADF) for orchestrating data workflows and extensive hands-on experience with Azure Databricks-including cluster management, notebook development, and performance optimization-for scalable data transformations. • Familiarity with Google Cloud Platform services-such as BigQuery, Cloud Dataflow, and Cloud Dataproc-in multi-cloud environments is highly advantageous. • Proven track record in developing, utilizing, and optimizing staging systems to manage complex data cleansing, transformation, and migration requirements. • Expertise in processing millions of customer records using SQL-based transformations and Spark-based frameworks (Python, Scala, or SQL) across platforms like Azure Databricks, Azure Synapse, or equivalent environments. • Strong knowledge of data quality frameworks, validation techniques, and error handling to ensure high-integrity data processes. • Experience working with structured and semi-structured data (JSON, Parquet, Avro, CSV, etc.) in migration contexts, and a deep understanding of legacy versus target data models. • Ability to optimize data cleansing and transformation processes for improved efficiency and performance. Want to learn more about careers at CGI? #LI-NP1 Together, as owners, let's turn meaningful insights into action. Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because... You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction. Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise. You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons. Come join our team-one of the largest IT and business consulting services firms in the world.

Data Engineer Junior to Mid-Level London - 4 Days on-site £40,000 - £65,000 DOE + Equity + Unlimited Annual Leave This is an excellent opportunity for a Junior Data Engineer to join a rapidly growing start-up offering great progression and the chance to further enhance your skills. This company is a platform designed to simplify the hiring process for businesses and enable individuals to find flexible work opportunities. By connecting businesses with skilled professionals for short-term staffing needs, this innovative solution optimises workforce efficiency. In this varied role you will be responsible for building and maintaining scalable data pipelines for data integration into customer-facing mobile and web apps, as well as internal dashboards. Responsibilities include designing and implementing data architecture to optimise data storage, retrieval, and processing, alongside developing ETL processes to ingest, transform, and load data from various sources, particularly APIs. The ideal candidate will possess strong foundations in data architecture with a degree in a relative subject or industry experience. Scalable data solutions, coupled with a solid understanding of data modelling techniques, database design, and data normalisation is required for the role. Equally, proficiency in Python and SQL is essential, ideally with experience using data processing frameworks such as Kafka, NoSQL, Airflow, TensorFlow, or Spark. Finally, experience with cloud platforms like AWS or Azure, including data services such as Apache Airflow, Athena, or SageMaker, is essential for the Mid-level. This is a fantastic opportunity for a Junior Data Engineer to join a rapidly expanding start-up at an important time where you will have great progression opportunities. The Role: • Build and maintain scalable data pipelines. • Design/implement optimised data architecture. • Develop ETL processes for various data sources. • Integrate data for apps and dashboards. The Person: • Strong data architecture foundation (degree/experience). • Scalable data solutions & data modelling expertise. • Proficient as a Data Engineer with Python, SQL, and data frameworks. • AWS/Azure experience with relevant data services. Reference Number: BBBH251710 To apply for this role or for to be considered for further roles, please click \"Apply Now\" or contact Tom McLaughlin at Rise Technical Recruitment This vacancy is being advertised by Rise Technical Recruitment Ltd. The services of Rise Technical Recruitment Ltd are that of an Employment Agency Rise Technical Recruitment Ltd regrets to inform that our client can only accept applications from engineering candidates who have a valid legal permit or right to work in the United Kingdom. Potential candidates who do not have this right or permit, or are pending an application to obtain this right or permit should not apply as your details will not be processed.

We have a current opportunity for a Java Python Data Engineer on a permanent basis. The position will be based in Houston. We are recruiting for a software engineer to work directly with the traders and research analysts in our trading teams. This is an exciting opportunity to work in a fast-paced commercial setting, playing a vital role in a real time, data and software driven trading environment. Whilst working directly with the trading teams who are based in various locations. The global engineer will be part of the global data science and engineering team who are responsible for the ingestion and management of market and fundamental data, sophisticated modelling techniques, data & analytics applications and solutions. The software engineer will be technically leading and building applications and software using cutting edge cloud and software technology stacks. Building end to end software platforms and stacks in a modern and innovation fueled business. Knowledge Skills and Abilities, Key Responsibilities: Engineer software such as components, frameworks and micro services, applications and tools for front office. Build core infrastructure and common services for use across DnA applications, such as common services and frameworks. Build cloud native big data platforms and analytics solutions Build and maintain time critical data integration pipelines (ETL/ELT) Implement a strong SDLC and agile principles to software delivery Apply domain driven design Problem solving and applying software solutions and automation to complex business issues and processes Abilities, Experience and Qualifications: 5+ years of software engineering experience Java or Python experience necessary Object oriented programming understanding Test driven development experience Cloud and modern development experience Experience building micro views/mini apps would be welcome AWS experience (E.g. S3, Redshift, Glue, Lambda) nice to have, willingness to learn essential Bachelors degree in computer science or related subject AWS certifications are a plus Prior front office experience in Commodities, Fixed Income, Equities, Asset Management would be a plus To find out more about SThree, please visit -hidden link- SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 8 Bishopsgate, London, EC2N 4BQ, United Kingdom | Partnership Number | OC387148 England and Wales

Principal Data Engineer / Architect (Python) Remote UK to £120k Are you a data centric technologist? You could be progressing your career in a senior, hands-on role at a scaling, global technical services company as they look to expand their product offerings with a new SaaS data analytics platform. As a Principal Data Engineer / Architect you will head up the engineering for the new platform, building the PoC product from the ground up and in time creating a team around you. You'll be responsible for the architecture and design, building a highly scalable SaaS offering that is customer facing and compliant with SOC and ISO27001 standards. The application will ingest customer data from multiple sources and aggregate, manipulate, model and build calculations and transformations based on the customers' analytical requirements and make the information available on a presentation layer. This is a high profile role where you'll collaborate closely with the founder and work directly with clients to understand their needs, you'll also be involved with recruiting and building a technical team around you. WFH Policy: Following a remote interview process you will join a diverse, global team working remotely from anywhere in the UK. About you : You have strong data engineering, architecture and design experience, having built a data platform from scratchYou have experience of working on a data platform within a SaaS environmentYou have strong Python coding skills in the context of developing data pipelines and APIsYou have a strong knowledge of RESTful services, microservices architectureYou have strong database design and optimisation skills on PostgreSQLYou have experience of writing testable code and unit testsYoure proficient with PowerBI for data presentation, C# would also be useful but not essentialYou have experience with public cloud services, AWS, GCP, AzureYou have excellent communication, client facing and stakeholder management abilities What's in it for you: Salary to £120k + bonusFully remote working in the UKHealth InsuranceLife assurance25 days holidayTraining and self-development budgetImpactful role with excellent career growth Apply now to find out more about this Principal Data Engineer / Architect opportunity. At Client Server we believe in a diverse workplace that allows people to play to their strengths and continually learn. We're an equal opportunities employer whose people come from all walks of life and will never discriminate based on race, colour, religion, sex, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. The clients we work with share our values.