11 senior data engineer jobs found in London

We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory reporting or financial services Exposure to Tagetik...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer/Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore...

Senior ML Platform Engineer London 5 Days a Week In Office £550- £700 Per Day, Outside IR35 Immediate Start The Company They are a technically ambitious organisation building advanced machine learning systems tightly integrated with real-world systems. Their platform supports the full lifecycle from data collection through to large-scale training and deployment. Engineering quality, reliability, and thoughtful system design are core to how they operate. The Role and Deliverables Own and evolve the operator-facing platform, including web UIs, backend services, and CLI tooling used for live data collection and dataset workflows. Design and maintain robust recording and orchestration systems that scale across robots, sensors, and lab environments. Collaborate with the ML team on dataset builders, ingestion pipelines, and infrastructure supporting large-scale distributed training. Partner with robotics engineers on ROS2 integration,...

Data Engineer £550-600/day outside IR35 6-month contract Remote working Working with a FTSE 100 client who have a requirement for a hands-on Senior Data Engineer. The role will be involved in designing and delivering data models, integrations, orchestration pipelines, rule engines and contributing to the platform/infrastructure - MUST have Terraform experience. Data Engineer, key skills: MUST have experience using Terraform to build and manage IAC Proven experience with AWS (E.g S3, Lambda, Glue etc) Background in building data pipelines, integrations and transformation layers Strong hands-on SQL experience Data modelling Data quality rules and validation frameworks Snowflake is massively desirable Data Engineer, AWS, Terraform, Snowflake Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have...

AI Engineer - LLM & Agentic Systems London - Hybrid. Circa £500 – £675 per day (and negotiable DOE) Contract (Outside IR35) Mid-level, Senior & Lead. Agentic AI / Machine Learning. Company: Our client is a globally established B2B information and professional services business, operating across multiple high-value industry sectors. They have established data science and machine learning engineering teams already delivering in production, and are now expanding their AI capability significantly across the global organisation. This is a role for people who ship. If you've built LLM-powered systems and agentic workflows that are live in production - not demos, not prototypes - and you want to do that at genuine scale, this is worth applying for. What you'll be working on as an AI Engineer - LLM & Agentic Systems: Designing and building AI agents and agentic workflows - combining LLMs, RAG, reasoning, memory and tool orchestration to...

AI Engineer - LLM & Agentic Systems London - Hybrid. Circa £500 - £675 per day (and negotiable DOE) Contract (Outside IR35) Mid-level, Senior & Lead. Agentic AI/Machine Learning. Company: Our client is a globally established B2B information and professional services business, operating across multiple high-value industry sectors. They have established data science and machine learning engineering teams already delivering in production, and are now expanding their AI capability significantly across the global organisation. This is a role for people who ship. If you've built LLM-powered systems and agentic workflows that are live in production - not demos, not prototypes - and you want to do that at genuine scale, this is worth applying for. What you'll be working on as an AI Engineer - LLM & Agentic Systems: Designing and building AI agents and agentic workflows - combining LLMs, RAG, reasoning, memory and tool orchestration to solve real,...

Principal / Lead Engineer Python / Cloud / Terraform / IAM / DevOps / infrastructure-as-a-code IaC Rate: Circa £600 - £700 PD (Outside IR35), 6 Months Location: London / Hybrid x2 days We are seeking an experienced Principal / Lead Engineer to join a highly ambitious organisation building a large-scale, mission-critical data and technology platform. This is a unique opportunity to join at the earliest stages of a major programme and play a key role in shaping its technical foundations. Working closely with the CTO and a small team of senior engineers, you will lead the design and implementation of core infrastructure, establish engineering standards and practices, and make architectural decisions that will have long-term strategic impact. If you enjoy solving complex technical challenges, influencing technology strategy, and creating robust engineering foundations, this role offers an exceptional opportunity to make a lasting impact. Role &...

This role is delivered within secure environments. Candidates must be eligible for UK SC clearance and hold UK citizenship. Join the Mission At ByDesign Secure, we believe that world‑class security shouldn't be an afterthought— it should be the foundation. We are an independent, outputs‑based consultancy dedicated to solving the most complex data assurance challenges in the UK public sector. Currently, we are working on a landmark transformation of a cross‑government secure IT system. This is an exciting opportunity to contribute to the design and consumption of a private cloud environment from the ground up and help modernise the end‑user services that support national decision‑making. We don’t believe in “billing by the hour” or rigid hierarchies; we are a lean, expert team focused on delivering high‑impact outcomes. If you are a self‑starter who thrives on autonomy and wants to see your analysis, insights, and business decisions shape the future of sovereign security, we...

This role is delivered within secure environments. Candidates must be eligible for UK SC clearance and hold UK citizenship. Join the Mission At ByDesign Secure, we believe that world‑class security shouldn't be an afterthought— it should be the foundation. We are an independent, outputs‑based consultancy dedicated to solving the most complex data assurance challenges in the UK public sector. Currently, we are working on a landmark transformation of a cross‑government secure IT system. This is an exciting opportunity to contribute to the design and consumption of a private cloud environment from the ground up and help modernise the end‑user services that support national decision‑making. We don’t believe in “billing by the hour” or rigid hierarchies; we are a lean, expert team focused on delivering high‑impact outcomes. If you are a self‑starter who thrives on autonomy and wants to see your analysis, insights, and business decisions shape the future of sovereign security, we...

This role is delivered within secure environments. Candidates must be eligible for UK SC clearance and hold UK citizenship. Opening: Join the Mission At ByDesign Secure, we believe that world-class security shouldn't be an afterthought—it should be the foundation. We are an independent, outputs-based consultancy dedicated to solving some of the most complex technology and security challenges within the UK public sector. We are currently supporting a landmark transformation of a cross-government secure IT system, helping to build and modernise critical digital services, cloud platforms, infrastructure capabilities, and workplace technologies that underpin national decision-making. We don't believe in rigid hierarchies or billing by the hour. We are a lean, expert team focused on delivering meaningful outcomes in highly secure environments. If you are passionate about Agile delivery, servant leadership, and helping teams achieve their full potential, we would love to hear...