43 senior data engineer jobs found in London, greater london

Senior Data Engineer – DBT, AWS (native), AWS DMS, ETL, Warehouse Architecture, Redshift, IaC (Terraform) Reporting to the Head of Data for this global, rapidly modernising SaaS platform , this business is scaling its data capabilities to support native AI engineering and agentic workflows. We’re looking for a Senior AWS Data Engineer who wants to shape the future of their data platform, modern analytics stack, and the way data powers decisions across the business. This is a hands‑on, architecture‑shaping, strategy‑influencing role for someone who thrives at the intersection of engineering excellence, data modelling, platform design and cross‑functional leadership. You’ll own the full data lifecycle from ingestion to modelling to consumption , and play a pivotal role in building a reliable, governed, cloud‑native data ecosystem. What you’ll be doing: Architect and deliver a cloud‑native data platform across ingestion, modelling, warehousing and BI...

Senior Data Engineer | Hybrid | Outside IR35 | £475 - £525 | London We are looking for a Senior Data Engineer to join a leading organisation on a contract basis. This role will suit someone with strong experience across the Azure data platform , particularly Databricks and PySpark , who can take ownership of data engineering delivery from design through to implementation. This is a hybrid role requiring the candidate to be on site 2 days per month. You will be working on building and enhancing modern data platforms, delivering scalable data pipelines, and supporting high-volume data processing in a cloud environment. Key Responsibilities Design and build scalable data pipelines using Azure technologies Develop and optimise solutions in Databricks using PySpark Work with large and complex datasets, including streaming and batch data Build and maintain data platforms and data warehouses Implement ETL/ELT processes and data transformation logic Collaborate...

Senior Data Engineer - DBT, AWS (native), AWS DMS, ETL, Warehouse Architecture, Redshift, IaC (Terraform) - OUTSIDE IR35 Reporting to the Head of Data for this global, rapidly modernising SaaS platform , this business is scaling its data capabilities to support native AI engineering and agentic workflows. We're looking for a Senior AWS Data Engineer who wants to shape the future of their data platform, modern analytics stack, and the way data powers decisions across the business. This is a hands-on, architecture-shaping, strategy-influencing role for someone who thrives at the intersection of engineering excellence, data modelling, platform design and cross-functional leadership. You'll own the full data life cycle from ingestion to modelling to consumption , and play a pivotal role in building a reliable, governed, cloud-native data ecosystem. What you'll be doing: Architect and deliver a cloud-native data platform across ingestion, modelling, warehousing...

Senior Data Engineer | Hybrid | Outside IR35 | £475 - £525 | London We are looking for a Senior Data Engineer to join a leading organisation on a contract basis. This role will suit someone with strong experience across the Azure data platform , particularly Databricks and PySpark , who can take ownership of data engineering delivery from design through to implementation. This is a hybrid role requiring the candidate to be on site 2 days per month. You will be working on building and enhancing modern data platforms, delivering scalable data pipelines, and supporting high-volume data processing in a cloud environment. Key Responsibilities Design and build scalable data pipelines using Azure technologies Develop and optimise solutions in Databricks using PySpark Work with large and complex datasets, including streaming and batch data Build and maintain data platforms and data warehouses Implement ETL/ELT processes and data...

We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory reporting or financial services Exposure to Tagetik...

Senior Data Engineer Location: London (Hybrid Working) Type: Contract Pay Rate: £350-£400 (Outside IR35) We're looking for a Senior Data Engineer to join a high-performing data team responsible for delivering scalable, reliable, and innovative data solutions that power analytics and decision-making across a global streaming and digital ecosystem. This is an opportunity to work with modern cloud technologies, large-scale datasets, and a collaborative engineering culture where you'll help shape the future of data platforms used by millions of customers worldwide. What You'll Be Doing Design, build, and support scalable data models and distributed ETL pipelines using modern big data technologies. Collaborate with stakeholders across multiple business functions to understand data challenges and translate requirements into robust technical solutions. Champion DataOps principles, engineering best practices, and continuous improvement initiatives....

Contract – Senior Data Engineer Contract : 6 month sRate : £750 - £800 PD (Outside IR35 )Location : London / Hybrid x2 days onsit e Overvi ewWe are seeking an experienced Senior Data Engineer to join a major data programme transforming how organisations and industry partners access and use health data across the UK. You will design, build and optimise scalable data platforms and pipelines that enable secure, trusted and efficient access to health data. You will collaborate closely with architects, product teams, analysts and engineers to deliver high-quality data solutions that support research, innovation and operational decision-making. This role is ideal for a hands-on Data Engineer who enjoys solving complex data challenges, working with large datasets and building modern cloud-based data solutions within regulated environment s. Role & Responsibilit iesData Engineering & Platform Developm entDesign, build and maintain scalable data...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer/Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore...

Senior Data & ML Engineer Contract - Outside IR35 - Initial 6 month contract £650-£750 per day London - Hybrid working We are partnering with a rapidly growing financial services business that is investing heavily in its machine learning and data platform capabilities. This is a hands-on engineering role focused on helping Data Science teams build, deploy, and scale machine learning solutions in production. The work sits at the intersection of data engineering, machine learning engineering, and MLOps, with a strong focus on production systems, feature engineering, workflow orchestration, and model lifecycle management. What you'll be doing Design and build scalable data and feature engineering pipelines to support machine learning workloads Work closely with Data Scientists to operationalise models and improve the end-to-end machine learning lifecycle Develop and optimise PySpark-based data processing workflows and training pipelines Build and...

Data Engineer - Contract - Outside IR35 - Wembley Hybrid This position will focus on improving and maturing the existing data platform, developing scalable data structures and pipelines, and supporting the wider business in maximising the value of its data. The environment has been established within Microsoft Fabric for several years, however there remains significant opportunity to improve data warehousing structures, data modelling, governance and reporting capabilities. The successful candidate will work across the full data lifecycle, from ingestion and transformation through to reporting and security, while collaborating closely with Data Analysts and business stakeholders. This is a hands-on role suited to someone who enjoys building practical, maintainable solutions and can balance strong technical capability with a business-focused approach. Key Responsibilities Design, develop and maintain data pipelines within Microsoft Fabric. Build and enhance...

Lead Data Engineer (BigQuery Consolidation, Migration & Architecture) – Contract Location: Hybrid - London Contract Length: Initial 4-week engagement with extension Day Rate: £700 per day (Outside IR35) Start Date: ASAP An ambitious, data-driven organisation is seeking a highly experienced Lead Data Engineer to assess and potentially lead the consolidation of a complex, fragmented data landscape into a single Google BigQuery platform. The business currently operates across multiple technologies and data warehouses, creating challenges around data consistency, reporting accuracy, and stakeholder trust. The objective is to establish a scalable, future-proof architecture that delivers a true single source of truth while supporting an AI-enabled data strategy. Initially, this will be a four-week exploratory engagement focused on validating the migration approach, identifying risks, and proving technical feasibility. For the right individual, there is...

Senior Software Engineer - Outside IR35 - Contract (Insurance) About the role Essential: Self-starter, someone who can pick up context quickly, drive outcomes efficiently, and to a high quality Competent in doing high-level designs, solution management, and scoping Understanding of data modelling best practices Ability to translate technical solutions to non-technical stakeholders and bring them on the journey Experience working in an agile delivery environment Experience working with React, TypeScript, Azure, Microsoft SQL, and Databricks (if they don’t have all of these, that’s workable, but be good to understand any they don’t have experience with) Frontend: React + TypeScript + Vite Material UI with Emotion for styling TanStack React Query 5 for server state React Router 7 React Hook Form+Yup for forms/validation MSAL for Entra ID auth Jest+Testing Library for unit tests; Playwrightfor E2E and visual tests Hosted as an Azure Static...

Lead Data Engineer  (BigQuery Consolidation, Migration & Architecture) Contract Location: Hybrid - London Contract Length: Initial 4-week engagement with extension Day Rate: £700 per day (Outside IR35) Start Date: ASAP An ambitious, data-driven organisation is seeking a highly experienced Lead Data Engineer to assess and potentially lead the consolidation of a complex, fragmented data landscape into a single Google BigQuery platform. The business currently operates across multiple technologies and data warehouses, creating challenges around data consistency, reporting accuracy, and stakeholder trust. The objective is to establish a scalable, future-proof architecture that delivers a true single source of truth while supporting an AI-enabled data strategy. Initially, this will be a four-week exploratory engagement focused on validating the migration approach, identifying risks, and proving technical feasibility. For the right individual, there is...

?? Senior Voice AI Engineer - Contract (Outside IR35) | £350-500/day | 3-4 months | Remote ?? We're looking for a hands-on engineer to take an existing voice AI proof-of-concept and turn it into a reliable, production-grade system ready for real users. The prototype works - but it now needs to be made fast, stable, scalable, and cost-efficient. What you'll be doing: - Productionising a voice AI system from an existing PoC - Working with voice platforms such as ElevenLabs/Deepgram (or similar) - Improving Real Time performance and reducing latency - Designing lightweight orchestration (simple, deterministic flows over complex prompt chains) - Integrating customer/internal data using RAG approaches - Optimising cost, reliability, and system efficiency - Building and maintaining API/SDK-based voice pipelines - Supporting secure handling of sensitive/PII data What we're looking for: - Strong experience building voice AI or Real Time speech systems - Hands-on experience with...

Robert Half Technology are assisting a growing sports media organisation to recruit an AI Engineer on a contract basis. Hybrid working - London based (3 days per week onsite). Role * The AI Engineer will work closely with senior stakeholders across the business to identify, design, and deliver AI solutions that drive operational efficiency, audience engagement, and commercial value. * Partner with business leaders, product teams, and technical stakeholders to understand requirements and translate opportunities into practical AI use cases. * Design, develop, and deploy Generative AI applications, including AI assistants, intelligent search solutions, content automation tools, and Retrieval-Augmented Generation (RAG) platforms. * Build and maintain scalable AI workflows and integrations across internal systems, APIs, and cloud environments. * Develop proof-of-concepts and rapidly iterate solutions, balancing innovation with business priorities and timelines. * Implement prompt...

Senior Voice AI Engineer - Contract (Outside IR35) | £350-500/day | 3-4 months | Remote We 're looking for a hands-on engineer to take an existing voice AI proof-of-concept and turn it into a reliable, production-grade system ready for real users. The prototype works - but it now needs to be made fast, stable, scalable, and cost-efficient. What you 'll be doing: - Productionising a voice AI system from an existing PoC - Working with voice platforms such as ElevenLabs / Deepgram (or similar) - Improving real-time performance and reducing latency - Designing lightweight orchestration (simple, deterministic flows over complex prompt chains) - Integrating customer/internal data using RAG approaches - Optimising cost, reliability, and system efficiency - Building and maintaining API/SDK-based voice pipelines - Supporting secure handling of sensitive/PII data What we 're looking for: - Strong experience building voice AI or real-time speech systems - Hands-on...

Robert Half Technology are assisting a growing sports media organisation to recruit an AI Engineer on a contract basis. Hybrid working - London based (3 days per week onsite). Role * The AI Engineer will work closely with senior stakeholders across the business to identify, design, and deliver AI solutions that drive operational efficiency, audience engagement, and commercial value. * Partner with business leaders, product teams, and technical stakeholders to understand requirements and translate opportunities into practical AI use cases. * Design, develop, and deploy Generative AI applications, including AI assistants, intelligent search solutions, content automation tools, and Retrieval-Augmented Generation (RAG) platforms. * Build and maintain scalable AI workflows and integrations across internal systems, APIs, and cloud environments. * Develop proof-of-concepts and rapidly iterate solutions, balancing innovation with business priorities and timelines....

Senior AI Engineer (Contract) Rate: £700 / day IR35 Status: Outside IR35 Duration: 6 months (with high likelihood of extension) Location: Hybrid / Remote options available (UK-based) Security Clearance: DV Cleared The Role We are looking for a Senior AI Engineer to design, build, and deploy production-ready GenAI applications and multi-agent systems within secure environments. This role requires a strong hybrid of advanced AI orchestration and robust cloud-native engineering, specifically focusing on scaling workloads via Kubernetes. Because of the nature of this work, you must hold active UK Developed Vetting (DV) security clearance to be considered. Key Responsibilities Agentic Workflows: Design, implement, and optimize multi-agent frameworks and stateful LLM applications. Kubernetes Orchestration: Containerize, deploy, and scale AI models, APIs, and microservices across production Kubernetes (K8s) clusters. Infrastructure &...

Senior AI Engineer - Agentic Platforms £800-900/day | Outside IR35 | Remote (UK) | Initial 6 months Our client are looking build out their next-generation AI capability, focused on developing an autonomous agent platform that will sit at the core of their product offering. They're looking to bring in two Senior AI Engineers to take a hands-on role in designing and delivering production-ready, agentic systems - this is not research or POC work, it's about building scalable, real-world AI solutions that integrate directly into a live platform. The focus of the role is on developing intelligent, self-learning workflows, multi-agent systems, and AI-driven automation that supports real estate professionals in managing leads, workflows, and customer interactions. You'll be working closely with Product, Architecture, and Data teams to define and build the underlying platform, with a strong emphasis on engineering quality, scalability, and commercial impact. Key areas of focus:...