40 senior data engineer jobs found in London

About the job Data Engineer - AWS/Azure/Snowflake/Databricks 6 Month Contract London based Hybrid - 2 days per week onsite. Outside IR35 SC Cleared or eligible to be cleared.   The Company   We have partnered with an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients. With a global presence spanning the UK, USA, Europe, Australia, India, and South Africa, they provide a collaborative environment where senior engineers can thrive.   The Role   As a Data Engineer, you will be part of a team that utilises modern agile technical practices, including continuous integration, deployment, and fast feedback loops, to deliver pragmatic solutions. You will work closely with clients to determine data processing and access needs, ensuring the creation and support of highly available data pipelines and storage solutions. Your...

Senior Data Engineer London | Flexible, hybrid working pattern | Outside IR35 | 12-month engagement We're looking for a Senior Data Engineer to shape modern data platforms, solve complex engineering challenges, and deliver data solutions that create business value. You'll join an organisation investing heavily in its data capabilities, working alongside architects, analysts, data scientists, and engineering teams to build production-grade data platforms supporting analytics, AI, and operational decision-making. Why Join? Work on large-scale data and cloud transformation initiatives Influence architecture, engineering standards, and platform strategy Deliver solutions with measurable business impact Join a collaborative team of experienced data professionals Responsibilities Design, build, and maintain scalable data products and pipelines Own solutions from requirements gathering through to deployment and monitoring Develop cloud-native data platforms using...

Contract - Senior Data Engineer (Snowflake Cortex) Rate: (Apply online only) per day, Outside IR35 Location: London (2 days per week, on-site) Start Date: Monday 9th November 2026 Length: 6 months initially, with a chance of extension. Interview Stages: 1-stage over Teams, with joint company owners (CEO and CTO) Opus have partnered with a rapidly growing HealthTech start-up who's recently received funding. They're on a mission to build a next-gen data platform for processing millions of confidential patient records and clinical documents securely, and at scale. The successful Data Engineer will play a pivotal part in helping to design and deliver AI-enabled document processing pipelines using Snowflake Cortex, helping to extract valuable insights from unstructured healthcare data including patient records, referral letters, clinical notes, PDFs and compliance documentation. The role: - Design and build scalable data pipelines in Snowflake (Snowpipes) - Design...

DVF are currently supporting a specialist Databricks consultancy hire a Lead Data Engineer on an urgent 6 month contract. You’ll act as the Senior Databricks expert on engagements, advising the client at every level from engineering teams through to senior stakeholders, and leading the design and delivery of modern Lakehouse platforms. Must haves: Deep, hands-on Databricks expertise, with the confidence to advise clients at all levels. Experience with Unity Catalog. Strong background designing and building scalable data pipelines. Experience implementing Delta Sharing. Solid understanding of Medallion Architecture. Databricks certifications (preferred). This is a 6 Month, Outside IR35 Contract. Based in London x5 days a week, paying £750 to £800 per day Get in touch now to learn who DVF Recruitment are working with! 📩

Azure Data Engineer | £450 | Outside IR35 | 6 months Initial | Fully Remote I'm working with a client looking for a Senior Data Engineer to help build and enhance a modern Azure-based data platform. We're keen to speak with engineers who have experience designing scalable cloud data solutions, developing robust data integration processes, and working across large datasets in secure, regulated environments. Technical Skills: Building enterprise-scale data pipelines within Azure Strong Python development skills for data engineering Azure Data Factory, Azure SQL and Data Lake technologies Data architecture and layered data platform design Metadata-led ingestion and reusable ETL frameworks CI/CD, source control and DataOps best practices Data security, governance and compliance-focused delivery Advanced SQL and experience working with complex datasets Nice to have: Data quality and testing frameworks API development experience Aviation data experience this Data...

Azure Data Engineer | £450 | Outside IR35 | 6 Months Initial | Fully Remote I 'm working with a client looking for a Senior Data Engineer to help build and enhance a modern Azure-based data platform. We 're keen to speak with engineers who have experience designing scalable cloud data solutions, developing robust data integration processes, and working across large datasets in secure, regulated environments. Technical Skills: Building enterprise-scale data pipelines within Azure Strong Python development skills for data engineering Azure Data Factory, Azure SQL and Data Lake technologies Data architecture and layered data platform design Metadata-led ingestion and reusable ETL frameworks CI/CD, source control and DataOps best practices Data security, governance and compliance-focused delivery Advanced SQL and experience working with complex datasets Nice to have: Data quality and testing frameworks API development experience...

Full Stack Engineer | Cross Asset Trading | React, C#, .NET, SQL Server | London | Hybrid 1-2 days onsite | Up to £550 p/day | Outside IR35 We’re working with a cross-asset trading business that’s firmly tech-first, where engineering sits at the heart of how the firm operates. They’re looking for a Full Stack Developer to join on a contract basis and help build the applications their traders and teams rely on every day. On the technical side, this is a front end-led role, with roughly 60% of your time in React, 30% across .NET, C# and API development, and the remaining 10% in SQL Server. Experience with the modern React ecosystem will set you apart, particularly the TanStack suite, which has become the industry standard for data access and routing. Just as important, you’ll bring a background in regulated environments. Finance can be a tricky space to step into cold, so a solid grasp of the vocabulary and an understanding of models and funds work will help you hit the...

a Lead Data Engineer on a 6-month contract to act as their senior Databricks expert on client engagements. You'd advise clients at every level, from engineering teams through to senior stakeholders, and lead the design and delivery of modern Lakehouse platforms. What they're looking for: • Deep, hands-on Databricks expertise, with the confidence to advise clients at all levels • Experience with Lakebase and Unity Catalog • A strong background designing and building scalable data pipelines • Experience implementing Delta Sharing • A solid understanding of Medallion Architecture • Databricks certifications (preferred) The details: • 6-month contract, Outside IR35 • £750–£800 per day • London, 5 days a week • Urgent start

Senior DevSecOps Engineer 6-Month Contract | Up to £680 per day | Outside IR35 | Hybrid We're looking for a Senior DevSecOps Engineer to support a major platform transformation programme, securing APIs, integrations, data flows and customer-facing digital journeys across a complex AWS and hybrid environment. Working closely with Engineering, Platform and Security teams, you'll help define and implement security standards across modern distributed applications, ensuring authentication, authorisation and integration security are built in from day one. Key Skills & Experience Strong background in DevSecOps, Application Security or Integration Security. Expertise in OAuth2, OIDC, JWT and API Security . Strong knowledge of OWASP Top 10 and OWASP API Security Top 10 . Experience securing AWS environments, including IAM, networking and hybrid integrations. Ability to review code across Java, Kotlin, TypeScript, .NET or Python. Experience embedding security testing...

Senior DevSecOps Engineer 6-Month Contract | Up to £680 per day | Outside IR35 | Hybrid We 're looking for a Senior DevSecOps Engineer to support a major platform transformation programme, securing APIs, integrations, data flows and customer-facing digital journeys across a complex AWS and hybrid environment. Working closely with Engineering, Platform and Security teams, you 'll help define and implement security standards across modern distributed applications, ensuring authentication, authorisation and integration security are built in from day one. Key Skills & Experience Strong background in DevSecOps, Application Security or Integration Security. Expertise in OAuth2, OIDC, JWT and API Security . Strong knowledge of OWASP Top 10 and OWASP API Security Top 10 . Experience securing AWS environments, including IAM, networking and hybrid integrations. Ability to review code across Java, Kotlin, TypeScript, .NET or Python....

Senior AI Engineer | Contract | Up to £620/day Outside IR35 I'm currently recruiting for several AI engineering opportunities with a major global financial institution, where the focus is on turning advanced AI capabilities into practical, production-ready solutions. The initial project involves developing AI-driven trading recommendations by combining client behavioural data with market predictions. You'll be building and deploying solutions using Python, machine learning and modern AI frameworks, with additional projects across trading, FX and digital sales to follow. Key requirements: 5+ years of commercial engineering experience. Strong Python skills and experience writing production-grade code. Proven experience building, evaluating and deploying AI/ML models using real business data. Practical experience with LLMs, agentic frameworks and AI-assisted coding tools. Understanding of model evaluation, testing, monitoring and production governance. Experience...

Azure Platform Engineer | Contract | Outside IR35 Outside IR35 | London Market Insurance We are working with a leading London Market insurer looking for an experienced Azure Platform Engineer to deliver a new cloud sandbox platform. This is a hands on engineering assignment focused on building a secure, automated Azure environment that allows development and technology teams to provision temporary infrastructure for testing, experimentation and proof of concept activities. The platform architecture and strategy have already been defined. The successful contractor will take ownership of the technical implementation, automation and delivery through to operational handover. Key Responsibilities Build and configure Azure infrastructure to support secure, isolated sandbox environments. Develop reusable Terraform modules and Ansible playbooks to automate infrastructure provisioning. Implement automated deployment workflows using GitHub Enterprise and GitHub Actions....

Senior & Principal AI Delivery Consultants - Capital Markets Outside IR35 and Hybrid Working Location: London Start date: ASAP Contract requirement: 2-4 consultants, with the strongest two candidates prioritised for initial presentation. We are supporting a Tier-1 global financial institution looking to bring in experienced AI consultants who have successfully delivered commercial AI solutions into live production environments. The bank has several AI initiatives underway but needs additional engineering capacity to move projects beyond experimentation and into production. Previous permanent hiring efforts have not filled the requirement, so the priority is to identify high-quality consultants who can start quickly and deliver from day one. These are hands-on delivery roles, not research, advisory or proof-of-concept positions. Consultants will be responsible for designing and building AI solutions, integrating them into the bank's existing technology...

Sr. Juniper Network Architect Our global communications client is looking for a hands-on Senior Architect/Engineer for a highly technical, customer-facing role providing post-sales, on-site technical support for Juniper Networks products/solutions. This role partners closely with our client's Network Engineering, Architecture, and Operations teams to ensure high availability, scalability, and operational excellence across large-scale service provider networks. The role requires you to have a deep technical expertise in the Juniper products deployed (and planned for deployment) within our client's network and delivers reactive and proactive operational support, design guidance, and best-practice recommendations. Essential Skills Senior Juniper architect spanning campus, data center, routing and security; able to own customer design and consulting. Experience in supporting major network transformations, upgrades, or expansions. 10+ years large-IP network design,...

Data Engineer London (2 Days Onsite) | Outside IR35 | Long-Term Contract We're supporting a client delivering major data, cloud and AI transformation programmes and are looking to engage a senior consultant with a strong blend of technical expertise, stakeholder management and consulting capability. This role requires someone who can operate confidently with both senior business stakeholders and technical teams, helping shape solutions, influence decision-making and drive delivery across complex enterprise environments. We're specifically looking for consultants with 10+ years of commercial experience , ideally gained across multiple clients, industries and transformation programmes. Essential Skills & Experience 10+ years' experience in Data Engineering, Data Architecture or Cloud Data Platforms Strong consulting background with proven client-facing delivery experience Excellent communication and stakeholder management skills Comfortable operating at both strategic...

Rate: Up to £550 per day IR35 Status: Outside IR35 Location: Fully Remote Contract Type: Contract Client: Financial Services We are seeking an experienced Senior Cloud Infrastructure Engineer to work with a financial services client on the development and automation of its cloud and data platform infrastructure. The role has a strong focus on Snowflake Infrastructure as Code (IaC), Terraform and Azure , alongside improving security, identity management and CI/CD processes. You will play a key role in automating Snowflake provisioning, modernising deployment pipelines and strengthening the management of credentials across Azure and Snowflake. Key Responsibilities Snowflake Infrastructure as Code: Design and develop reusable Terraform modules to provision and manage Snowflake databases, schemas, warehouses, roles, grants, stages, integrations and other platform objects. Terraform Engineering: Develop and maintain reusable modules, manage Terraform state,...

WE ARE: At Adaptive, we are a technology provider firm that partners with capital, commodity, and digital market participants to build custom front-office technology, messaging systems, and trading infrastructure. Our experienced teams design and deliver complex front-office technology solutions using our proven accelerators to create long-term competitive advantage. Our clients include the world 's leading investment banks, investment managers, fintechs and capital market service providers. With a global reach, with offices in London, New York, Barcelona, Montreal, and Manila, we have a proven track record of delivering powerful, elegant and intuitive trading technology solutions, and we value technical pragmatism, collaboration, and clear communication. We 're looking for a Senior Java / Systems Engineer with significant experience in Platform Exchange Systems to design, deliver, and optimise production-ready, high-performance, low-latency technology using Aeron....

WE ARE: At Adaptive, we are a technology provider firm that partners with capital, commodity, and digital market participants to build custom front-office technology, messaging systems, and trading infrastructure. Our experienced teams design and deliver complex front-office technology solutions using our proven accelerators to create long-term competitive advantage. Our clients include the world's leading investment banks, investment managers, fintechs and capital market service providers. With a global reach, with offices in London, New York, Barcelona, Montreal, and Manila, we have a proven track record of delivering powerful, elegant and intuitive trading technology solutions, and we value technical pragmatism, collaboration, and clear communication. We're looking for a Senior Java / Systems Engineer with significant experience in Platform Exchange Systems to design, deliver, and optimise production-ready, high-performance, low-latency technology using Aeron....

Machine Learning/ML Ops Engineer Outside IR35: £500 - 625 p/d Active SC Clearance Required 4 days a week into East London 6 months initial contract, long term programme The Role We're looking for a Senior MLOps Engineer to build and run the infrastructure that takes machine learning models from research into production. You'll work alongside AI developers, software engineers and technical leadership to turn R&D into reliable, deployable products in the cloud and on edge hardware. The work is for a long-term programme in the defence and security sector. This is a hands-on role, and you'll have real influence over the architecture of the ML platform. What you'll do Design and maintain ML training pipelines, including distributed training at scale Build experiment tracking, model registry and data versioning capability Optimise models for production and edge deployment Containerise ML workloads, including multi-architecture builds for cloud and edge targets...

Machine Learning / ML Ops Engineer Outside IR35: £500 - 625 p/d Active SC Clearance Required 4 days a week into East London 6 months initial contract, long term programme The Role We 're looking for a Senior MLOps Engineer to build and run the infrastructure that takes machine learning models from research into production. You 'll work alongside AI developers, software engineers and technical leadership to turn R &D into reliable, deployable products in the cloud and on edge hardware. The work is for a long-term programme in the defence and security sector. This is a hands-on role, and you 'll have real influence over the architecture of the ML platform. What you 'll do Design and maintain ML training pipelines, including distributed training at scale Build experiment tracking, model registry and data versioning capability Optimise models for production and edge deployment Containerise ML workloads, including multi-architecture builds...