22 lead data engineer jobs found in London

Lead Data Platform Engineer - Outside IR35 - 1 day pw London (rest remote) - 3 months Initially We are currently recruiting for a Lead Data Platform Engineer to join a programme focused on data platforms, analytics engineering, and modern Lakehouse solutions. The client is looking for a hands-on engineering professional with strong Microsoft Fabric, Spark, PySpark and SparkSQL expertise, capable of designing, building and supporting enterprise-scale data platforms. Start Date: ASAP Duration: 3 months Initially Pay Rate: Competitive IR35 Status: Outside IR35 Location: London (1 day per week onsite, remainder remote) The Role: The core requirement is strong Lakehouse expertise, particularly Spark, PySpark, and SparkSQL. Hands-on experience in low-code is essential. Data & Analytics Expertise: Particularly relevant to your current Data Platform background: Data architecture (Lakehouse, Medallion, Kimball, 3NF). Data ingestion and processing. Data...

2x Data Engineering Positions - Lead/Senior/Mid Outside IR35: £450 - £525 per day ASAP Start: 6 months initial contract Primarily remote: at maximum once a month travel to London We're supporting a key client in a major CRM migration programme that's looking to share the future of their growing data function. As part of this, we're looking to engage 2x Data Engineers, 1 Lead/Senior and 1 Senior/Mid level. You'll be joining at a genuinely exciting stage: the business is investing heavily in new technology and modernizing its data platform from the ground up. Rather than inheriting years of technical debt, you'll have the opportunity to influence architecture, standards, and ways of working from the beginning. Tech Stack: * Snowflake * dbt * Python * AWS * PowerBI Responsibilities: * Designing, developing, and evolving scalable Data Warehouse and ELT solutions * Driving modern DataOps practices including CI/CD, GitOps, testing, and automation * Implementing robust,...

AI Technical Lead | Generative AI & Machine Learning 12-Month Contract | £500 - £700 per day | Outside IR35 | London 167 Solutions is working with an organisation looking to appoint an experienced AI Technical Lead to lead the design and delivery of production-ready Generative AI and Machine Learning solutions. This is a hands-on technical leadership role for someone who can operate across AI strategy, architecture and engineering , while still being comfortable getting involved in the technology. The Role You will take technical ownership of AI initiatives from initial concept through to production, working with engineering, product and business stakeholders to build scalable AI solutions. Key responsibilities will include: Leading the technical design and delivery of Generative AI and Machine Learning solutions Designing enterprise-grade LLM, RAG and AI agent architectures Building and integrating conversational,...

Lead Python Engineer £450/day Outside IR35 3-Month Contract Hybrid Working Active SC Clearance Required An experienced Lead Python Engineer is required to join a data-focused programme aimed at improving the safe use of production data within development environments. The project is centred on data anonymisation, obfuscation and sanitisation, helping to establish the tooling, governance and te click apply for full job details

AI Engineer - LLM & Agentic Systems London - Hybrid. Circa £500 - £675 per day (and negotiable DOE) Contract (Outside IR35) Mid-level, Senior & Lead. Agentic AI / Machine Learning. Company: Our client is a globally established data and information services business, operating across multiple high-value industry sectors. They have established data science and machine learning engineering teams already delivering in production, and are now expanding their AI capability significantly across the global organisation. This is a role for people who ship. If you 've built LLM-powered systems and agentic workflows that are live in production - not demos, not prototypes - and you want to do that at genuine scale, this is worth applying for. What you 'll be working on as an AI Engineer - LLM & Agentic Systems: Designing and building AI agents and agentic workflows - combining LLMs, RAG,...

Senior C# Engineer – .NET 9/10, AWS Lambda, SQS, SNS – OUTSIDE IR35 £700–£800 per day • Outside IR35 ? 100% Remote • 11-month rolling contract Takeaway: Contribute to the architecture and build of a major greenfield B2B SaaS platform as a deeply senior, hands-on C# engineer, with heavy emphasis on deep .NET engineering , high-performance distributed systems , and real-world AWS serverless delivery . You’ll also have the opportunity to develop hands-on skills with Claude Code , one of the most advanced AI-assisted development tools in the industry. Role Overview: You’ll operate as the technical spearhead for a greenfield product build, reporting to the Director of Engineering. Expect deep backend engineering, distributed system design, and high-quality serverless delivery, plus the chance to adopt modern AI-assisted development practices as part of your workflow. What You’ll Bring: Senior/Staff-level backend mastery in C# and .NET 9/10 , with...

Job Title: Project Manager - Network & Security Day Rate: £450 per day - Outside IR35/Limited Company Duration: 6 months initially Location: Central London, near Bank Station - Fully onsite Start Date: ASAP Overview We are assisting a client in their requirement for an experienced Project Manager to lead the delivery of a Cisco network and security transformation programme. As Project Manager, you will take ownership of the end-to-end delivery, coordinating technical resources, stakeholders, third parties and business teams to ensure the migration is delivered successfully with minimal disruption to production services. Key Responsibilities Own and manage the project from initiation through design, build, migration, testing, cutover and handover into BAU. Develop and maintain the overall project plan, milestones, dependencies, RAID log and delivery schedule. Coordinate the deployment of the new Cisco Secure Firewall infrastructure, including FMC HA and...

Role - Search Orchestration Developer - Agentic AI Platform Remote Role/London Rate - Upto £600/Day Outside IR35 Role & Responsibilities: Lead the design, development, and delivery of production-grade Search Orchestration services for Client Group's enterprise Agentic AI platform, leveraging hybrid retrieval, GraphRAG, reranking, and knowledge discovery. Build scalable, secure, and reusable search capabilities using Azure AI Search, Neo4j, Qdrant, BM25, Vector Search, Cross-Encoder Reranking, Python, and Azure AI Foundry. Design and implement cloud-native microservices, REST APIs, CI/CD pipelines, automated testing, monitoring, and Kubernetes-based deployments on Azure. Develop enterprise search solutions integrating Snowflake, SharePoint, Azure services, embeddings, LLMs, and hybrid search architectures to support multiple AI applications. Collaborate closely with Solution Architects, Product Owners, Data Engineers, and the Architecture Review Board to...

Data Architect - Insurance - London Market Location: London, UK Working Pattern: Hybrid - 2-3 days per week onsite Contract: Outside IR35 Rate: £450 per day Duration: Contract The Opportunity We are looking for an experienced Data Architect with strong insurance domain experience to join a major insurance organisation in London. This is a hands-on architecture role focused on designing, modernising and governing enterprise data platforms. You'll need strong SQL/PostgreSQL, data modelling, migration and data governance experience, alongside a solid understanding of insurance data and processes. Key Responsibilities Own end-to-end data architecture across transactional, analytical and reporting platforms. Design logical, conceptual and physical data models, schemas, data flows and integration patterns. Lead data migration, database modernisation and optimisation initiatives. Work closely with business stakeholders, product owners, data engineers...

Analytics Engineer l DBT Core l DBT Cloud l Bigquery l Data modelling l data warehouse l SQL l End-to-end l 6-Month Contract | £500- £520 per day | Outside IR35 l Hybrid London We 're working with a fast-moving, product-led business looking for an Analytics Engineer to support their data team on an initial 6-month contract. This is a hands-on role sitting between data engineering and analytics - building clean, reliable data models that power reporting and decision-making across the business with a strong emphasis on DBT You 'll be working closely with BI and engineering teams both onshore and offshore, owning dbt models end-to-end and helping improve data quality, performance, and overall usability. What you 'll be doing: Owning and resolving pipeline failures Building new data marts for the BI team Improving our existing data layer 's performance for BI analysis Migrating existing business semantic logic from Tableau into our dbt project...

Data Engineer: Contract | Up to £400/day outside IR35 | Hybrid, London | 6 months initial A major consumer goods business is seeking a contract Data Engineer. The programme is consolidating a fragmented estate and standardising how things are done across the group. It's early days, the team is lean and the structure is still being shaped. As a Data Engineer, you'd be building and maintaining the pipelines that take data from disparate Legacy systems across the group and get it into a shared, reliable platform, working closely with senior engineers on the wider platform direction. There's a genuine green field element here, with real support from more senior members of the team as patterns and standards continue to be established. As a contract Data Engineer you'll be competent in: Building and maintaining ETL/ELT pipelines across cloud platforms (AWS/Azure/GCP) Working with modern data stack tooling such as dbt, Airflow, Databricks or Snowflake Supporting the...

Data Engineer – Python | GCP | KAFKA | SC Clearance - £600 OUTSIDE IR35 - Remote I’m looking for an experienced Data Engineer to join a greenfield technology programme building a highly scalable data platform supporting advanced AI capabilities and maritime surveillance across the North Atlantic . You’ll join a highly autonomous engineering team taking an existing proven prototype through to a production-grade platform , ingesting and processing large volumes of complex, real-world data. 💷 Up to £600 per day, Outside IR35 💻 FULLY REMOTE 📈 Initial 6 months - scope for extension / perm ‼️ SC clearance required for this role - UK APPLICANTS ONLY The role: Design and productionise scalable, high-throughput distributed data pipelines Onboard and normalise diverse data sources into consistent, queryable schemas Build the core data foundations used by AI/ML models and agents Develop a knowledge layer allowing AI agents to read and write data...

Automation Test Engineer - eDV/UKIC Clearance Required If you do not know what eDV/UKIC is please do not apply. 12 month outside IR35 contract- 650-700 p/d. Based in London on site 5 days a week. SR2 is partnering with an exciting client looking for an Automation Test Engineer to play a key role in building quality, security and confidence into their software delivery life cycle. You'll work alongside Software Developers, DevSecOps Engineers and QA specialists to design and maintain automated testing that is Embedded directly into CI/CD pipelines. This is a hands-on role for someone who enjoys building robust automation frameworks, testing modern containerised applications and shifting quality and security left. What you'll be doing Design, build and maintain automated unit, API, integration, functional and end-to-end test suites Develop reusable and scalable test automation frameworks and libraries Test Python 3.13+ , microservices and containerised applications...

AI DevOps Engineer - Azure AI Foundry Contract Length: 6 months Location: Remote with ad-hoc travel Rate: Up to £600 per day IR35 Status: Outside IR35 Start Date: ASAP About the Client A leading global insurance organisation is investing heavily in AI and is building new AI products and services across the business. They are looking for an experienced DevOps Engineer to help establish the engineering foundations needed to deploy, automate, govern, and operate these AI solutions at enterprise scale. Role Overview This is not a traditional DevOps role. You will sit at the intersection of DevOps, software development and AI, building the CI/CD, automation, Infrastructure-as-Code and governance capabilities needed to take AI solutions from development into secure, repeatable production environments. You will work closely with AI, DevOps and Engineering teams, with a particular focus on integrating Azure AI Foundry into existing enterprise engineering...

Job Title: Project Manager - Network & Security Day Rate: £450 per day - Outside IR35 / Limited Company Duration: 6 months initially Location: Central London, near Bank Station - Fully onsite Start Date: ASAP Overview We are assisting a client in their requirement for an experienced Project Manager to lead the delivery of a Cisco network and security transformation programme. As Project Manager, you will take ownership of the end-to-end delivery, coordinating technical resources, stakeholders, third parties and business teams to ensure the migration is delivered successfully with minimal disruption to production services. Key Responsibilities Own and manage the project from initiation through design, build, migration, testing, cutover and handover into BAU. Develop and maintain the overall project plan, milestones, dependencies, RAID log and delivery schedule. Coordinate the deployment of the new Cisco Secure Firewall infrastructure, including FMC...

Job Title: Project Manager - Network & Security Day Rate: £450 per day - Outside IR35/Limited Company Duration: 6 months initially Location: Central London, near Bank Station - Fully onsite Start Date: ASAP Overview We are assisting a client in their requirement for an experienced Project Manager to lead the delivery of a Cisco network and security transformation programme. As Project Manager, you will take ownership of the end-to-end delivery, coordinating technical resources, stakeholders, third parties and business teams to ensure the migration is delivered successfully with minimal disruption to production services. Key Responsibilities Own and manage the project from initiation through design, build, migration, testing, cutover and handover into BAU. Develop and maintain the overall project plan, milestones, dependencies, RAID log and delivery schedule. Coordinate the deployment of the new Cisco Secure Firewall infrastructure, including FMC HA...

Job Title: Project Manager - Network & Security Day Rate: £450 per day - Outside IR35 / Limited Company Duration: 6 months initially Location: Central London, near Bank Station - Fully onsite Start Date: ASAP Overview We are assisting a client in their requirement for an experienced Project Manager to lead the delivery of a Cisco network and security transformation programme. As Project Manager, you will take ownership of the end-to-end delivery, coordinating technical resources, stakeholders, third parties and business teams to ensure the migration is delivered successfully with minimal disruption to production services. Key Responsibilities Own and manage the project from initiation through design, build, migration, testing, cutover and handover into BAU. Develop and maintain the overall project plan, milestones, dependencies, RAID log and delivery schedule. Coordinate the deployment of the new Cisco Secure Firewall...

Senior DevOps & Platform Automation Engineer - Outside IR35 Contract - Hybrid - London Driving Agentic AI, Ephemeral Infrastructure & Next-Generation Delivery We're seeking an experienced DevOps and Platform Automation professional to play a key role in shaping the future of engineering delivery within a rapidly evolving technology function. Working closely with the DevOps & Automation leadership team, you'll help accelerate a strategic transformation focused on intelligent automation, cloud-native engineering, self-service platforms and ephemeral environments. This role is ideal for someone who thrives on innovation, enjoys solving complex challenges at scale, and wants to influence how modern software delivery is implemented across an enterprise organisation. You'll be instrumental in advancing capabilities across platform engineering, deployment automation, observability, AI-driven operations and Infrastructure as Code, helping move the organisation toward...

At Adaptive, we are a financial consulting firm that partners with capital, commodity, and digital market participants. We value differentiation through technology. Our experienced teams design and deliver complex front-office technology solutions using our proven accelerators to create long-term competitive advantage. Our clients include the world's leading investment banks, investment managers, fintechs and capital market service providers. With a global reach with offices in London, New York, Barcelona, Manila and Montreal, we have a proven track record delivering powerful, elegant and intuitive trading technology solutions. We are now looking for PM services on an exciting project! THE INDIVIDUAL PROVIDING THE SERVICES WILL HAVE THE FOLLOWING EXPERIENCE: A strategic thinker with great communication skills A great relationship builder with the team and clients A problem-solver and team player Extensive hands-on experience of managing agile delivery projects...

At Adaptive, we are a financial consulting firm that partners with capital, commodity, and digital market participants. We value differentiation through technology. Our experienced teams design and deliver complex front-office technology solutions using our proven accelerators to create long-term competitive advantage. Our clients include the world's leading investment banks, investment managers, fintechs and capital market service providers. With a global reach with offices in London, New York, Barcelona, Manila and Montreal, we have a proven track record delivering powerful, elegant and intuitive trading technology solutions. We are now looking for PM services on an exciting project! THE INDIVIDUAL PROVIDING THE SERVICES WILL HAVE THE FOLLOWING EXPERIENCE: A strategic thinker with great communication skills A great relationship builder with the team and clients A problem-solver and team player Extensive hands-on experience of managing agile delivery...