31 lead data engineer jobs found in London, greater london

Lead Data Engineer (Azure Synapse | Synapse Notebooks | Azure DevOps) Contract 6-month initial term, with strong likelihood of extension Up to c £500 per day Outside IR35 Remote or hybrid (West London office if preferred) We are looking for an experienced Lead Data Engineer to play a key role in the development of a modern Azure data platform, with a strong focus on Azure Synapse, Synapse notebooks and engineering best practice . This is a hands-on technical leadership role for someone who enjoys owning solutions from requirements through to deployment, working closely with business stakeholders and delivering robust, production-grade data platforms. You will be responsible for: Designing and developing scalable ETL/ELT pipelines and reusable data products Building and maintaining Azure Synapse solutions, with particular emphasis on Synapse notebooks, Serverless SQL and Synapse pipelines...

Lead Data Engineer (Azure Synapse | Azure DevOps | CI/CD) Contract 6 months initial term, extension likely Up to c£500 per day outside IR35 Can be remote or hybrid as preferred - West London office We're looking for a hands-on Lead Data Engineer to help shape and deliver a modern Azure data platform, with a particular focus on Azure Synapse and engineering best practice. This role would suit someone who enjoys solving complex data challenges, building robust and governed solutions, and acting as a technical lead across both engineering teams and business stakeholders. You'll be responsible for: Designing and developing enterprise-scale ETL/ELT pipelines and reusable data products Building and maintaining Azure Synapse solutions, including Serverless SQL, Synapse notebooks and Synapse pipelines Designing and implementing CI/CD pipelines and release processes using Azure DevOps Developing scalable data warehouse and lakehouse...

Senior C# Engineer – .NET 8/9, AWS Lambda, SQS, SNS – OUTSIDE IR35 £700–£800/day • 100% Remote • 11-month rolling contract Takeaway: Lead the architecture and build of a greenfield SaaS platform as a deeply senior, hands-on C# engineer, with heavy emphasis on deep .NET engineering , high-performance distributed systems , and real-world AWS serverless delivery . You’ll also have the opportunity to develop hands-on skills with Claude Code , one of the most advanced AI-assisted development tools in the industry. Role Overview: You’ll operate as the technical spearhead for a greenfield product build, reporting to the Director of Engineering. Expect deep backend engineering, distributed system design, and high-quality serverless delivery, plus the chance to adopt modern AI-assisted development practices as part of your workflow. What You’ll Bring: Senior/Staff-level backend mastery in C# and .NET 8/9 , with the ability to architect and lead...

Join a forward-thinking organisation where your Microsoft security expertise will drive meaningful improvements in cyber security capability and maturity. Salary: £500 - 550 per day Security Engineer Security Engineer with strong expertise across the Microsoft security stack, including proven experience implementing Purview, who enjoys working in lean, evolving cyber security functions and can drive meaningful improvements in security capability and maturity. Day Rate: £500-£550pd IR35 Status: Outside Travel: 3 days a week in Central London Office Duration: 6 months initial Responsibilities: Lead the design, implementation, and optimisation of the Microsoft security ecosystem, including Defender, Entra ID, Sentinel, Intune, and Purview Deliver end to end Purview implementations, including Information Protection, Data Loss Prevention, Data Lifecycle Management, Insider Risk Management, and compliance solutions across Microsoft 365 Work closely with IT,...

Security Engineer Security Engineer with strong expertise across the Microsoft security stack, including proven experience implementing Purview, who enjoys working in lean, evolving cyber security functions and can drive meaningful improvements in security capability and maturity. Day Rate: £500-£550pd IR35 Status: Outside Travel: 3 days a week in Central London Office Duration: 6 months initial Responsibilities: Lead the design, implementation, and optimisation of the Microsoft security ecosystem, including Defender, Entra ID, Sentinel, Intune, and Purview. Deliver end to end Purview implementations, including Information Protection, Data Loss Prevention, Data Lifecycle Management, Insider Risk Management, and compliance solutions across Microsoft 365. Work closely with IT, infrastructure, and business stakeholders to deploy security controls, respond to emerging threats, and ensure compliance with organisational and regulatory requirements. Bring proven...

AI Engineer - LLM & Agentic Systems London - Hybrid. Circa £550 – £650 per day (negotiable DOE) Contract (Outside IR35) Agentic AI / Machine Learning. Company: Our client is a globally established B2B information and professional services business, operating across multiple high-value industry sectors. They have established data science and machine learning engineering teams already delivering in production, and are now expanding their AI capability significantly across the global organisation. This is a role for people who ship. If you've built LLM-powered systems and agentic workflows that are live in production - not demos, not prototypes - and you want to do that at genuine scale, this is worth applying for. What you'll be working on as an AI Engineer - LLM & Agentic Systems: Designing and building AI agents and agentic workflows - combining LLMs, RAG, reasoning, memory and tool orchestration to solve real, complex business...

Lead Backend Software Engineer – Data Services Federated Data Services | Distributed Systems | Apache Spark | DataFusion | Python | Kubernetes Location: London (2 days per week onsite) Rate: £700–£800 per day (Outside IR35) Duration: Initial 6-month contract with likely extension Overview We're looking for an experienced Lead Backend Software Engineer to join a high-profile programme building secure, cloud-native data services that will support data-driven research and innovation at national scale. This is a founding engineering role, offering the opportunity to shape the architecture, engineering standards, and core data services from the ground up. Working closely with the Engineering Manager and a small team of senior engineers, you'll establish the technical foundations for a complex federated data platform operating within a highly regulated environment. We're looking for someone who enjoys building from first principles, thrives in ambiguity, and...

Senior C# Engineer (AI-Native & Agentic Engineering) .NET 8/9 • AWS Lambda/SQS • OUTSIDE IR35  £700–£800/day • 100% Remote (UK) • 11-months rolling If you’re a deeply senior C# engineer who wants to actually build something new, not maintain legacy, not refactor someone else’s mess, this is one of the few roles in the market worth stopping for. You’ll be the technical spearhead for a greenfield SaaS platform, reporting directly to the Director of Engineering and shaping everything from architecture to AI-native delivery patterns. This is high-autonomy, high-impact work for someone who thrives in ambiguity and loves solving hard problems at pace. Why this role stands out: You set the engineering bar, not follow it. You get to embed agentic AI workflows into real production systems. You own outcomes end-to-end, not just “tickets”. You influence product direction without layers of process or ceremony. What You’ll Bring:...

Lead Backend Software Engineer - Data Services Federated Data Services | Distributed Systems | Apache Spark | DataFusion | Python | Kubernetes Location: London (2 days per week onsite) Rate: £700-£800 per day (Outside IR35) Duration: Initial 6-month contract with likely extension Overview We're looking for an experienced Lead Backend Software Engineer to join a high-profile programme building secure, cloud-native data services that will support data-driven research and innovation at national scale. This is a founding engineering role, offering the opportunity to shape the architecture, engineering standards, and core data services from the ground up. Working closely with the Engineering Manager and a small team of senior engineers, you'll establish the technical foundations for a complex federated data platform operating within a highly regulated environment. We're looking for someone who enjoys building from first principles, thrives in ambiguity, and can balance...

Lead Backend Software Engineer - Data Services Federated Data Services | Distributed Systems | Apache Spark | DataFusion | Python | Kubernetes Location: London (2 days per week onsite) Rate: £700 - £800 per day (Outside IR35) Duration: Initial 6-month contract with likely extension Overview We 're looking for an experienced Lead Backend Software Engineer to join a high-profile programme building secure, cloud-native data services that will support data-driven research and innovation at national scale. This is a founding engineering role, offering the opportunity to shape the architecture, engineering standards, and core data services from the ground up. Working closely with the Engineering Manager and a small team of senior engineers, you 'll establish the technical foundations for a complex federated data platform operating within a highly regulated environment. We 're looking for someone who enjoys building from first principles, thrives in...

We are currently looking for an experience Principal Engineer to join us on a contract basis. This is a hybrid position and will require 3 days per week on client site in Central London. Requirements Role responsibilities:   Define and drive technical strategy, architecture, and engineering standards across the Personalisation domain Design and deliver scalable systems supporting personalisation, search, recommendations, and ML-powered features Partner closely with Product, Data Science, and Design to deliver customer-centric solutions Lead and influence technical decision-making across multiple teams and platforms Mentor and support senior engineers, helping to raise the overall engineering capability Improve engineering quality, reliability, and productivity through best practices, tooling, and platform enhancemen   Who you are:   An experienced technical leader with a strong background in Java/Python and...

AI Transformation Lead (Data Centre Engineering) Open day rate - Outside IR35 - negotiable London - Hybrid We’re working with a data center construction business backed by long-term capital, looking to embed AI into the core of how they design, engineer, and deliver projects .This is not experimentation. This is about applying AI to real engineering workflows that already exist at scale. Their teams are some of the strongest engineering profiles in the market, working across CAD, BIM, and GIS environments. The opportunity is to fundamentally change how those teams operate. The role This is a senior, standalone hire reporting directly into the Managing Partner. You will define and lead how AI is introduced into the engineering lifecycle. Embed AI into CAD, BIM, and GIS driven workflows Identify and prioritise practical use cases across design, engineering, and delivery Reduce design time, error rates, and rework across projects Translate AI capability into...

An experienced Microsoft Sentinel SME is required to support a major security transformation programme within a large enterprise environment. The successful consultant will take ownership of the Microsoft Sentinel platform, helping to improve detection capabilities, optimise existing configurations, develop new use cases, and enhance the organisation's overall security monitoring and response capabilities. This role would suit a hands-on Security Engineer, Detection Engineer, SIEM Engineer, or Security Operations specialist with deep Microsoft security expertise and extensive experience working with Sentinel in complex enterprise environments. Key Responsibilities Act as the technical lead and subject matter expert for Microsoft Sentinel Review and optimise existing Sentinel deployments, analytics rules, and workbooks Design, build, and tune threat-detection use cases aligned with current threats Develop advanced KQL queries for monitoring, threat hunting, and...

A leading financial services organisation is seeking an experienced Microsoft Security Engineer to join a high-profile cybersecurity programme. This role will focus on the design, implementation, integration, and optimisation of security solutions across the Microsoft security ecosystem. The successful consultant will have a proven track record of engineering enterprise-grade security solutions using Microsoft technologies and will be comfortable working across identity, endpoint, cloud, data, and security operations domains. This is a hands-on engineering role rather than a pure operational or analyst position. Key Responsibilities Design, implement, and optimise security controls across the Microsoft security stack. Engineer solutions leveraging Microsoft Defender, Microsoft Sentinel, Entra ID, and Azure security services. Lead the deployment and integration of security technologies across cloud and hybrid environments. Configure and enhance security monitoring,...

Senior C# Engineer (AI-Native & Agentic Engineering) – .NET 8/9, AWS Lambda/SQS – OUTSIDE IR35 £750–£800/day • 100% Remote • 11-month rolling contract A rare opportunity to lead the build of a greenfield SaaS product as a deeply senior, hands-on C# engineer. Reporting directly to the Director of Engineering, you’ll operate as the technical spearhead; shaping architecture, driving AI-native engineering patterns, and delivering complex distributed systems at pace. We’re looking for someone who is product-centric, agentic-minded, and thrives in ambiguity . If you enjoy solving hard problems, owning outcomes end-to-end, and setting the engineering bar for others, this one’s for you. What You’ll Bring: Senior/Staff-level backend engineering depth in C# and .NET 8/9 , with the ability to architect and lead distributed REST microservices at scale. Strong authority in AWS serverless : Lambda-first, with hands-on experience across API Gateway, SQS, Step...

Microsoft Security Consultant - 6 Month Contract - Outside IR35 - Fully remote Contract Type: Initial 6 month contract (Outside IR35) Rate: £450 per day Outside IR35 Location: Fully Remote Role Overview We are looking for a Microsoft Security Consultant to join on a contract basis, bringing deep expertise across Microsoft Sentinel, Defender XDR, and Azure security. The role combines hands-on technical delivery with trusted advisory work - designing and implementing enterprise-grade detection and response architectures, driving Zero Trust initiatives, and translating complex security requirements into practical, scalable solutions. Key Responsibilities Architect and deliver Microsoft Defender XDR solutions, running architecture and design workshops to define end-to-end security strategies aligned with Zero Trust and secure-by-design principles Lead Microsoft Sentinel implementations including data connector configuration, KQL analytics rule...

This role is delivered within secure environments. Candidates must be eligible for UK SC and DV clearance and hold UK citizenship. Opening: Join the Mission At ByDesign Secure, we believe that world-class security shouldn't be an afterthought—it should be the foundation. We are an independent, outputs-based consultancy dedicated to solving the most complex data assurance challenges in the UK public sector. Currently, we working on a landmark transformation of a cross-government secure IT system. This is an exciting opportunity to help architect a private cloud environment from the ground up and modernize the end-user services that power national decision-making. We don't believe in ʺbilling by the hourʺ or rigid hierarchies; we are a lean, expert team focused on delivering high-impact technical outcomes. If you are a self-starter who thrives on autonomy and wants to see your engineering or architectural decisions shape the future of sovereign security, we want to talk to you....

This role is delivered within secure environments. Candidates must be eligible for UK SC and DV clearance and hold UK Citizenship. Opening: Join the Mission At ByDesign Secure, we believe that world-class security shouldn't be an afterthought—it should be the foundation. We are an independent, outputs-based consultancy dedicated to solving the most complex data assurance challenges in the UK public sector. Currently, we are working on a landmark transformation of a cross-government secure IT system. This is an exciting opportunity to help architect a private cloud environment from the ground up and modernize the end-user services that power national decision-making. We don't believe in ʺbilling by the hourʺ or rigid hierarchies; we are a lean, expert team focused on delivering high-impact technical outcomes. If you are a self-starter who thrives on autonomy and wants to see your engineering or architectural decisions shape the future of sovereign security, we want to talk to...

Join a tech-driven financial services business as a GCP Data Engineer and help turn complex data into valuable business insights. Salary: £550 per day GCP Data Engineer - Financial Services - Outside IR35 - Hybrid We're looking for an experienced GCP Data Engineer to join a tech-driven financial services business on an initial 3-month contract basis (extension likely, Outside IR35). You'll join a small, high-performing data team responsible for ingesting and processing large volumes of customer data, allowing the business to draw actionable business insights. Reporting into the Head of Data, you'll bring strong commercial experience with Google Cloud Platform (GCP), alongside expertise in DBT for data transformation, data modelling, and building robust ETL/ELT pipelines. This is a highly technical engineering role where you'll play a key part in designing, developing, and optimising scalable data solutions. Location: Remote first, 1 day per week in South West London or...

Full job description Join a tech-driven financial services business as a GCP Data Engineer and help turn complex data into valuable business insights. Salary:  £550 per day GCP Data Engineer - Financial Services - Outside IR35 - Hybrid We're looking for an experienced GCP Data Engineer to join a tech-driven financial services business on an initial 3-month contract basis (extension likely, Outside IR35). You'll join a small, high-performing data team responsible for ingesting and processing large volumes of customer data, allowing the business to draw actionable business insights. Reporting into the Head of Data, you'll bring strong commercial experience with Google Cloud Platform (GCP), alongside expertise in DBT for data transformation, data modelling, and building robust ETL/ELT pipelines. This is a highly technical engineering role where you'll play a key part in designing, developing, and optimising scalable data solutions. Location:...