56 lead data engineer jobs found

Lead Data Platform Engineer - Outside IR35 - 1 day pw London (rest remote) - 3 months Initially We are currently recruiting for a Lead Data Platform Engineer to join a programme focused on data platforms, analytics engineering, and modern Lakehouse solutions. The client is looking for a hands-on engineering professional with strong Microsoft Fabric, Spark, PySpark and SparkSQL expertise, capable of designing, building and supporting enterprise-scale data platforms. Start Date: ASAP Duration: 3 months Initially Pay Rate: Competitive IR35 Status: Outside IR35 Location: London (1 day per week onsite, remainder remote) The Role: The core requirement is strong Lakehouse expertise, particularly Spark, PySpark, and SparkSQL. Hands-on experience in low-code is essential. Data & Analytics Expertise: Particularly relevant to your current Data Platform background: Data architecture (Lakehouse, Medallion, Kimball, 3NF). Data ingestion and processing. Data...

2x Data Engineering Positions - Lead/Senior/Mid Outside IR35: £450 - £525 per day ASAP Start: 6 months initial contract Primarily remote: at maximum once a month travel to London We're supporting a key client in a major CRM migration programme that's looking to share the future of their growing data function. As part of this, we're looking to engage 2x Data Engineers, 1 Lead/Senior and 1 Senior/Mid level. You'll be joining at a genuinely exciting stage: the business is investing heavily in new technology and modernizing its data platform from the ground up. Rather than inheriting years of technical debt, you'll have the opportunity to influence architecture, standards, and ways of working from the beginning. Tech Stack: * Snowflake * dbt * Python * AWS * PowerBI Responsibilities: * Designing, developing, and evolving scalable Data Warehouse and ELT solutions * Driving modern DataOps practices including CI/CD, GitOps, testing, and automation * Implementing robust, observable,...

2x Data Engineering Positions - Lead/Senior/Mid Outside IR35: £450 - £525 per day ASAP Start: 6 months initial contract Primarily remote: at maximum once a month travel to London We're supporting a key client in a major CRM migration programme that's looking to share the future of their growing data function. As part of this, we're looking to engage 2x Data Engineers, 1 Lead/Senior and 1 Senior/Mid level. You'll be joining at a genuinely exciting stage: the business is investing heavily in new technology and modernizing its data platform from the ground up. Rather than inheriting years of technical debt, you'll have the opportunity to influence architecture, standards, and ways of working from the beginning. Tech Stack: * Snowflake * dbt * Python * AWS * PowerBI Responsibilities: * Designing, developing, and evolving scalable Data Warehouse and ELT solutions * Driving modern DataOps practices including CI/CD, GitOps, testing, and automation * Implementing robust,...

We are currently looking for an experienced Microsoft Fabric Data Architect / Lead for an Outside IR35 contract opportunity. Location: Manchester.   Working arrangement: Hybrid – two days per week in the Manchester office Contract : Outside IR35   The client requires a senior Microsoft Fabric specialist who can assess the current environment, strengthen its architecture and governance, implement practical improvements, and build a well-controlled and sustainable internal capability.   The successful individual will evaluate what is currently in place, define the target environment, implement the necessary improvements and support the development of the internal team. The anticipated scope includes: • Reviewing the existing Microsoft Fabric environment, data lake and associated datasets • Assessing the current architecture and identifying technical, governance and control gaps • Reviewing how data is acquired,...

Principal Control Engineer Duration: 12-months Rate: £80 - £100 per hour (outside IR35) Location: Remote Our client is a leading engineering and design consultancy who specialise in providing services to the engineering sector. As a Principal Control/SCS/SCADA Engineer you will be working on engineering and construction projects primarily in industrial, transmission/distribution and renewable sectors. You must be able to appreciate complex, practical, regulatory, technical and commercial issues and to work constructively with a broad range of senior stakeholders. Role accountabilities: • Responsible for the design of transmission substation Control/SCS/SCADA systems for voltages up to 400 kV. • Reviewing in-house designs and those produced by external contractors. • Responsible for delivering tender design man-hours estimates, deliverables lists, design programs. • Leading and guiding junior engineers through various Control/SCS/SCADA engineering tasks by...

AI Technical Lead | Generative AI & Machine Learning 12-Month Contract | £500 - £700 per day | Outside IR35 | London 167 Solutions is working with an organisation looking to appoint an experienced AI Technical Lead to lead the design and delivery of production-ready Generative AI and Machine Learning solutions. This is a hands-on technical leadership role for someone who can operate across AI strategy, architecture and engineering , while still being comfortable getting involved in the technology. The Role You will take technical ownership of AI initiatives from initial concept through to production, working with engineering, product and business stakeholders to build scalable AI solutions. Key responsibilities will include: Leading the technical design and delivery of Generative AI and Machine Learning solutions Designing enterprise-grade LLM, RAG and AI agent architectures Building and integrating conversational,...

Lead Python Engineer £525/day Outside IR35 3-Month Contract Hybrid Working Active SC Clearance Required An experienced Lead Python Engineer is required to join a data-focused programme aimed at improving the safe use of production data within development environments. The project is centred on data anonymisation, obfuscation and sanitisation, helping to establish the tooling, governance and technical standards needed to support secure software delivery. This is a hands-on leadership role for an engineer who can combine strong Python development skills with stakeholder engagement, technical governance and architectural influence. Working within a small delivery team, you will play a key role in both technical delivery and the wider adoption of best practices across multiple stakeholders. Responsibilities Lead development and enhancement of Python-based tooling. Remain actively involved in software engineering and delivery. Engage with governance forums and...

Lead Python Engineer £450/day Outside IR35 3-Month Contract Hybrid Working Active SC Clearance Required An experienced Lead Python Engineer is required to join a data-focused programme aimed at improving the safe use of production data within development environments. The project is centred on data anonymisation, obfuscation and sanitisation, helping to establish the tooling, governance and te click apply for full job details

AI Engineer - LLM & Agentic Systems London - Hybrid. Circa £500 - £675 per day (and negotiable DOE) Contract (Outside IR35) Mid-level, Senior & Lead. Agentic AI / Machine Learning. Company: Our client is a globally established data and information services business, operating across multiple high-value industry sectors. They have established data science and machine learning engineering teams already delivering in production, and are now expanding their AI capability significantly across the global organisation. This is a role for people who ship. If you 've built LLM-powered systems and agentic workflows that are live in production - not demos, not prototypes - and you want to do that at genuine scale, this is worth applying for. What you 'll be working on as an AI Engineer - LLM & Agentic Systems: Designing and building AI agents and agentic workflows - combining LLMs, RAG,...

Senior C# Engineer – .NET 9/10, AWS Lambda, SQS, SNS – OUTSIDE IR35 £700–£800 per day • Outside IR35 ? 100% Remote • 11-month rolling contract Takeaway: Contribute to the architecture and build of a major greenfield B2B SaaS platform as a deeply senior, hands-on C# engineer, with heavy emphasis on deep .NET engineering , high-performance distributed systems , and real-world AWS serverless delivery . You’ll also have the opportunity to develop hands-on skills with Claude Code , one of the most advanced AI-assisted development tools in the industry. Role Overview: You’ll operate as the technical spearhead for a greenfield product build, reporting to the Director of Engineering. Expect deep backend engineering, distributed system design, and high-quality serverless delivery, plus the chance to adopt modern AI-assisted development practices as part of your workflow. What You’ll Bring: Senior/Staff-level backend mastery in C# and .NET 9/10 , with...

Senior Software Engineer - Rust & Python - any Ruby OR Java a bonus. 100% remote. £600-£650/day OUTSIDE IR35. 12 MONTH CONTRACT We are seeking an experienced Software Engineer to help build and evolve Back End services. You will also play a key role in modernising our engineering ecosystem by helping decommission Legacy Rails components, migrating data models into modern services, and establishing new sources of truth across CLIENTS platform. KEY SKILLS ARE RUST, PYTHON & ANY RUBY, JAVA & API's A BONUS! This is a hands-on engineering role requiring deep expertise with Rust & Python and have experience to build high-performance, scalable Back End systems. YOU MUST BE AN EXPERT IN RUST & PYTHON. Any API's (REST OR GRAPHGL) & Ruby On Rails OR JAVA a big bonus but not essential. Key Deliverables Build and enhance Back End services that reduce operational costs through automation and process optimisation. Develop scalable Rust & Python-based services...

Principal Data Engineer (AWS) - Contract, Outside IR35 £650 per day | Outside IR35 | 3-Month Contract (13 weeks) | Remote UK - very occasional travel to Leeds Brio Digital is working with a major UK organisation embarking on a strategic data transformation programme to modernise a business-critical operational platform. The project replaces manual, spreadsheet-driven processes with a scalable, cloud-native AWS solution that automates high-volume invoicing and operational workflows used across the business. This is a greenfield MVP with a clear roadmap to expand into a significantly larger programme. What you'll be doing Owning the Low Level Design, data models, data flows, AWS services, security controls, IAM model, encryption and secrets management, observability, DR, integration patterns and CI/CD approach Leading technical delivery of the MVP and setting the engineering standards the build follows Building scalable serverless data pipelines, APIs and...

Senior C# Engineer - .NET 9/10, AWS Lambda, SQS, SNS - OUTSIDE IR35 £700-£800 per day Outside IR35 - 100% Remote 11-month rolling contract Takeaway: Contribute to the architecture and build of a major greenfield B2B SaaS platform as a deeply senior, hands-on C# engineer, with heavy emphasis on deep .NET engineering , high-performance distributed systems , and real-world AWS serverless delivery . You'll also have the opportunity to develop hands-on skills with Claude Code , one of the most advanced AI-assisted development tools in the industry. Role Overview: You'll operate as the technical spearhead for a greenfield product build, reporting to the Director of Engineering. Expect deep Back End engineering, distributed system design, and high-quality serverless delivery, plus the chance to adopt modern AI-assisted development practices as part of your workflow. What You'll Bring: Senior/Staff-level Back End mastery in C# and .NET 9/10 , with the ability...

QA Automation Engineer QA Automation Engineer - End to End Hybrid - 3 Days on-site 400-500 per day (outside of IR35) Technology & Data Shape the future of AI-powered quality engineering. We're working with an organisation that's embracing AI to transform the way software is tested and delivered. As they continue to invest in automation and engineering excellence, they're looking for an experienced QA Automation Engineer to help lead the next generation of test automation. This is more than a traditional QA role. You'll be responsible for building robust, end-to-end automated test coverage across complex applications, data pipelines and reporting layers, while using the latest AI-assisted development tools to improve quality, speed and efficiency. Working closely with software engineers, data teams and product stakeholders, you'll play a key role in embedding quality throughout the development lifecycle and helping shape how AI is used within modern software...

📄 Job Description: Salesforce DevOps Engineer (Contract – Outside IR35) Role: Salesforce DevOps Engineer Contract Type: Outside IR35 Location: Remote / Hybrid (UK) Duration: 6–12 months (with possible extension) Start Date: Immediate / ASAP 🔧 Role Overview We are seeking an experienced Salesforce DevOps Engineer to support and enhance our multi-cloud Salesforce delivery pipeline. The ideal contractor will have strong expertise in source-driven development , CI/CD automation , environment management , and release governance across complex Salesforce landscapes (Sales, Service, CPQ, Experience Cloud, custom domains). The role focuses on ensuring high-quality, scalable, and auditable deployments , working closely with engineering leads, architects, QA, and product teams. 🛠 Key Responsibilities DevOps & CI/CD Automation Design, implement, and maintain CI/CD pipelines using tools such as Copado , Gearset , GitHub Actions ,...

Technical Delivery Manager Location: Central London (4 days on-site / 1 day remote) Rate: £500 - £550 per day - Outside IR35 Employment Type: Contract Clearance Requirement: Active DV Clearance (Sole UK Nationals only) About the Role We are seeking an experienced Technical Delivery Manager to join a pioneering team working on one of the UK's most significant AI initiatives within the Defence sector. In this role, you will be pivotal in driving the delivery of mission-critical systems built on a cutting-edge technical stack. Working closely with cross-functional engineering teams, product managers, and key stakeholders, you will ensure complex, high-stakes software solutions are delivered predictably, securely, and at pace. Key Responsibilities Technical Delivery & Agile Leadership: Lead agile delivery across multiple engineering workstreams, driving sprint planning, daily stand-ups, backlog refinement, and retrospectives. Architecture & Engineering...

Job Information Date Opened 25/08/2026 Job Type Contract Industry IT Services Work Experience 5+ years Salary £400 - £425 Outside IR35 City London Province Greater London Country United Kingdom Postal Code E14 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. With a strong commitment to user-centred design and agile delivery, we continue to build innovative digital services that truly make a difference. Role Purpose We are looking for an experienced Backend Developer to design, build, and maintain scalable, secure server-side services and APIs, while contributing to the adoption of Agentic AI capabilities within our engineering platform. The role sits at SFIA...

Job Information Date Opened 25/08/2026 Job Type Contract Industry IT Services Work Experience 5+ years Salary £400 - £425 Outside IR35 City London Province Greater London Country United Kingdom Postal Code E14 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. With a strong commitment to user-centred design and agile delivery, we continue to build innovative digital services that truly make a difference. Role Purpose We are looking for an experienced Backend Developer to design, build, and maintain scalable, secure server-side services and APIs, while contributing to the adoption of Agentic AI capabilities within our engineering platform. The role sits at SFIA...

Role overview We are seeking Senior Data Engineers to join a delivery team supporting a major financial-services client's Data Strategy implementation. You will be onsite 4 days a week 1 day remote. Outside IR35 You will design, build, test and deploy data-engineering features, including onboarding new data sources and migrating existing ETL processes from Azure Data Factory and Azure Data Lake Storage to Microsoft Fabric. Responsibilities Enhance an existing metadata-driven ADF ingestion framework to onboard new data sources. Develop incremental load processes, watermarks, merge logic and ingestion mappings. Migrate ETL processes from ADF and ADLS to Microsoft Fabric Pipelines. Integrate Fabric Pipelines through On-Premises Data Gateways. Build parameterised templates and reusable Fabric deployment patterns. Produce and maintain source-to-target data mappings and technical specifications. Promote build artefacts through DEV, TEST, UAT and PROD using established...

Technical Delivery Manager Location: Central London (4 days on-site/1 day remote) Rate: £500 - £550 per day - Outside IR35 Employment Type: Contract Clearance Requirement: Active DV Clearance (Sole UK Nationals only) About the Role We are seeking an experienced Technical Delivery Manager to join a pioneering team working on one of the UK's most significant AI initiatives within the Defence sector. In this role, you will be pivotal in driving the delivery of mission-critical systems built on a cutting-edge technical stack. Working closely with cross-functional engineering teams, product managers, and key stakeholders, you will ensure complex, high-stakes software solutions are delivered predictably, securely, and at pace. Key Responsibilities Technical Delivery & Agile Leadership: Lead agile delivery across multiple engineering workstreams, driving sprint planning, daily stand-ups, backlog refinement, and retrospectives. Architecture & Engineering...