13 lead data engineer jobs found

2x Data Engineering Positions - Lead/Senior/Mid Outside IR35: £450 - £525 per day ASAP Start: 6 months initial contract Primarily remote: at maximum once a month travel to London We're supporting a key client in a major CRM migration programme that's looking to share the future of their growing data function. As part of this, we're looking to engage 2x Data Engineers, 1 Lead/Senior and 1 Senior/Mid level. You'll be joining at a genuinely exciting stage: the business is investing heavily in new technology and modernizing its data platform from the ground up. Rather than inheriting years of technical debt, you'll have the opportunity to influence architecture, standards, and ways of working from the beginning. Tech Stack: * Snowflake * dbt * Python * AWS * PowerBI Responsibilities: * Designing, developing, and evolving scalable Data Warehouse and ELT solutions * Driving modern DataOps practices including CI/CD, GitOps, testing, and automation * Implementing robust, observable,...

2x Data Engineering Positions - Lead/Senior/Mid Outside IR35: £450 - £525 per day ASAP Start: 6 months initial contract Primarily remote: at maximum once a month travel to London We're supporting a key client in a major CRM migration programme that's looking to share the future of their growing data function. As part of this, we're looking to engage 2x Data Engineers, 1 Lead/Senior and 1 Senior/Mid level. You'll be joining at a genuinely exciting stage: the business is investing heavily in new technology and modernizing its data platform from the ground up. Rather than inheriting years of technical debt, you'll have the opportunity to influence architecture, standards, and ways of working from the beginning. Tech Stack: * Snowflake * dbt * Python * AWS * PowerBI Responsibilities: * Designing, developing, and evolving scalable Data Warehouse and ELT solutions * Driving modern DataOps practices including CI/CD, GitOps, testing, and automation * Implementing robust,...

Job Information Date Opened 26/08/2026 Job Type Contract Industry IT Services Work Experience 5+ years Salary £475 - £500 Outside IR35 City London Province Greater London Country United Kingdom Postal Code EC1A Job Description About Scrumconnect Consulting:   Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. With a strong commitment to user-centred design and agile delivery, and more to deliver innovative digital services that matter   Preferred Tech Stack Expertise Cloud Infrastructure : AWS (EKS, RDS, Aurora, ElastiCache, Kafka, IAM) Secure Hosting : Experience working with air-gapped or government-secure environments Container & Cluster Management : Docker,...

AI Technical Lead | Generative AI & Machine Learning 12-Month Contract | £500 - £700 per day | Outside IR35 | London 167 Solutions is working with an organisation looking to appoint an experienced AI Technical Lead to lead the design and delivery of production-ready Generative AI and Machine Learning solutions. This is a hands-on technical leadership role for someone who can operate across AI strategy, architecture and engineering , while still being comfortable getting involved in the technology. The Role You will take technical ownership of AI initiatives from initial concept through to production, working with engineering, product and business stakeholders to build scalable AI solutions. Key responsibilities will include: Leading the technical design and delivery of Generative AI and Machine Learning solutions Designing enterprise-grade LLM, RAG and AI agent architectures Building and integrating conversational,...

Technical Delivery Manager Location: Central London (4 days on-site / 1 day remote) Rate: £500 - £550 per day - Outside IR35 Employment Type: Contract Clearance Requirement: Active DV Clearance (Sole UK Nationals only) About the Role We are seeking an experienced Technical Delivery Manager to join a pioneering team working on one of the UK's most significant AI initiatives within the Defence sector. In this role, you will be pivotal in driving the delivery of mission-critical systems built on a cutting-edge technical stack. Working closely with cross-functional engineering teams, product managers, and key stakeholders, you will ensure complex, high-stakes software solutions are delivered predictably, securely, and at pace. Key Responsibilities Technical Delivery & Agile Leadership: Lead agile delivery across multiple engineering workstreams, driving sprint planning, daily stand-ups, backlog refinement, and retrospectives. Architecture & Engineering...

Job Information Date Opened 25/08/2026 Job Type Contract Industry IT Services Work Experience 5+ years Salary £400 - £425 Outside IR35 City London Province Greater London Country United Kingdom Postal Code E14 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. With a strong commitment to user-centred design and agile delivery, we continue to build innovative digital services that truly make a difference. Role Purpose We are looking for an experienced Backend Developer to design, build, and maintain scalable, secure server-side services and APIs, while contributing to the adoption of Agentic AI capabilities within our engineering platform. The role sits at SFIA...

Job Information Date Opened 25/08/2026 Job Type Contract Industry IT Services Work Experience 5+ years Salary £400 - £425 Outside IR35 City London Province Greater London Country United Kingdom Postal Code E14 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. With a strong commitment to user-centred design and agile delivery, we continue to build innovative digital services that truly make a difference. Role Purpose We are looking for an experienced Backend Developer to design, build, and maintain scalable, secure server-side services and APIs, while contributing to the adoption of Agentic AI capabilities within our engineering platform. The role sits at SFIA...

Role overview We are seeking Senior Data Engineers to join a delivery team supporting a major financial-services client's Data Strategy implementation. You will be onsite 4 days a week 1 day remote. Outside IR35 You will design, build, test and deploy data-engineering features, including onboarding new data sources and migrating existing ETL processes from Azure Data Factory and Azure Data Lake Storage to Microsoft Fabric. Responsibilities Enhance an existing metadata-driven ADF ingestion framework to onboard new data sources. Develop incremental load processes, watermarks, merge logic and ingestion mappings. Migrate ETL processes from ADF and ADLS to Microsoft Fabric Pipelines. Integrate Fabric Pipelines through On-Premises Data Gateways. Build parameterised templates and reusable Fabric deployment patterns. Produce and maintain source-to-target data mappings and technical specifications. Promote build artefacts through DEV, TEST, UAT and PROD using established...

Technical Delivery Manager Location: Central London (4 days on-site/1 day remote) Rate: £500 - £550 per day - Outside IR35 Employment Type: Contract Clearance Requirement: Active DV Clearance (Sole UK Nationals only) About the Role We are seeking an experienced Technical Delivery Manager to join a pioneering team working on one of the UK's most significant AI initiatives within the Defence sector. In this role, you will be pivotal in driving the delivery of mission-critical systems built on a cutting-edge technical stack. Working closely with cross-functional engineering teams, product managers, and key stakeholders, you will ensure complex, high-stakes software solutions are delivered predictably, securely, and at pace. Key Responsibilities Technical Delivery & Agile Leadership: Lead agile delivery across multiple engineering workstreams, driving sprint planning, daily stand-ups, backlog refinement, and retrospectives. Architecture & Engineering...

Data Architect - Insurance - London Market Location: London, UK Working Pattern: Hybrid - 2-3 days per week onsite Contract: Outside IR35 Rate: £450 per day Duration: Contract The Opportunity We are looking for an experienced Data Architect with strong insurance domain experience to join a major insurance organisation in London. This is a hands-on architecture role focused on designing, modernising and governing enterprise data platforms. You'll need strong SQL/PostgreSQL, data modelling, migration and data governance experience, alongside a solid understanding of insurance data and processes. Key Responsibilities Own end-to-end data architecture across transactional, analytical and reporting platforms. Design logical, conceptual and physical data models, schemas, data flows and integration patterns. Lead data migration, database modernisation and optimisation initiatives. Work closely with business stakeholders, product owners, data engineers...

Analytics Engineer l DBT Core l DBT Cloud l Bigquery l Data modelling l data warehouse l SQL l End-to-end l 6-Month Contract | £500- £520 per day | Outside IR35 l Hybrid London We 're working with a fast-moving, product-led business looking for an Analytics Engineer to support their data team on an initial 6-month contract. This is a hands-on role sitting between data engineering and analytics - building clean, reliable data models that power reporting and decision-making across the business with a strong emphasis on DBT You 'll be working closely with BI and engineering teams both onshore and offshore, owning dbt models end-to-end and helping improve data quality, performance, and overall usability. What you 'll be doing: Owning and resolving pipeline failures Building new data marts for the BI team Improving our existing data layer 's performance for BI analysis Migrating existing business semantic logic from Tableau into our dbt project...

Job Title: Project Manager - Network & Security Day Rate: £450 per day - Outside IR35/Limited Company Duration: 6 months initially Location: Central London, near Bank Station - Fully onsite Start Date: ASAP Overview We are assisting a client in their requirement for an experienced Project Manager to lead the delivery of a Cisco network and security transformation programme. As Project Manager, you will take ownership of the end-to-end delivery, coordinating technical resources, stakeholders, third parties and business teams to ensure the migration is delivered successfully with minimal disruption to production services. Key Responsibilities Own and manage the project from initiation through design, build, migration, testing, cutover and handover into BAU. Develop and maintain the overall project plan, milestones, dependencies, RAID log and delivery schedule. Coordinate the deployment of the new Cisco Secure Firewall infrastructure, including FMC HA...

Job Title: Project Manager - Network & Security Day Rate: £450 per day - Outside IR35 / Limited Company Duration: 6 months initially Location: Central London, near Bank Station - Fully onsite Start Date: ASAP Overview We are assisting a client in their requirement for an experienced Project Manager to lead the delivery of a Cisco network and security transformation programme. As Project Manager, you will take ownership of the end-to-end delivery, coordinating technical resources, stakeholders, third parties and business teams to ensure the migration is delivered successfully with minimal disruption to production services. Key Responsibilities Own and manage the project from initiation through design, build, migration, testing, cutover and handover into BAU. Develop and maintain the overall project plan, milestones, dependencies, RAID log and delivery schedule. Coordinate the deployment of the new Cisco Secure Firewall...