44 data engineering lead jobs found in London

Finance Transformation Director - Interim Location: Ealing / Hybrid Salary: £Competitive Day Rate (Outside IR35) Contract type: Interim / Fixed Term (12-18 months) Lead a major finance and procurement transformation at pace Are you a senior finance transformation leader with a strong track record of delivering complex change programmes? Do you thrive in fast-paced environments where clarity, influence, and delivery really matter? We’re seeking an Interim Finance Transformation Programme Director to lead and deliver a major programme to modernise Finance and Procurement at A2Dominion. This is a high-impact role, responsible for designing and delivering a transformation roadmap that rebuilds processes, systems, and controls — creating a streamlined, insight-driven function that adds real value to the business. Working closely with the Chief Financial Officer and senior leadership, you’ll drive outcomes through structure, pace, and strong stakeholder engagement,...

Solutions Architect (Databricks) Contract Outside IR35 £600 - £700 per day London A leading Databricks Partner is seeking multiple Resident Solutions Architects (and Senior Data Engineers) for immediate outside IR35, fully remote contracts. You will work on cutting edge customer engagements, solving big data challenges using the Databricks platform. As a trusted consultant, you’ll lead the design, build, and deployment of scalable data and AI solutions, ensuring clients unlock maximum value from their data. Key Responsibilities: Deliver impactful customer technical projects including reference architectures, solution accelerators, and production-ready deployments. Lead end-to-end design, implementation, and optimisation of Databricks-based data and AI platforms. Scope professional services engagements in collaboration with engagement managers and client stakeholders. Provide technical leadership in Databricks implementations, migrations, and...

SC Cleared Data Architect - Data Migration Programme Contract: Outside IR35 Rate: Up to £550 per day Duration: 3 months (initial) Start: ASAP Location: UK-based, hybrid with some travel to London Clearance: Active SC required Cloud Environment: AWS Overview We are supporting a consultancy delivering a secure data migration programme and are seeking an SC Cleared Data Architect to support the design and delivery of a new data architecture. This role suits a candidate who combines strong data architecture capability with hands-on technical understanding , and who can work closely with engineering teams to deliver complex migrations in a regulated environment. The programme focuses on migrating XML-based data into a new database architecture , supporting a case management platform within AWS. Key Responsibilities Design target-state data architecture and data models Define and oversee data migration strategies and approaches Lead data mapping...

AI Delivery Manager - AI Centre of Excellence 6 month contract Hybrid working - London based Outside IR35 We are operationalising AI across core business workflows and are looking for an experienced AI Delivery Manager to ensure these capabilities land cleanly and at scale. This is a hands-on execution lead delivery role focused on coordinating AI solutions built in-house or sourced from vendors. You will remove delivery friction for engineering and product teams, manage cross-functional dependencies (Data, Security, Business), and ensure business readiness, UAT, and governance requirements are met. You will support the rollout of enterprise AI capabilities such as enterprise search, AI copilots, and agentic environments , working closely with technical teams and transformation leads, comms and change management to ensure solutions are adopted and operate safely in production. We're looking for someone who has: Proven experience in delivery management across...

Robert Half Technology are assisting a leading UK legal firm to recruit a Chief Technology Officer (CTO) on a contract basis. Outside IR35. UK-based remote working with occasional stakeholder sessions. Role * The CTO will lead the assessment, design, and implementation of the firm 's cloud and data platforms. * Provide Board-ready recommendations on cloud strategy (Azure vs GCP) and data architecture. * Design and implement a modern cloud data platform with Databricks as the core analytics and AI layer. * Build a production-ready lakehouse architecture optimised for analyst-led use. * Implement secure, scalable ingestion pipelines for structured, unstructured, text-based, and geospatial data. * Balance performance, security, cost, and operational simplicity across the platform. * Provide knowledge transfer, documentation, and guidance to enable internal teams to operate and extend the platform. Profile * Proven hands-on experience delivering cloud-based...

M365 Engineer - Exchange, OneDrive, SharePoint Online We're looking for an experienced M365 Migration Specialist to lead discovery and support end to end migration activity across a global Microsoft 365 environment. You'll run end to end migrations across Exchange Online, SharePoint/OneDrive and Teams, following structured standard operating procedures and driving smooth go lives and hypercare. Must Have Experience: Exchange Online SharePoint Online & OneDrive migration experience Microsoft Teams migrations including DNS/MX changes Entra ID admin (PIM, RBAC) Excellent stakeholder communication This is a 6 month initial contract, paying circa £350 - £440 per day outside IR35, onsite in the Central London office 2-3 days per week. Our processing and use of your personal data is in accordance with our Privacy Notice, available on our website. We know that the most successful teams have a diversity of background, experience and approach. When we recruit, we...

M365 Engineer - Exchange, OneDrive, SharePoint Online We're looking for an experienced M365 Migration Specialist to lead discovery and support end to end migration activity across a global Microsoft 365 environment. You'll run end to end migrations across Exchange Online, SharePoint/OneDrive and Teams, following structured standard operating procedures and driving smooth go lives and hypercare. Must Have Experience: Exchange Online SharePoint Online & OneDrive migration experience Microsoft Teams migrations including DNS/MX changes Entra ID admin (PIM, RBAC) Excellent stakeholder communication This is a 6 month initial contract, paying circa £350 - £440 per day outside IR35, onsite in the Central London office 2-3 days per week. Our processing and use of your personal data is in accordance with our Privacy Notice, available on our website. We know that the most successful teams have a diversity of background, experience and approach. When we recruit, we...

Robert Half Technology are assisting a leading UK legal firm to recruit a Cloud & Data Architecture Consultant on a contract basis. Outside IR35. UK-based with remote working and occasional stakeholder sessions. Role Lead a structured assessment of cloud and data platforms (Azure vs GCP) and provide a Board-ready recommendation. Design and implement a modern cloud data platform with Databricks as the core analytics and AI layer. Build a production-ready lakehouse architecture optimised for analyst-led use. Implement secure, scalable ingestion pipelines for structured, unstructured, text-based, and geospatial data. Balance performance, security, cost, and operational simplicity across the platform. Provide knowledge transfer and documentation to enable internal teams to operate and extend the platform. Profile Proven hands-on experience delivering cloud-based analytics platforms end to end. Strong expertise in Azure or GCP, including Databricks...

A leading organisation is seeking a highly experienced cloud data consultant to lead a strategic scoping phase ahead of a major Databricks migration. This is a senior advisory role requiring deep technical credibility, strong stakeholder management and the ability to shape a clear roadmap for a complex transformation. The consultant will assess the current data landscape, define the future state architecture and produce a detailed migration approach for the adoption of Databricks. This engagement sits at the earliest stage of the programme and will influence investment decisions, delivery structure and long term data strategy. Key responsibilities Conduct a comprehensive review of existing data platforms, pipelines, governance processes and operational constraints Define the target architecture for Databricks and supporting cloud services Identify risks, dependencies, cost considerations and required organisational changes Produce a clear and actionable migration...

Full job description Robert Half Technology are assisting a leading UK legal firm to recruit a Cloud & Data Architecture Consultant on a contract basis. Outside IR35. UK-based with remote working and occasional stakeholder sessions. Role Lead a structured assessment of cloud and data platforms (Azure vs GCP) and provide a Board-ready recommendation. Design and implement a modern cloud data platform with Databricks as the core analytics and AI layer. Build a production-ready lakehouse architecture optimised for analyst-led use. Implement secure, scalable ingestion pipelines for structured, unstructured, text-based, and geospatial data. Balance performance, security, cost, and operational simplicity across the platform. Provide knowledge transfer and documentation to enable internal teams to operate and extend the platform. Profile Proven hands-on experience delivering cloud-based analytics platforms end to end. Strong...

A leading organisation is seeking a highly experienced cloud data consultant to lead a strategic scoping phase ahead of a major Databricks migration. This is a senior advisory role requiring deep technical credibility, strong stakeholder management and the ability to shape a clear roadmap for a complex transformation. The consultant will assess the current data landscape, define the future state architecture and produce a detailed migration approach for the adoption of Databricks. This engagement sits at the earliest stage of the programme and will influence investment decisions, delivery structure and long term data strategy. Key responsibilities Conduct a comprehensive review of existing data platforms, pipelines, governance processes and operational constraints Define the target architecture for Databricks and supporting cloud services Identify risks, dependencies, cost considerations and required organisational changes Produce a clear and actionable migration...

Infrastructure Architect with Tenant-to-Tenant/ M&A integration Contract: 6 months initially Status: Outside IR35 Working Model: Hybrid/Remote - 3 days onsite/2 days from home Start: ASAP An exciting opportunity for an experienced Infrastructure & Cloud Architect with Tenant-to-Tenant/M&A integration experience to join a specialist M&A Integration team delivering a major international technology integration programme. This role suits someone with deep hands-on infrastructure and cloud expertise, and strong experience in global-scale migrations or acquisition-led transformation. The Infrastructure Architect with Tenant-to-Tenant/M&A integration experience is grounded in expertise with Microsoft 365 , Integrations or Migrations and Azure technology; and not DevOps focused experience. The Role The Infrastructure & Cloud Architect with Tenant-to-Tenant/M&A integration will play a key part in multiple concurrent integration projects,...

Robert Half Technology are assisting a leading UK legal firm to recruit a Cloud & Data Architecture Consultant on a contract basis. Outside IR35. UK-based with remote working and occasional stakeholder sessions. Role * Lead a structured assessment of cloud and data platforms (Azure vs GCP) and provide a Board-ready recommendation. * Design and implement a modern cloud data platform with Databricks as the core analytics and AI layer. * Build a production-ready lakehouse architecture optimised for analyst-led use. * Implement secure, scalable ingestion pipelines for structured, unstructured, text-based, and geospatial data. * Balance performance, security, cost, and operational simplicity across the platform. * Provide knowledge transfer and documentation to enable internal teams to operate and extend the platform. Profile * Proven hands-on experience delivering cloud-based analytics platforms end to end. * Strong expertise in Azure or GCP, including...

Data Architect SC Cleared £600-650 per day, Outside IR35 Initially 2-3 Months 1-2 Days per week in London One of our favorite Consulting partners urgently requires the services of a Data Architect to join a Discovery team, for a high-profile project in the Government space. You must have Active Security Clearance! Skills, Experience and Tech Stack we need: Core Government & Policy Skills:● Translating Policy Intent● Understanding the 'Policy-to-Delivery' Lifecycle● Navigating Governance & Constraints● Stakeholder Management (Public Sector) GDS & Service Delivery Skills:● Fluency in GDS Principles● Applying the GDS Service Standard● User-Centred Analysis● Agile & Lean Methodologies: ʺ You must be comfortable delivering a Minimum Viable Product (MVP) and building on it based on data and user feedback. Core data architecture skills: 1. Developing Implementation Options:● Enterprise & Solution Architecture (TOGAF/ArchiMate): The ability to produce...

Morgan Hunt are working with a public sector organisation to recruit an Azure Data Architect on a 6-month contract. The role is fully remote, with no requirement to travel to the organisations offices. They are looking for someone to lead the design and delivery of modern, scalable data platforms in Microsoft Azure. You will be responsible for defining end-to-end data architectures and guiding teams through successful implementations across cloud data platforms. You will work closely with stakeholders, engineers, and analysts to ensure data solutions are aligned with the organisations goals and best practices. Key Responsibilities: Design and implement enterprise-grade data architectures using Azure Fabric Architect and optimise datalakes for analytics, reporting, and advanced workloads Lead data governance, cataloguing, and compliance initiatives using Microsoft Purview Own and oversee data platform implementations from concept through delivery...

We are seeking a Databricks Implementation Consultant / Architect for an initial 4-6 weeks contract. The primary objective of this role is to assess and recommend the optimal cloud platform (Azure or Google Cloud Platform) for implementing Databricks. This will involve a detailed evaluation of both platforms against analytical requirements, cost models, security, compliance, and integration considerations, culminating in a clear recommendation for senior stakeholders Role Overview You will lead a comprehensive Cloud & Data Platform Assessment focused on defining a future-ready architecture and positioning Databricks as the core analytics layer. This role requires deep expertise in Databricks implementations across Azure and Google Cloud Platform (GCP). Cloud & Data Platform Assessment: Review the existing data landscape, including CRM data in SQL Server, external datasets, geospatial sources, and BI consumption. Assess how shortlisted...

Tech Lead/Lead Data Engineer (AWS Data Platform) Rate: £500 - £550 p/d outside IR35 Length: 1st April to end of November (initially) Location: London (hybrid - typically 1 day per week on-site, remaining remote) Security Clearance: SC Clearance essential + NPPV3 Overview We're looking for a hands-on Tech Lead to lead a small team delivering secure, scalable data solutions within a highly regulated environment. You'll take technical ownership across an AWS-based data platform using S3, Glue, and Redshift , working closely with delivery leadership, architecture stakeholders, and product teams to deliver incremental value. This role suits someone who can balance technical leadership , hands-on engineering , and stakeholder-facing communication , while maintaining strong standards around security, quality, and operational resilience . Key Responsibilities Lead and mentor a small engineering team across data engineering, analytics engineering,...

UX/UI Designer – Contract (Outside IR35) Rate: £600 per day Contract Length: 6 months IR35 Status: Outside IR35 Location: Bank, City of London Working Pattern: Hybrid – onsite up to once per week (max) Start: ASAP The Role We are seeking an experienced UX/UI Designer to join an organisation on a 6-month contract. This role will suit a senior designer who is comfortable working across both UX and UI, contributing to end-to-end design delivery while influencing design strategy and mentoring others. You will work closely with product managers, engineers, and business stakeholders to design high-quality, user-centred digital experiences across web and mobile platforms. Key Responsibilities Lead UX/UI design across web and mobile applications Create wireframes, prototypes, and interaction designs Contribute to and evolve component-based design systems Conduct user research, usability testing, and apply data-driven insights Ensure...

Lead Technical Test Engineer Remote 3 month contract - potential for extension Outside IR35 £450pd iO are working with an established and rapidly growing Digital agency in their search for an experienced Lead Technical Test Engineer They work with global technology leaders to provide digital transformation services to a number of customers in industries including not-for-profit, financial services and the pubic sector You will bring years of experience, understanding and practical application in all levels and types of testing and a good understanding and usage of AWS services to assist in the set-up and triggering of test conditions. As the Lead Test Engineer, you will support the Test Manager with the strategy and coordinating a small team of Technical Test Engineers Must have experience in testing one or more of the following: Minimum of 5 years' experience in BOTH testing and test leadership Experience of testing web-based solutions built in a...

Full-Stack Java Software Engineer (Hybrid Cloud Transformation) I. Role Overview and Engagement This is a critical, hands-on engineering role within a major Financial Services institution focused on accelerating their Cloud Modernization and Migration Strategy . The successful candidate will be integral to developing and deploying enterprise-grade, secure, and scalable microservices within a complex Hybrid Cloud Architecture . Job Title: Full-Stack Java Software Engineer Location: Central London (Hybrid: 2 days onsite) Engagement Model: 1-Month Contract (Outside IR35) to Guaranteed Permanent Conversion Contract Rate: £450/day (during 1-month contract term) Urgency: URGENT - Interviews scheduled this week for ASAP start. Role Type: Highly Hands-on Contributor (Not a Lead position), requiring strong commercial awareness . II. Core Technical Mandate (Mandatory & Non-Negotiable) The engineer must possess recent, demonstrable expertise in...