68 senior data engineer jobs found in London

Job Title: Senior Data Engineer Day Rate: £400-450/day (Outside IR35) Location: 3 days per week on-site in either London or Birmingham Contract Length: 6 months Senior Data Engineer - Role & Responsibilities Design, build, and maintain scalable data pipelines and data models within Microsoft Fabric, supporting enterprise analytics and reporting needs. Lead the migration from Azure Synapse to Microsoft Fabric using a Medallion architecture approach, while ensuring stability of existing Azure and SQL Server environments. Integrate internal systems and third-party data sources into the Fabric platform using APIs and robust data integration patterns. Develop, optimise, and automate ETL workflows, ensuring high standards for data quality, validation, and performance. Deliver and govern Power BI dashboards and reports, while mentoring and upskilling business users to build a self-service analytics capability. Senior Data Engineer - Required Experience...

Senior Data Engineer (Snowflake & dbt) A London-based insurer is seeking a Senior Data Engineer to help design, build, and scale its modern data platform. You'll play a key role in transforming raw data into reliable, well-structured datasets that power analytics, reporting, and data-driven decision-making across the business. Key Responsibilities of the Senior Data Engineer: Design, develop, and maintain scalable data pipelines and ELT workflows Build and optimize data models using dbt to support analytics and business intelligence Manage and enhance our Snowflake data warehouse environment Ensure data quality, integrity, and performance across pipelines Collaborate with analysts, data scientists, and stakeholders to understand data needs Implement testing, monitoring, and documentation for data systems Contribute to data architecture decisions and best practices Essential skills of the Senior Data Engineer: Strong experience with Snowflake (data...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

Senior Data Engineer (GCP) - Outside IR35 - Hybrid 2/3 days onsite London - 3 year B2B contract I'm working with a client looking for a Senior GCP Data Engineer to help build and scale a modern data platform across GCP and Azure.  Role: Design and build scalable data pipelines (batch & streaming) Work with BigQuery, Dataflow, Pub/Sub, Airflow Deliver cloud data solutions across GCP & Azure Contribute to architecture and engineering best practices Key Skills: 5-6+ years Data Engineering experience 3-5 years with GCP Strong Python & SQL Experience with BigQuery, Dataflow, Pub/Sub, Airflow/dbt Modern data platform/lakehouse experience Desirable: Multi-cloud (GCP & Azure) Kafka/Event Hub BI tools (Power BI/Tableau) Cloud certifications Senior Data Engineer (GCP) - Outside IR35 - Hybrid 2/3 days onsite London - 3 year B2B contract

Senior Data Engineer - Analytics (Contract) Hybrid - London/Reading A data engineer is required to deliver insight-ready datasets and support advanced analytics across a cloud-based environment. The role focuses on building scalable pipelines, refining complex data sources, and enabling analysts and data scientists with high-quality, well-structured data. Key Responsibilities Develop and optimise data pipelines for analytics and modelling. Cleanse, transform, and analyse large datasets using Python/R . Maintain SQL-driven processing workflows in the cloud. Perform EDA to identify trends, anomalies, and data issues. Collaborate with BI teams to deliver reliable analytical datasets. Skills & Experience Strong SQL and data wrangling. Proficient in Python or R. Experience with large, complex datasets and Power BI. AWS experience preferred: Glue, S3, Athena, Lambda, Redshift, Step Functions . Advantageous: statistics/ML exposure and telecom-style data environments....

Senior Data Engineer Contract Role Outside IR35 | £500-550/day | Milton Keynes | Hybrid | Initial 5 Months We have a new Senior Data Engineer contract opportunity with a global leading client with offices in Milton Keynes. You'll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, requires 1 day per week on-site, and offers an initial 5-month contract with an immediate start and strong potential for extension on a greenfield project. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices. Migrate and transform data into a Databricks Lakehouse architecture. Ensure data quality, reliability, and scalability for analytics and reporting. Collaborate with stakeholders to deliver robust solutions aligned with business needs. Support production environments and...

Senior Azure Data Engineer (Snowflake, Databricks, Dbt)  I'm urgently looking to speak with Senior Contractors bringing significant experience in Databricks + Snowflake, coupled with proven Azure-Databricks project expertise.  You must have valid right to work status in the UK to be considered for this opportunity.  Skills & Experience: - Proven Snowflake & Databricks, hands-on experience  - Significant expertise in Azure-Databricks, with demonstratable, hands-on leadership in Azure-heavy projects - Excellent stakeholder management, able to hit ground running and work closely with senior stakeholders - DBT experience - nice to have  Please note: This role requires someone who can operate autonomously from day one, with strong delivery focus in fast‑paced, enterprise-scale data environments. Reason for role:  Urgent interim replacement  Rate : £500-550 p/d | Outside IR35  Start date : End of March  Working Patterns:  Remote first, 1 week in Milton...

Senior Azure Data Engineer (Snowflake, Databricks, Dbt) I'm urgently looking to speak with Senior Contractors bringing significant experience in Databricks + Snowflake, coupled with proven Azure-Databricks project expertise. You must have valid right to work status in the UK to be considered for this opportunity. Skills & Experience: - Proven Snowflake & Databricks, hands-on experience - Significant expertise in Azure-Databricks, with demonstratable, hands-on leadership in Azure-heavy projects - Excellent stakeholder management, able to hit ground running and work closely with senior stakeholders - DBT experience - nice to have Please note: This role requires someone who can operate autonomously from day one, with strong delivery focus in fast paced, enterprise-scale data environments. Reason for role: Urgent interim replacement Rate : £500-550 p/d | Outside IR35 Start date : End of March Working Patterns: Remote first, 1 week in Milton...

Senior Azure Data Engineer (Snowflake, Databricks, Dbt) I 'm urgently looking to speak with Senior Contractors bringing significant experience in Databricks + Snowflake, coupled with proven Azure-Databricks project expertise. You must have valid right to work status in the UK to be considered for this opportunity. Skills & Experience: - Proven Snowflake & Databricks, hands-on experience - Significant expertise in Azure-Databricks, with demonstratable, hands-on leadership in Azure-heavy projects - Excellent stakeholder management, able to hit ground running and work closely with senior stakeholders - DBT experience - nice to have Please note: This role requires someone who can operate autonomously from day one, with strong delivery focus in fast-paced, enterprise-scale data environments. Reason for role: Urgent interim replacement Rate : £500-550 p/d | Outside IR35 Start date : End of March Working Patterns: Remote...

Databricks Lead Engineer – Contract 📍 Central London (Hybrid – 3 days onsite) 💰 £400–£500 p/day (Outside IR35) 📆 6‑month rolling Overview Hands-on Databricks Lead Engineer needed to drive a major data platform re‑engineering programme, migrating complex, high‑volume datasets to a scalable Delta Lake architecture. Key Responsibilities Lead design + implementation of Delta Lake architecture Model and partition large, high-cardinality datasets Build metadata, compaction, and versioning strategies Migrate legacy platforms to Delta / Iceberg formats Support diverse downstream data delivery use cases Define backup/recovery processes (1‑day RTO target) Act as technical lead while staying hands-on Essential Skills Strong Databricks + Delta Lake + Unity Catalog Delta UniForm & Apache Iceberg experience AWS (S3, Lake Formation) Linux development Modern engineering practices (CI/CD, testing, Git) Strong autonomy + problem‑solving Desirable...

We are hiring a Senior GCP Data Engineer to design and build scalable, high-performance data platforms on Google Cloud for a leading banking/financial services client. This role involves working on large-scale data systems, building both batch and real-time pipelines, and delivering enterprise-grade data solutions. Key Responsibilities Design and build batch & real-time data pipelines on GCP Work with BigQuery, Dataflow, Cloud Storage, Spanner Develop real-time streaming solutions (Kafka / Apache Beam) Implement Infrastructure as Code using Terraform Deploy workloads on Kubernetes (GKE) Build and manage CI/CD pipelines (Jenkins / Spinnaker) Collaborate on data modelling and architecture Ensure systems are secure, scalable, and cost-optimized Required Skills 6+ years of overall experience in Data Engineering 3+ years of hands-on experience in Google Cloud Platform (GCP) Strong expertise in: BigQuery Dataflow / Apache Beam...

Senior Software Developer / Data Engineer - (Contract Outside IR35) In brief We’re looking for well-rounded software developers with experience in data engineering, with a proven ability to tackle complex data challenges, make an excellent impression on clients, and have a high impact on the output of your entire team. We provide a supportive environment with a strong focus on individual career progression, where you will have both the mentorship and project opportunities you need to develop your technical skills. You’ll work in a team alongside other talented developers and data engineers, supported by a Technical Lead. Projects span a range of sizes and multiple sectors and technologies. The role Experience and qualifications You have 4+ years’ experience and a breadth & depth of technical knowledge & expertise, particularly in data engineering, and can solve technical challenges across front-end, back-end, and infrastructure. You have...

All our office locations considered: Newbury, Reading, London, Liverpool, Glasgow (UK); xc5 xa0ibenik, Croatia (considered) We 're on the hunt for builders . No, we 've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as telecoms, insurance, finance and mortgages. ? First and foremost we seek strong Consultants; so if you are ready to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We 're Intuita - a fast growing consultancy that 's making waves in both the consultancy and technology space. With our ambitious goals for the year ahead and beyond, we are looking for talented individuals...

We are hiring a Senior GCP Data Engineer to design and build scalable, high-performance data platforms on Google Cloud for a leading banking/financial services client. This role involves working on large-scale data systems, building both batch and real-time pipelines, and delivering enterprise-grade data solutions. Key Responsibilities Design and build batch & real-time data pipelines on GCP Work with BigQuery, Dataflow, Cloud Storage, Spanner Develop real-time streaming solutions (Kafka / Apache Beam) Implement Infrastructure as Code using Terraform Deploy workloads on Kubernetes (GKE) Build and manage CI/CD pipelines (Jenkins / Spinnaker) Collaborate on data modelling and architecture Ensure systems are secure, scalable, and cost-optimized Required Skills 6+ years of overall experience in Data Engineering 3+ years of hands-on experience in Google Cloud Platform (GCP) Strong expertise in: BigQuery Dataflow / Apache Beam Kafka...

Contract Data Engineer / 6 month duration / Outside IR35 / £575 per day / London Market Insurance / We are partnered closely with a London Market Insurance Syndicate, recruiting for a Contract Data Engineer. As Data Engineer you will be responsible for the build / development / enhancement and support the Data ecosystem (Data Platform, Datawarehouse), including but not restricted to Syndicate Data Hub. The Senior Data Engineer will promote good data hygiene across the Syndicate and wider group. Key duties and responsibilities Build / enhance / deliver / support the Data ecosystem, including but not restricted to Syndicate Data Hub: Develop data pipelines leveraging ELT / ETL techniques to ingest, transform and display data following state-of-the-art-approach and internal standards (testing, reconciling and documenting changes is a key part of this role) Design and propose changes to the group data model (with specific focus on Syndicate) Support data scheduled...

Databricks Data Engineer £500 - £550 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and Real Time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create personalised journeys for millions of shoppers worldwide. The Role As a Senior Data Engineer, you'll play a key role in developing and optimising the backbone of the company's data platform. You'll be responsible for building and maintaining large-scale, Real Time data pipelines that power analytics, machine learning, and operational systems across the business. You'll collaborate with software engineers, data scientists, and analytics teams to ensure the platform delivers reliable, high-quality, and compliant data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key...

Azure Data Engineer (Contract – Day Rate) - Mid‑Level | Azure | Data Lakehouse | ETL Location:  Central London  Day Rate: £375 - 425 per day (Outside IR35)  Working Patterns:  Hybrid, London  Interviews:  2 stage process Opus are supporting a global insurance organisation seeking an Azure Data Engineering contractor to join its core IT function on a day‑rate basis. This role is part of a wider data platform capability build and offers the opportunity to bring a fresh, pragmatic perspective into an established Azure environment.The team is currently top‑heavy and are deliberately looking to strengthen the mid‑level layer - someone highly technical, hands‑on, and confident shaping how data is ingested, optimised and structured across Azure. The Role: Join a central IT delivery team, reporting into the agile delivery team.  Act as a replacement within the existing data engineering function Focus on incoming data design, Azure optimisation, and ETL best practice Work...

Senior Software Engineer - Outside IR35 - Contract - Current SC Essential We're hiring a Senior Software Engineer to join a high-impact government programme of work. This is an outside IR35 contract with a strong potential for extension beyond the initial 6-month term, making it a great opportunity for experienced contractors looking for stability and interesting work. The project sits within a complex, delivery-focused environment where your engineering decisions will genuinely matter. You'll be working as part of a collaborative team building robust, scalable solutions for a public sector client. Tech Experience: Java, Spring Boot, Typescript and React. £550 per day outside IR35 Start date: 28/04/2026 End date: 30/10/2026 About Softwire Softwire is a leading UK technology and strategy consultancy. From enterprise to government, we help visionary organisations turn strategic ambitions into results at scale. Our practices cover AI...

Azure Data Engineer (Contract - Day Rate) - Mid Level | Azure | Data Lakehouse | ETL Location: Central London Day Rate: £375 - 425 per day (Outside IR35) Working Patterns: Hybrid, London Interviews: 2 stage process Opus are supporting a global insurance organisation seeking an Azure Data Engineering contractor to join its core IT function on a day rate basis. This role is part of a wider data platform capability build and offers the opportunity to bring a fresh, pragmatic perspective into an established Azure environment.The team is currently top heavy and are deliberately looking to strengthen the mid level layer - someone highly technical, hands on, and confident shaping how data is ingested, optimised and structured across Azure. The Role: Join a central IT delivery team, reporting into the agile delivery team. Act as a replacement within the existing data engineering function Focus on incoming data design, Azure optimisation, and ETL best practice Work...

**ML Applied Engineer – 6 month initial contract (temporary) – outside IR35 – London – day rate dependent on experience** We are looking for a senior, hands-on Applied ML Engineer to bridge the gap between classical data science and generative AI. This is an initial 6-month contract, with the possibility of a Phase-2 extension subject to successful delivery of first phase 1. The role is focused on delivery, execution, and technical ownership. You will be brought in to accelerate the product roadmap, transitioning capabilities from experimentation into robust, enterprise-grade systems embedded directly into our products and client solutions. You will be tasked to create Hybrid AI systems: using LLMs to provide interaction and explanation, grounded strictly by quantitative ML models (cost-to-serve, forecasting, and optimisation). You will own the transition from experimental notebooks to enterprise-grade solutions. Key responsibilities and deliverables: AI...