195 data engineer jobs found

🚀 Senior Data Engineer – Storage Optimisation Engagement 🚀 📍London (Hybrid) 📅 Starting ASAP for an initial 8 week engagement 💰 Outside IR35 - rate depending on experience We’re supporting a client looking for a Senior Data Engineer to lead a short-term, high-impact storage optimisation engagement within an ML-heavy environment. This is not a generic BAU role – it’s a focused piece of work with clear deliverables, governance ownership and measurable impact. 🔑 The Role • Assess large-scale storage usage across ML data prep, training and experimentation • Design and execute structured clean-up & optimisation strategies • Implement retention policies and lifecycle governance • Reduce reliance on manual storage management • Deliver a high-level data engineering roadmap • You’ll work closely with ML and Infrastructure engineers, mapping workflows and introducing sustainable improvements. 🎯 We’re looking for someone who: 👉 Has strong...

Our sister company Stellarmann is seeking an experienced Data Engineer to support a London Market Insurance client in building a modern Azure data environment. The Data Engineer will work alongside the wider team in building a modern Data Lakehouse with three tiers. We're seeking someone with: Proven experience as a Data Engineer Strong hands on experience with Azure Databricks and Azure Data Factory Experience in the Lloyd's/London Market (specialty insurance) Proficiency in Python Experience with SQL Server Exposure to DevOps automation and deployment pipelines (YAML) Experience working with Medallion architecture/tiered medallion Lakehouse Strong understanding of Delta Lakes and Delta Tables Experience using Databricks Notebooks for data pipelines The initial engagement will run until early September 2026 and the role is paying a competitive day rate outside IR35, offering hybrid working in the London office (2 days per week). If this...

Role Overview We are seeking a skilled Data Engineer with strong expertise in Microsoft Azure and Databricks to design, build, and optimize scalable data pipelines and analytics solutions. You will play a key role in building modern data platforms that support business intelligence, advanced analytics, and machine learning initiatives. This role requires hands-on experience with cloud-native data architectures, distributed processing, and best practices in data engineering. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and related Azure services Build and optimize data workflows using Apache Spark within Databricks Develop and maintain data lakes and lakehouse architectures using Azure Data Lake Storage Implement data modeling solutions for analytics and reporting Ensure data quality, governance, and security best practices Collaborate with data analysts, data scientists, and business...

Data Engineer | Outside IR35 | £400 - £500 | 6 months | Hybrid Nottingham We’re looking for a highly skilled Data Engineer to join a growing data team supporting a large-scale modern data platform project. Working 3 days a week onsite on the outskirts of Nottingham, you'll be a key contributor in evolving the organisation’s data capability, focusing on best‑practice engineering, clean architecture, and high‑value BI delivery.Key Responsibilities Design, build and optimise ETL/ELT pipelines using Azure Data Factory and Databricks. Develop scalable data models and transformations using SQL and Python. Work hands‑on with Databricks (Lakehouse, Delta tables, notebooks, workflows). Deliver high-quality dashboards and reporting solutions using Power BI. Implement best practices for data quality, governance, lineage and automation. Collaborate with cross‑functional teams including analysts, product owners and business stakeholders. Support performance tuning, cost optimisation and...

Data Engineer | Outside IR35 | £400 - £500 | 6 months | Hybrid Nottingham We’re looking for a highly skilled Data Engineer to join a growing data team supporting a large-scale modern data platform project. Working 3 days a week onsite on the outskirts of Nottingham, you'll be a key contributor in evolving the organisation’s data capability, focusing on best‑practice engineering, clean architecture, and high‑value BI delivery. Key Responsibilities Design, build and optimise ETL/ELT pipelines using Azure Data Factory and Databricks. Develop scalable data models and transformations using SQL and Python . Work hands‑on with Databricks (Lakehouse, Delta tables, notebooks, workflows). Deliver high-quality dashboards and reporting solutions using Power BI . Implement best practices for data quality, governance, lineage and automation. Collaborate with cross‑functional teams including analysts, product owners and business stakeholders. Support performance...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration layer to replace legacy systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part of integration improvements. Rebuild and enhance data flows between Salesforce and other systems. Design and implement a new integration layer to replace old estate connections. Key Skills & Experience: Proven experience as a Databricks Specialist in enterprise environments. Strong knowledge of Azure Data...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

Data Engineer | Outside IR35 | £400 - £500 | 6 months | Hybrid Nottingham We're looking for a highly skilled Data Engineer to join a growing data team supporting a large-scale modern data platform project. Working 3 days a week onsite on the outskirts of Nottingham, you'll be a key contributor in evolving the organisation's data capability, focusing on best practice engineering, clean architecture, and high value BI delivery. Key Responsibilities Design, build and optimise ETL/ELT pipelines using Azure Data Factory and Databricks. Develop scalable data models and transformations using SQL and Python . Work hands on with Databricks (Lakehouse, Delta tables, notebooks, workflows). Deliver high-quality dashboards and reporting solutions using Power BI . Implement best practices for data quality, governance, lineage and automation. Collaborate with cross functional teams including analysts, product owners and business stakeholders. Support performance tuning,...

Details Newbury Hybrid 2 days onsite mandatory Client Gamma RRF ID 1 £400 per day Outside IR35 Duration 3 months initial Start ASAP Overview We are looking for an experienced Data Engineer to design and deliver scalable, secure, and high performance data solutions. The role focuses heavily on Snowflake architecture, cloud data platforms, and modern data pipeline development click apply for full job details

Data Engineer | Outside IR35 | £400 - £500 | 6 months | Hybrid Nottingham We're looking for a highly skilled Data Engineer to join a growing data team supporting a large-scale modern data platform project. Working 3 days a week onsite on the outskirts of Nottingham, you 'll be a key contributor in evolving the organisation's data capability, focusing on best-practice engineering, clean architecture, and high-value BI delivery. Key Responsibilities Design, build and optimise ETL/ELT pipelines using Azure Data Factory and Databricks. Develop scalable data models and transformations using SQL and Python . Work hands-on with Databricks (Lakehouse, Delta tables, notebooks, workflows). Deliver high-quality dashboards and reporting solutions using Power BI . Implement best practices for data quality, governance, lineage and automation. Collaborate with cross-functional teams including analysts, product owners and business...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35)Location: Hybrid in South Wales Role OverviewWe are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands‑on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark‑driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time‑aware joins and dimensional transformations Support optimisation of Spark workloads and Delta tables Solid...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35) Location: Hybrid in South Wales Role Overview We are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands-on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark-driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time-aware joins and dimensional transformations Support optimisation of Spark workloads and Delta tables...

Contract Data Engineer - ASAP Start £425/day | Liverpool | 6 months Initially We're looking for a Contract Data Engineer who can hit the ground running and help accelerate a major digital transformation. If you enjoy working in fast-paced environments, shaping data pipelines, and bringing clarity to complex data flows, this role should land well. What You'll Be Working On You'll be responsible for building and maintaining end-to-end data pipelines using Azure Data Factory, connecting varied data sources and orchestrating workflows into Azure SQL for downstream consumption. You'll use Python and Pandas to transform, cleanse, and validate data, ensuring accuracy, performance, and reliability across the pipeline. This role is all about enabling high-quality, well-structured data that feeds analytics, reporting, and product-led decision-making. Key Responsibilities Design, build, and optimise scalable ETL/ELT pipelines in Azure Data Factory Work with Azure SQL to...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35) Location: Hybrid in South Wales Role Overview We are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands-on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark-driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time-aware joins and dimensional transformations Support optimisation of Spark workloads and Delta tables...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35) Location: Hybrid in South Wales Role Overview We are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands-on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark-driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time-aware joins and dimensional transformations Support optimisation of...

Senior Data Engineer (GCP) Client: Consultancy client Location: UK – Hybrid / Remote (TBC) Rate: £550-650 per day (Outside IR35) Overview We’re supporting a consultancy client delivering a large data platform programme , focused on building and maturing a modern, cloud-native data platform on Google Cloud Platform (GCP) . The programme is moving beyond PoCs into large-scale, production-grade delivery and requires strong hands-on Data Engineers to help stabilise, scale, and operationalise core data pipelines and platform services. This role suits engineers who enjoy working on complex data platforms, care about engineering quality, and have experience delivering data products in regulated, enterprise environments. Key Responsibilities Design, build, and operate robust data pipelines on GCP using Spark and Airflow Develop and optimise data processing workloads in BigQuery and associated GCP services Contribute to the design and evolution of a...

Senior Data Engineer | Azure | Snowflake | Fivetran | DBT | ETL / ELT | APIs Rate: £225 per day (Outside IR35) Contract: Initially 9 months - likely to extend Start: ASAP Working model: Remote depending on location or Hybrid 1 day p/w Working hours: UK (GMT) Required: Azure, Fivetran, Snowflake, Python & APIs (Non Negotiable) ℹ️ Only candidates with relevant Fivetran experience will be considered for this role. 🚨 Non‑Negotiables - Please only apply if you have ALL of the following 🚨 Core technologies: Snowflake (data warehouse) Fivetran (data connectors) DBT (data transformation) Python (including building custom API connectors) Environment: Strong experience working in Azure‑based data environments Proven, hands‑on experience as a Data Engineer Strong experience building and maintaining ETL/ELT pipelines Solid understanding of data warehousing and data modelling concepts Key skills: Experience...

Senior Microsoft Fabric Data Engineer £550 - £650 per day Outside IR35 6 month initial contract UK Remote Overview I’m working with a client scaling out their Microsoft Fabric estate and need a genuinely hands-on Fabric engineer with active 2026 delivery experience. This is not a proof of concept environment. This is a live, production Fabric implementation supporting core business workloads. We’re looking for someone who has built Fabric end-to-end and understands how to design, optimise and scale it properly. Experience Required 18+ months hands-on Microsoft Fabric delivery At least one end-to-end production Fabric implementation Strong Azure Data Engineering background (Synapse, Azure Data Factory, Databricks) 5+ years overall Data Engineering experience Key Responsibilities Design and implement Fabric Lakehouse architecture in OneLake Build and optimise Bronze / Silver / Gold (medallion) layers Develop and maintain Delta tables using PySpark Create and...

Lead Data Engineer Contract Outside IR35 £625 - £650 p/d 6 months Intially 2/3 days a week on-site - Redditch ASAP Start My client are seeking an experienced Data Architect to lead the migration of customer data from a third-party platform onto the new Databricks environment. This is a hands-on leadership role requiring deep Databricks expertise combined with architectural ownership and delivery accountability. Key Responsibilities Lead the migration of customer data from an external third-party provider to the new Databricks platform. Define and implement the end-to-end data architecture strategy within Databricks. Design scalable, secure, and high-performance data pipelines. Establish governance, data modelling standards, and best practice frameworks. Act as technical authority and SME for Databricks across the programme. Provide architectural oversight while remaining hands-on with engineering delivery. Required Experience Deep hands-on expertise in...