218 data engineer jobs found

Azure Data Engineer | Outside IR35 | £400 - £450 | 6 months | Hybrid LiverpoolYou’ll be designing, developing, and managing data pipelines across Azure, primarily using Azure Data Factory to integrate multiple data sources and deliver streamlined workflows into Azure SQL. A strong grasp of Python will be essential as you'll be transforming, cleansing, and validating complex datasets to ensure they’re accurate, efficient, and ready for analytics and product teams to leverage. This position plays a key role in supporting ongoing modernisation efforts by strengthening the way data is collected, processed, and made available across the business. Responsibilities Build, maintain, and improve scalable ETL/ELT pipelines using Azure Data Factory Model, manage, and optimise datasets within Azure SQL Use Python and Pandas for data preparation, transformation, and quality checks Work closely with engineering, product, and analytics teams to understand data requirements and deliver robust...

Role: Data Engineer (Python, PySpark, SQL) Day rate: £400pd-£440pd (Outside IR35) Contract: 6 months initial We are seeking a highly skilled Data Engineer to support a Material Spend Project. You will play a crucial role in extracting, transforming, and analysing large data sets from multiple sources, including API integrations and ServiceNow, to drive actionable insights and support strategic decision-making. Skills and experience required: Strong experience developing ETL/ELT pipelines using PySpark and Python Hands-on experience with Microsoft Fabric lakehouse or similar cloud data platforms (Azure Synapse Analytics, Databricks) Proficiency in working with Jupyter/Fabric Notebooks for data engineering workflows Solid understanding of data lakehouse architecture patterns and medallion architecture API Integration experience Experience working with Delta Lake or similar lakehouse storage formats Strong SQL skills for data manipulation, transformation, and quality...

Senior Data Engineer – Contract (Outside IR35) 📍 Newcastle (3 days onsite) | 🏡 2 days WFH 💰 £500–£700 per day | 📅 6–12 Month Project We’re looking for an experienced Senior Data Engineer to join a high-impact programme delivering scalable, cloud-based data solutions for a major organisation based in Newcastle. This is a 6–12 month contract , outside IR35 , offering a competitive day rate and a flexible hybrid working model. 🔎 The Role You’ll play a key role in designing, building, and optimising robust data pipelines and cloud-native data platforms. Working closely with architects, analysts, and engineering teams, you’ll help drive best practice in data engineering and deliver reliable, high-performance solutions. 🛠 Key Responsibilities Design and build scalable data pipelines using Python and SQL Develop and optimise big data solutions using Apache Spark Implement and manage cloud-based data platforms within AWS Build and maintain...

Contract Data Engineer - Snowflake / DBT / Python / SQL Pharmaceutical Industry | £550-£600 per day | Outside IR35 London (Hybrid - 2 days onsite) | 12 months + extension likely We're hiring multiple Contract Data Engineers to support a leading global pharmaceutical organisation as they scale a modern, cloud-based data platform driving clinical, regulatory, and commercial insights. This is an opportunity to work on high-impact data solutions that directly support drug development, research analytics, and patient outcomes within a highly regulated environment. What You'll Be Doing: Designing and optimising Snowflake data pipelines within a secure, GxP-aligned architecture Building robust transformation layers using DBT (Cloud/Core) Developing scalable data models to support clinical, R&D, and commercial reporting Writing high-performance SQL and leveraging Python for orchestration and automation Contributing to the evolution of a modern,...

Data Engineer l Informatica l Data governance l SQL Database l Databricks l Stakeholder management l integration l Financial Services I £500-£525 per day Outside IR35 3-6-month initial Hybrid Remote - London One of my consulting partners is kicking off a major data governance and integration programme for a leading insurance client, and we're looking for three strong Data Engineers with deep experience implementing and optimising Informatica solutions end-to-end from both on prem and cloud systems. Core Skills Required Extensive Informatica experience (IICS / PowerCenter / IDMC) across design, build, integration, and deployment Strong background in Data Governance , including: Enterprise metadata management Data lineage setup and optimisation Data quality rules, profiling, and stewardship workflows Policy framework implementation Governance operating model support Experience working with Informatica Data Quality (IDQ) , Axon , or similar governance...

Contract Data Engineer - Snowflake / DBT / Python / SQL Pharmaceutical Industry £550-£600 per day Outside IR35 London (Hybrid - 2 days onsite) 12 months + extension likely We're hiring multiple Contract Data Engineers to support a leading global pharmaceutical organisation as they scale a modern, cloud-based data platform driving clinical, regulatory, and commercial insights. This is an opportunity to work on high-impact data solutions that directly support drug development, research analytics, and patient outcomes within a highly regulated environment. What You'll Be Doing: Designing and optimising Snowflake data pipelines within a secure, GxP-aligned architecture Building robust transformation layers using DBT (Cloud/Core) Developing scalable data models to support clinical, R&D, and commercial reporting Writing high-performance SQL and leveraging Python for orchestration and automation Contributing to the evolution of a modern, analytics-driven...

Senior Data Engineer - Azure, Databricks, Datafactory, Phinsys Tandem, Insurance Our sister company Stellarmann is seeking an experienced Data Engineer to join their team, who are building out a new data platform for processing Finance and Actuarial data. You will be working as part of a talented team building a cutting edge data platform using Azure Databricks, Datafactory and Python integrating with Phinsys Tandem. We're seeking someone with: Proven experience as a Data Engineer Strong hands on experience with Azure Databricks and Azure Data Factory Experience in the Lloyd's/London Market (specialty insurance) Experience working with Phinsys Tandem - essential Proficiency in Python Experience working with Medallion architecture/tiered medallion Lakehouse Experience using Databricks Notebooks for data pipelines This is a 6 month initial engagement, outside IR35 with scope to extend beyond the initial term. If this opportunity aligns with your...

Contract Data Engineer - Snowflake/DBT/Python/SQL Pharmaceutical Industry | £550-£600 per day | Outside IR35 London (Hybrid - 2 days onsite) | 12 months + extension likely We're hiring multiple Contract Data Engineers to support a leading global pharmaceutical organisation as they scale a modern, cloud-based data platform driving clinical, regulatory, and commercial insights. This is an opportunity to work on high-impact data solutions that directly support drug development, research analytics, and patient outcomes within a highly regulated environment. What You'll Be Doing: Designing and optimising Snowflake data pipelines within a secure, GxP-aligned architecture Building robust transformation layers using DBT (Cloud/Core) Developing scalable data models to support clinical, R&D, and commercial reporting Writing high-performance SQL and leveraging Python for orchestration and automation Contributing to the evolution of a modern, analytics-driven...

Azure Data Engineer | Outside IR35 | £400 - £450 | 6 months | Hybrid Liverpool You'll be designing, developing, and managing data pipelines across Azure, primarily using Azure Data Factory to integrate multiple data sources and deliver streamlined workflows into Azure SQL. A strong grasp of Python will be essential as you'll be transforming, cleansing, and validating complex datasets to ensure they're accurate, efficient, and ready for analytics and product teams to leverage. This position plays a key role in supporting ongoing modernisation efforts by strengthening the way data is collected, processed, and made available across the business. Responsibilities Build, maintain, and improve scalable ETL/ELT pipelines using Azure Data Factory Model, manage, and optimise datasets within Azure SQL Use Python and Pandas for data preparation, transformation, and quality checks Work closely with engineering, product, and analytics teams to understand data requirements and...

Role: Data Engineer (Python, PySpark, SQL) Day rate: £400pd-£440pd (Outside IR35) Contract: 6 months initial We are seeking a highly skilled Data Engineer to support a Material Spend Project. You will play a crucial role in extracting, transforming, and analysing large data sets from multiple sources, including API integrations and ServiceNow, to drive actionable insights and support strategic decision-making. Skills and experience required: Strong experience developing ETL/ELT pipelines using PySpark and Python Hands-on experience with Microsoft Fabric lakehouse or similar cloud data platforms (Azure Synapse Analytics, Databricks) Proficiency in working with Jupyter/Fabric Notebooks for data engineering workflows Solid understanding of data lakehouse architecture patterns and medallion architecture API Integration experience Experience working with Delta Lake or similar lakehouse storage formats Strong SQL skills for data manipulation, transformation, and quality...

Fabric Data Engineer £500-600 per day 6-12 months durations Outside IR35 Fully Renote - UK based applicants with RTW (no sponsorship offered) Fabric Data Engineer x 3 We are seeking a skilled Fabric Data Engineers to design, build, and optimize scalable data solutions using Microsoft Fabric. The ideal candidate will have strong expertise in modern data architecture, cloud-based analytics, and end-to-end data pipeline development. You will work closely with data analysts, data scientists, and business stakeholders to deliver high-quality, reliable, and secure data solutions that drive strategic decision-making. Key Responsibilities Design, develop, and maintain scalable data pipelines using Microsoft Fabric, including: Data Factory for orchestration and ingestion Lakehouse architecture for unified analytics Warehouse for structured data modeling Build and optimize data solutions leveraging Azure Data Factory, Azure Synapse Analytics, and Power...

Data Engineer l Informatica l Data governance l SQL Database l Databricks l Stakeholder management l integration l Financial Services I £500- £525 per day | Outside IR35 | 3-6-month initial | Hybrid Remote - London One of my consulting partners is kicking off a major data governance and integration programme for a leading insurance client, and we 're looking for three strong Data Engineers with deep experience implementing and optimising Informatica solutions end-to-end from both on prem and cloud systems. Core Skills Required Extensive Informatica experience (IICS / PowerCenter / IDMC) across design, build, integration, and deployment Strong background in Data Governance , including: Enterprise metadata management Data lineage setup and optimisation Data quality rules, profiling, and stewardship workflows Policy framework implementation Governance operating model support Experience working with Informatica...

Azure Data Engineer | Outside IR35 | £400 - £450 | 6 months | Hybrid Liverpool You'll be designing, developing, and managing data pipelines across Azure, primarily using Azure Data Factory to integrate multiple data sources and deliver streamlined workflows into Azure SQL. A strong grasp of Python will be essential as you 'll be transforming, cleansing, and validating complex datasets to ensure they're accurate, efficient, and ready for analytics and product teams to leverage. This position plays a key role in supporting ongoing modernisation efforts by strengthening the way data is collected, processed, and made available across the business. Responsibilities Build, maintain, and improve scalable ETL/ELT pipelines using Azure Data Factory Model, manage, and optimise datasets within Azure SQL Use Python and Pandas for data preparation, transformation, and quality checks Work closely with engineering, product, and analytics teams to understand data...

Role: Data Engineer (Python, PySpark, SQL) Day rate: £400pd- £440pd (Outside IR35) Contract: 6 months initial We are seeking a highly skilled Data Engineer to support a Material Spend Project. You will play a crucial role in extracting, transforming, and analysing large data sets from multiple sources, including API integrations and ServiceNow, to drive actionable insights and support strategic decision-making. Skills and experience required: Strong experience developing ETL/ELT pipelines using PySpark and Python Hands-on experience with Microsoft Fabric lakehouse or similar cloud data platforms (Azure Synapse Analytics, Databricks) Proficiency in working with Jupyter/Fabric Notebooks for data engineering workflows Solid understanding of data lakehouse architecture patterns and medallion architecture API Integration experience Experience working with Delta Lake or similar lakehouse storage formats Strong SQL skills for data...

🚀 Senior Data Engineer – Storage Optimisation Engagement 🚀 📍London (Hybrid) 📅 Starting ASAP for an initial 8 week engagement 💰 Outside IR35 - rate depending on experience We’re supporting a client looking for a Senior Data Engineer to lead a short-term, high-impact storage optimisation engagement within an ML-heavy environment. This is not a generic BAU role – it’s a focused piece of work with clear deliverables, governance ownership and measurable impact. 🔑 The Role • Assess large-scale storage usage across ML data prep, training and experimentation • Design and execute structured clean-up & optimisation strategies • Implement retention policies and lifecycle governance • Reduce reliance on manual storage management • Deliver a high-level data engineering roadmap • You’ll work closely with ML and Infrastructure engineers, mapping workflows and introducing sustainable improvements. 🎯 We’re looking for someone who: 👉 Has strong...

Our sister company Stellarmann is seeking an experienced Data Engineer to support a London Market Insurance client in building a modern Azure data environment. The Data Engineer will work alongside the wider team in building a modern Data Lakehouse with three tiers. We're seeking someone with: Proven experience as a Data Engineer Strong hands on experience with Azure Databricks and Azure Data Factory Experience in the Lloyd's/London Market (specialty insurance) Proficiency in Python Experience with SQL Server Exposure to DevOps automation and deployment pipelines (YAML) Experience working with Medallion architecture/tiered medallion Lakehouse Strong understanding of Delta Lakes and Delta Tables Experience using Databricks Notebooks for data pipelines The initial engagement will run until early September 2026 and the role is paying a competitive day rate outside IR35, offering hybrid working in the London office (2 days per week). If this...

Role Overview We are seeking a skilled Data Engineer with strong expertise in Microsoft Azure and Databricks to design, build, and optimize scalable data pipelines and analytics solutions. You will play a key role in building modern data platforms that support business intelligence, advanced analytics, and machine learning initiatives. This role requires hands-on experience with cloud-native data architectures, distributed processing, and best practices in data engineering. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and related Azure services Build and optimize data workflows using Apache Spark within Databricks Develop and maintain data lakes and lakehouse architectures using Azure Data Lake Storage Implement data modeling solutions for analytics and reporting Ensure data quality, governance, and security best practices Collaborate with data analysts, data scientists, and business...

Data Engineer | Outside IR35 | £400 - £500 | 6 months | Hybrid Nottingham We’re looking for a highly skilled Data Engineer to join a growing data team supporting a large-scale modern data platform project. Working 3 days a week onsite on the outskirts of Nottingham, you'll be a key contributor in evolving the organisation’s data capability, focusing on best‑practice engineering, clean architecture, and high‑value BI delivery.Key Responsibilities Design, build and optimise ETL/ELT pipelines using Azure Data Factory and Databricks. Develop scalable data models and transformations using SQL and Python. Work hands‑on with Databricks (Lakehouse, Delta tables, notebooks, workflows). Deliver high-quality dashboards and reporting solutions using Power BI. Implement best practices for data quality, governance, lineage and automation. Collaborate with cross‑functional teams including analysts, product owners and business stakeholders. Support performance tuning, cost optimisation and...

Data Engineer | Outside IR35 | £400 - £500 | 6 months | Hybrid Nottingham We’re looking for a highly skilled Data Engineer to join a growing data team supporting a large-scale modern data platform project. Working 3 days a week onsite on the outskirts of Nottingham, you'll be a key contributor in evolving the organisation’s data capability, focusing on best‑practice engineering, clean architecture, and high‑value BI delivery. Key Responsibilities Design, build and optimise ETL/ELT pipelines using Azure Data Factory and Databricks. Develop scalable data models and transformations using SQL and Python . Work hands‑on with Databricks (Lakehouse, Delta tables, notebooks, workflows). Deliver high-quality dashboards and reporting solutions using Power BI . Implement best practices for data quality, governance, lineage and automation. Collaborate with cross‑functional teams including analysts, product owners and business stakeholders. Support performance...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration layer to replace legacy systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part of integration improvements. Rebuild and enhance data flows between Salesforce and other systems. Design and implement a new integration layer to replace old estate connections. Key Skills & Experience: Proven experience as a Databricks Specialist in enterprise environments. Strong knowledge of Azure Data...