67 data engineer jobs found

Azure Data Engineer | Outside IR35 | £400 - £450 | 6 months | Hybrid LiverpoolYou’ll be designing, developing, and managing data pipelines across Azure, primarily using Azure Data Factory to integrate multiple data sources and deliver streamlined workflows into Azure SQL. A strong grasp of Python will be essential as you'll be transforming, cleansing, and validating complex datasets to ensure they’re accurate, efficient, and ready for analytics and product teams to leverage. This position plays a key role in supporting ongoing modernisation efforts by strengthening the way data is collected, processed, and made available across the business. Responsibilities Build, maintain, and improve scalable ETL/ELT pipelines using Azure Data Factory Model, manage, and optimise datasets within Azure SQL Use Python and Pandas for data preparation, transformation, and quality checks Work closely with engineering, product, and analytics teams to understand data requirements and deliver robust...

Role: Data Engineer (Python, PySpark, SQL) Day rate: £400pd-£440pd (Outside IR35) Contract: 6 months initial We are seeking a highly skilled Data Engineer to support a Material Spend Project. You will play a crucial role in extracting, transforming, and analysing large data sets from multiple sources, including API integrations and ServiceNow, to drive actionable insights and support strategic decision-making. Skills and experience required: Strong experience developing ETL/ELT pipelines using PySpark and Python Hands-on experience with Microsoft Fabric lakehouse or similar cloud data platforms (Azure Synapse Analytics, Databricks) Proficiency in working with Jupyter/Fabric Notebooks for data engineering workflows Solid understanding of data lakehouse architecture patterns and medallion architecture API Integration experience Experience working with Delta Lake or similar lakehouse storage formats Strong SQL skills for data manipulation, transformation, and quality...

Senior Data Engineer – Contract (Outside IR35) 📍 Newcastle (3 days onsite) | 🏡 2 days WFH 💰 £500–£700 per day | 📅 6–12 Month Project We’re looking for an experienced Senior Data Engineer to join a high-impact programme delivering scalable, cloud-based data solutions for a major organisation based in Newcastle. This is a 6–12 month contract , outside IR35 , offering a competitive day rate and a flexible hybrid working model. 🔎 The Role You’ll play a key role in designing, building, and optimising robust data pipelines and cloud-native data platforms. Working closely with architects, analysts, and engineering teams, you’ll help drive best practice in data engineering and deliver reliable, high-performance solutions. 🛠 Key Responsibilities Design and build scalable data pipelines using Python and SQL Develop and optimise big data solutions using Apache Spark Implement and manage cloud-based data platforms within AWS Build and maintain...

Data Engineer l Informatica l Data governance l SQL Database l Databricks l Stakeholder management l integration l Financial Services I £500-£525 per day Outside IR35 3-6-month initial Hybrid Remote - London One of my consulting partners is kicking off a major data governance and integration programme for a leading insurance client, and we're looking for three strong Data Engineers with deep experience implementing and optimising Informatica solutions end-to-end from both on prem and cloud systems. Core Skills Required Extensive Informatica experience (IICS / PowerCenter / IDMC) across design, build, integration, and deployment Strong background in Data Governance , including: Enterprise metadata management Data lineage setup and optimisation Data quality rules, profiling, and stewardship workflows Policy framework implementation Governance operating model support Experience working with Informatica Data Quality (IDQ) , Axon , or similar governance...

Senior Data Engineer - Azure, Databricks, Datafactory, Phinsys Tandem, Insurance Our sister company Stellarmann is seeking an experienced Data Engineer to join their team, who are building out a new data platform for processing Finance and Actuarial data. You will be working as part of a talented team building a cutting edge data platform using Azure Databricks, Datafactory and Python integrating with Phinsys Tandem. We're seeking someone with: Proven experience as a Data Engineer Strong hands on experience with Azure Databricks and Azure Data Factory Experience in the Lloyd's/London Market (specialty insurance) Experience working with Phinsys Tandem - essential Proficiency in Python Experience working with Medallion architecture/tiered medallion Lakehouse Experience using Databricks Notebooks for data pipelines This is a 6 month initial engagement, outside IR35 with scope to extend beyond the initial term. If this opportunity aligns with your...

Role: Data Engineer (Python, PySpark, SQL) Day rate: £400pd-£440pd (Outside IR35) Contract: 6 months initial We are seeking a highly skilled Data Engineer to support a Material Spend Project. You will play a crucial role in extracting, transforming, and analysing large data sets from multiple sources, including API integrations and ServiceNow, to drive actionable insights and support strategic decision-making. Skills and experience required: Strong experience developing ETL/ELT pipelines using PySpark and Python Hands-on experience with Microsoft Fabric lakehouse or similar cloud data platforms (Azure Synapse Analytics, Databricks) Proficiency in working with Jupyter/Fabric Notebooks for data engineering workflows Solid understanding of data lakehouse architecture patterns and medallion architecture API Integration experience Experience working with Delta Lake or similar lakehouse storage formats Strong SQL skills for data manipulation, transformation, and quality...

Azure Data Engineer | Outside IR35 | £400 - £450 | 6 months | Hybrid Liverpool You'll be designing, developing, and managing data pipelines across Azure, primarily using Azure Data Factory to integrate multiple data sources and deliver streamlined workflows into Azure SQL. A strong grasp of Python will be essential as you'll be transforming, cleansing, and validating complex datasets to ensure they're accurate, efficient, and ready for analytics and product teams to leverage. This position plays a key role in supporting ongoing modernisation efforts by strengthening the way data is collected, processed, and made available across the business. Responsibilities Build, maintain, and improve scalable ETL/ELT pipelines using Azure Data Factory Model, manage, and optimise datasets within Azure SQL Use Python and Pandas for data preparation, transformation, and quality checks Work closely with engineering, product, and analytics teams to understand data requirements and...

Role Overview We are seeking a skilled Data Engineer with strong expertise in Microsoft Azure and Databricks to design, build, and optimize scalable data pipelines and analytics solutions. You will play a key role in building modern data platforms that support business intelligence, advanced analytics, and machine learning initiatives. This role requires hands-on experience with cloud-native data architectures, distributed processing, and best practices in data engineering. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and related Azure services Build and optimize data workflows using Apache Spark within Databricks Develop and maintain data lakes and lakehouse architectures using Azure Data Lake Storage Implement data modeling solutions for analytics and reporting Ensure data quality, governance, and security best practices Collaborate with data analysts, data scientists, and business...

Data Engineer | Outside IR35 | £400 - £500 | 6 months | Hybrid Nottingham We’re looking for a highly skilled Data Engineer to join a growing data team supporting a large-scale modern data platform project. Working 3 days a week onsite on the outskirts of Nottingham, you'll be a key contributor in evolving the organisation’s data capability, focusing on best‑practice engineering, clean architecture, and high‑value BI delivery.Key Responsibilities Design, build and optimise ETL/ELT pipelines using Azure Data Factory and Databricks. Develop scalable data models and transformations using SQL and Python. Work hands‑on with Databricks (Lakehouse, Delta tables, notebooks, workflows). Deliver high-quality dashboards and reporting solutions using Power BI. Implement best practices for data quality, governance, lineage and automation. Collaborate with cross‑functional teams including analysts, product owners and business stakeholders. Support performance tuning, cost optimisation and...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

Data Engineer | Outside IR35 | £400 - £500 | 6 months | Hybrid Nottingham We're looking for a highly skilled Data Engineer to join a growing data team supporting a large-scale modern data platform project. Working 3 days a week onsite on the outskirts of Nottingham, you'll be a key contributor in evolving the organisation's data capability, focusing on best practice engineering, clean architecture, and high value BI delivery. Key Responsibilities Design, build and optimise ETL/ELT pipelines using Azure Data Factory and Databricks. Develop scalable data models and transformations using SQL and Python . Work hands on with Databricks (Lakehouse, Delta tables, notebooks, workflows). Deliver high-quality dashboards and reporting solutions using Power BI . Implement best practices for data quality, governance, lineage and automation. Collaborate with cross functional teams including analysts, product owners and business stakeholders. Support performance tuning,...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35)Location: Hybrid in South Wales Role OverviewWe are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands‑on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark‑driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time‑aware joins and dimensional transformations Support optimisation of Spark workloads and Delta tables Solid...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35) Location: Hybrid in South Wales Role Overview We are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands-on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark-driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time-aware joins and dimensional transformations Support optimisation of Spark workloads and Delta tables...

Contract Data Engineer - ASAP Start £425/day | Liverpool | 6 months Initially We're looking for a Contract Data Engineer who can hit the ground running and help accelerate a major digital transformation. If you enjoy working in fast-paced environments, shaping data pipelines, and bringing clarity to complex data flows, this role should land well. What You'll Be Working On You'll be responsible for building and maintaining end-to-end data pipelines using Azure Data Factory, connecting varied data sources and orchestrating workflows into Azure SQL for downstream consumption. You'll use Python and Pandas to transform, cleanse, and validate data, ensuring accuracy, performance, and reliability across the pipeline. This role is all about enabling high-quality, well-structured data that feeds analytics, reporting, and product-led decision-making. Key Responsibilities Design, build, and optimise scalable ETL/ELT pipelines in Azure Data Factory Work with Azure SQL to...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35) Location: Hybrid in South Wales Role Overview We are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands-on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark-driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time-aware joins and dimensional transformations Support optimisation of Spark workloads and Delta tables...

Details Newbury Hybrid 2 days onsite mandatory Client Gamma RRF ID 2026-18851 £400 per day Outside IR35 Duration 3 months initial Start ASAP Overview We are looking for an experienced Data Engineer to design and deliver scalable, secure, and high performance data solutions. The role focuses heavily on Snowflake architecture, cloud data platforms, and modern data pipeline development. Key Responsibilities Design and architect data solutions using Snowflake Optimise workflows and integrations using Openflow Develop and maintain ETL and ELT pipelines from Salesforce, relational databases, files, and NoSQL sources Implement dimensional modelling to support data warehousing and BI reporting Build and optimise data pipelines across Azure and AWS Ensure data quality, governance, and security best practices Enable reporting and analytics through Power BI and Tableau integration Collaborate with cross functional teams to translate business requirements into...

Senior Data Engineer - Azure Databricks (Contract) ?? Fully Remote | ? 3 months (Likely to Extend) | ?? Outside IR35 I'm supporting a client who is looking for an experienced Senior Data Engineer with strong Azure and Databricks skills to join them on an initial 3-month contract , with a high likelihood of extension. What you'll work on Building and optimising scalable data pipelines in Azure and Databricks Supporting data engineering best practices across cloud environments Collaborating with cross-functional teams to deliver high-quality data solutions What we're looking for Strong commercial experience with Azure & Databricks Skilled Senior Data Engineer with a track record of delivering in fast-paced environments Health/Life Sciences experience is highly beneficial (candidates with thisd experience will be prioritised) Contract details Duration: 3 months (likely to extend) IR35: Outside IR35 Location: Fully remote

Fabric Data Engineer - Outside IR35 - Hybrid We are seeking a skilled Fabric Data Engineer to design, build, and optimize scalable data solutions using Microsoft Fabric. The ideal candidate will have strong expertise in modern data architecture, cloud-based analytics, and end-to-end data pipeline development. You will work closely with data analysts, data scientists, and business stakeholders to deliver high-quality, reliable, and secure data solutions that drive strategic decision-making. Key Responsibilities Design, develop, and maintain scalable data pipelines using Microsoft Fabric, including: Data Factory for orchestration and ingestion Lakehouse architecture for unified analytics Warehouse for structured data modelling Build and optimize data solutions leveraging Azure Data Factory, Azure Synapse Analytics, and Power BI. Develop ETL/ELT processes to ingest, transform, and load data from various sources (APIs, databases, flat files, streaming sources)....

Technical Data Engineer / Analyst | Contract | Azure | 6 months | Hybrid | Outside IR35 | £400 - £475 | Nottingham |We’re supporting a major data transformation programme and looking for a Technical Data Analyst to help migrate legacy systems into a modern Azure data platform. This is a hybrid role 3 days a week in the Nottingham office which is none negotiable. This is a ideal role for someone who is looking for hands on experience with Azure analytics tools and thrives in a data heavy environment.What you'll be doing: Analysing, understanding, and documenting legacy data structures Supporting data model mapping from old systems into the new Azure platform Validating migrated datasets for accuracy and completeness Creating reporting assets and dashboards using Power BI Working with engineers to identify data issues, test pipeline outputs, and improve overall data quality Key Skills Strong SQL skills and experience working with Azure‑hosted datasets Power BI...