175 data engineer jobs found

Lead Snowflake Data Engineer - £550pd - Outside IR35 High Level Overview: Remote First (UK Based) £500-£550 per day Outside IR35 Initial 6-Month Contract Financial Services Client The Opportunity We're supporting a leading financial services organisation on a major data transformation programme and are looking for an experienced Lead Snowflake Data Engineer to drive delivery across critical data initiatives. Key Requirements Extensive Snowflake experience Proven track record delivering complex data solutions within Financial Services Strong experience building and optimising data pipelines and transformations Expertise in data reconciliations and data quality controls Experience supporting remediation, regulatory reporting, and customer treatment programmes Strong stakeholder management and technical leadership skills Highly Desirable Consultancy background Experience within FCA-regulated environments Financial Services domain expertise...

Data Engineer / Data Engineering / Azure / Databricks / Ingestion / Pipelines / Insurance / Financial Services / 3 month contract / Outside IR35 / Fully remote One of our leading clients is looking to recruit a Data Engineer. Location – fully remote / home based Duration – 3 months plus possible extension Outside IR35 Role / Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Implement layered data model (bronze / silver / gold) for ingestion, processing, and reporting Develop ingestion patterns from API sources (batch and streaming) Establish data governance, metadata, and access controls Define storage structures, naming conventions, and schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark / Python (data cleansing, standardisation, validation) Configure monitoring, logging, and...

Lead Snowflake Data Engineer Remote First (UK Based) £500-£550 per day Outside IR35 Initial 6-Month Contract Financial Services Client The Opportunity We're supporting a leading financial services organisation on a major data transformation programme and are looking for an experienced Lead Snowflake Data Engineer to drive delivery across critical data initiatives. Key Requirements Extensive Snowflake experience Proven track record delivering complex data solutions within Financial Services Strong experience building and optimising data pipelines and transformations Expertise in data reconciliations and data quality controls Experience supporting remediation, regulatory reporting, and customer treatment programmes Strong stakeholder management and technical leadership skills Highly Desirable Consultancy background Experience within FCA-regulated environments Financial Services domain expertise Join a programme where your work directly influences...

We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory reporting or financial services Exposure to Tagetik...

Senior Data Engineer Location: London (Hybrid Working) Type: Contract Pay Rate: £350-£400 (Outside IR35) We're looking for a Senior Data Engineer to join a high-performing data team responsible for delivering scalable, reliable, and innovative data solutions that power analytics and decision-making across a global streaming and digital ecosystem. This is an opportunity to work with modern cloud technologies, large-scale datasets, and a collaborative engineering culture where you'll help shape the future of data platforms used by millions of customers worldwide. What You'll Be Doing Design, build, and support scalable data models and distributed ETL pipelines using modern big data technologies. Collaborate with stakeholders across multiple business functions to understand data challenges and translate requirements into robust technical solutions. Champion DataOps principles, engineering best practices, and continuous improvement initiatives....

Senior Data Engineer Location: Bristol Contract: Outside IR35 Rate: £68 per hour Security Clearance: DV Cleared Working Pattern: 5 Days On Site Nationality Requirement: Sole British Nationals Only THE ROLE We are recruiting on behalf of a highly secure engineering and technology programme seeking an experienced Senior Data Engineer to support the design, development and delivery of secure, scalable and hi click apply for full job details

Senior Data Engineer - Azure Central government | Outside IR35 | Remote | 6 months + SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets. You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial. Requirements: Strong commercial experience delivering data engineering solutions in Azure. Strong hands-on experience working with...

BRAND NEW CONTRACT - Principal AWS Data Engineer - Fully Remote - up to £750 p/d - Outside IR35 Day Rate. This is a 6-week contract to support an AI/ML startup that is at the pre-seed stage on a go-live project. There is also room for extension. They are looking for someone who has worked in fast-paced environments, such as gambling etc or start-up environments. A lot of the work is going to be a mix of hands-on and reviewing architecture. For this contract, you will need experiance with Amazon Web Services (predominantly EKS, S3, RedShift) Kafka Flink (Or equivalent) Python or Java Strong architecture experience Real-time data pipelines at scale Testing pipelines Desirable: AI/ML work CI/CD They are also looking for this person to start immediately. They can move very quickly, and the interview process is only a one-stage process.

Senior Data Engineer – Azure Central government | Outside IR35 | Remote | 6 months + SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets. You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial. Requirements: Strong commercial experience delivering data engineering solutions in Azure. Strong hands-on experience...

Data Engineer / Data Engineering / Azure / Databricks / Ingestion / Pipelines / Insurance / Financial Services / 2-3 month contract / Outside IR35 / Fully remote One of our leading clients is looking to recruit a Data Engineer. Location – fully remote / home based Duration – 2-3 months plus possible extension Outside IR35 Role / Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Implement layered data model (bronze / silver / gold) for ingestion, processing, and reporting Develop ingestion patterns from API sources (batch and streaming) Establish data governance, metadata, and access controls Define storage structures, naming conventions, and schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark / Python (data cleansing, standardisation, validation) Configure monitoring, logging, and...

Contract – Senior Data Engineer Contract : 6 month sRate : £750 - £800 PD (Outside IR35 )Location : London / Hybrid x2 days onsit e Overvi ewWe are seeking an experienced Senior Data Engineer to join a major data programme transforming how organisations and industry partners access and use health data across the UK. You will design, build and optimise scalable data platforms and pipelines that enable secure, trusted and efficient access to health data. You will collaborate closely with architects, product teams, analysts and engineers to deliver high-quality data solutions that support research, innovation and operational decision-making. This role is ideal for a hands-on Data Engineer who enjoys solving complex data challenges, working with large datasets and building modern cloud-based data solutions within regulated environment s. Role & Responsibilit iesData Engineering & Platform Developm entDesign, build and maintain scalable data...

Azure / Microsoft Fabric Data Engineer - remote - 1 x contract - outside IR35 and 1 x permanent. You will be an experienced Azure/Microsoft Fabric Data Engineer and will help design, build and maintain modern data platforms. The role will focus on Microsoft Fabric, Azure data services, Lakehouse architecture, data ingestion, transformation, modelling, governance and AI-ready analytics. Skills/Experience Strong experience with Microsoft Azure data services and modern cloud data engineering. Hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, Pipelines, Dataflows, Notebooks and Power BI. Good understanding of data lake, lakehouse and warehouse architecture. Experience building data ingestion and transformation pipelines from multiple source systems. Strong SQL skills and experience working with relational data models. Experience with Python and/or PySpark for data transformation and automation. Understanding of Power BI, semantic models, DAX...

Senior Data Engineer | Up to £650 per day | Outside IR35 | Fully Remote We are seeking an experienced Senior Data Engineer to join a fast-paced technology business on an initial 6-week contract, with the potential for extension. This is a fully remote opportunity offering up to £650 per day Outside IR3 5 and requires someone who can make an immediate impact from day one . This role will focus on designing, building, and optimising large-scale data platforms and distributed systems within a high-volume, real-time environment. You will work across stream processing, data architecture, multi-tenant data models, validation frameworks, and cloud infrastructure, helping to deliver critical business initiatives within tight timescale s. Key Responsibiliti es:Design and implement scalable, production-grade data pipelines and streaming soluti onsBuild and maintain real-time data processing capabilities using Kafka and stream processing technolog iesDesign and...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks-based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory...

Data Engineer / Data Engineering / Azure / Databricks / Ingestion / Pipelines / Insurance / Financial Services / 2-3 month contract / Outside IR35 / Fully remote One of our leading clients is looking to recruit a Data Engineer. Location – fully remote / home based Duration – 2-3 months plus possible extension Outside IR35 Role / Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Implement layered data model (bronze / silver / gold) for ingestion, processing, and reporting Develop ingestion patterns from API sources (batch and streaming) Establish data governance, metadata, and access controls Define storage structures, naming conventions, and schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark / Python (data cleansing, standardisation, validation) Configure monitoring, logging, and...

Azure/Microsoft Fabric Data Engineer - remote - outside IR35 - £500 - 535 (and a perm role - up to £80k) You will be an experienced Azure/Microsoft Fabric Data Engineer and will help design, build and maintain modern data platforms. The role will focus on Microsoft Fabric, Azure data services, Lakehouse architecture, data ingestion, transformation, modelling, governance and AI-ready analytics. Skills/Experience Strong experience with Microsoft Azure data services and modern cloud data engineering. Hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, Pipelines, Dataflows, Notebooks and Power BI. Good understanding of data lake, lakehouse and warehouse architecture. Experience building data ingestion and transformation pipelines from multiple source systems. Strong SQL skills and experience working with relational data models. Experience with Python and/or PySpark for data transformation and automation. Understanding of Power BI, semantic models, DAX and...

Full job description Azure/Microsoft Fabric Data Engineer - remote - outside IR35 - £500 - 535 (and a perm role - up to £80k) You will be an experienced Azure/Microsoft Fabric Data Engineer and will help design, build and maintain modern data platforms. The role will focus on Microsoft Fabric, Azure data services, Lakehouse architecture, data ingestion, transformation, modelling, governance and AI-ready analytics. Skills/Experience Strong experience with Microsoft Azure data services and modern cloud data engineering. Hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, Pipelines, Dataflows, Notebooks and Power BI. Good understanding of data lake, lakehouse and warehouse architecture. Experience building data ingestion and transformation pipelines from multiple source systems. Strong SQL skills and experience working with relational data models. Experience with Python and/or PySpark for data transformation and...

Azure/Microsoft Fabric Data Engineer - remote - outside IR35 - £500 - 535 (and a perm role - up to £80k) You will be an experienced Azure/Microsoft Fabric Data Engineer and will help design, build and maintain modern data platforms. The role will focus on Microsoft Fabric, Azure data services, Lakehouse architecture, data ingestion, transformation, modelling, governance and AI-ready analytics. Skills/Experience Strong experience with Microsoft Azure data services and modern cloud data engineering. Hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, Pipelines, Dataflows, Notebooks and Power BI. Good understanding of data lake, lakehouse and warehouse architecture. Experience building data ingestion and transformation pipelines from multiple source systems. Strong SQL skills and experience working with relational data models. Experience with Python and/or PySpark for data transformation and automation. Understanding of Power BI, semantic models,...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer/Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in...

Data Engineer/Data Engineering/Azure/Databricks/Ingestion/Pipelines/Insurance/Financial Services/2-3 month contract/Outside IR35/Fully remote One of our leading clients is looking to recruit a Data Engineer. Location - fully remote/home based Duration - 2-3 months plus possible extension Outside IR35 Role/Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Implement layered data model (bronze/silver/gold) for ingestion, processing, and reporting Develop ingestion patterns from API sources (batch and streaming) Establish data governance, metadata, and access controls Define storage structures, naming conventions, and schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and alerting Execute unit...