126 data engineer jobs found

Senior Data Engineer - Elastic Stack / Apache NiFi 📍 Worcester (Onsite) 💰 £70-£75 per hour | Outside IR35 📅 12-Month Rolling Contract ⏰ Compressed Working Available - Work 3 Long Days, Paid for 5 We are seeking an experienced Senior Data Engineer to join a high-profile programme delivering secure, scalable data platforms within a highly regulated environment. This is an exciting opportunity to work on complex data engineering challenges using cutting-edge technologies, with the flexibility of compressed working patterns. The Opportunity As a Senior Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and platforms. You will work closely with architects, engineers, and security teams to deliver high-performance data solutions that meet stringent security and governance requirements. This role is fully onsite in Worcester, with the option to work a compressed schedule (e.g. three extended working days...

Senior Data Engineer - Elastic Stack/Apache NiFi ?? Worcester (Onsite) ?? £70-£75 per hour | Outside IR35 ?? 12-Month Rolling Contract ? Compressed Working Available - Work 3 Long Days, Paid for 5 We are seeking an experienced Senior Data Engineer to join a high-profile programme delivering secure, scalable data platforms within a highly regulated environment. This is an exciting opportunity to work on complex data engineering challenges using cutting-edge technologies, with the flexibility of compressed working patterns. The Opportunity As a Senior Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and platforms. You will work closely with architects, engineers, and security teams to deliver high-performance data solutions that meet stringent security and governance requirements. This role is fully onsite in Worcester , with the option to work a compressed schedule (eg three extended working days while being...

Data Engineer (SC & NPPV3 Cleared) - Contract (Outside IR35) Location: London (3 days onsite per week) Duration: 3 months (initial) Rate: Up to £570 per day (Outside IR35) Start: ASAP We are currently seeking an experienced Data Engineer for an urgent contract opportunity with a London-based client click apply for full job details

Data Engineer Programme: Niche RMS Replacement Day Rate: £500/day IR35: Outside Duration: Until Feb 2027 Location: Hybrid - 2-3 days/month onsite in Warwickshire You'll join as a Data Engineer Specialist , playing a key role in designing and delivering the data migration, pipelines, and analytics layer that underpins the new system. What You'll Be Doing Design & build scalable data pipelines for migration and reporting Deliver ETL/ELT processes across Legacy (Athena/Connect) and Niche Drive data transformation, validation, and cleansing to ensure integrity and compliance Work with suppliers and architects on data models and migration strategy Support trial migrations, UAT, dress rehearsals, and final cutover Produce reporting-ready datasets and analytics outputs Key Skills Required Strong Data Engineering experience in large-scale programmes Proven data migration & transformation expertise Advanced ETL/ELT & data pipeline...

Senior data Engineer - Quantexa - 6-months - £500 p/d (Outside IR35) We're partnering with a leading global professional services organisation to hire a Senior Data Engineer with strong Quantexa experience to lead the delivery of large-scale, data-driven solutions for enterprise clients. What you'll do Lead development of Quantexa-based data solutions Build and optimise data pipelines using Spark, Scala, Databricks & Python Configure Quantexa components (Entity Resolution, Scoring, Network Generation) Work with Architects and Tech Leads to design scalable, production-ready solutions Support integration into wider enterprise data platforms (cloud, DevOps, security) What you need Quantexa Technical Certification (required) Strong hands-on Quantexa delivery experience Background leading data engineering or integration projects for enterprise clients Strong skills in Scala, Python, Databricks Nice to have Financial Services/AML/Fraud/KYC...

Contract Outside IR35 Senior Data Engineer/Python/C# Developer - Energy Trading - London Up to £600 per day *Only candidates with Power/Gas/LNG/Oil/Ags/Metals commercial experience will be considered* Global Energy Trading company is embarking on a new Digitalisation Program, to transform how data is managed and utilised within the Energy business. The ambition is to deliver next generation of big data infrastructure, develop a range of data-driven, highly automated data pipelines to facilitate and enhance the trading business, as well as optimisation of physical assets. Working together with the Data Team, you will be developing the next generation of Data Infrastructure. Working with data pipelines, data management, and data analysis to help automate and optimise business. The role will require versatility as the individual will be required to work on Python and/or C# related projects in addition. The role Develop, construct, test and maintain data pipelines...

Data Engineer – Python, Azure, Snowflake, Large‑Scale Enterprise Environment – OUTSIDE IR35 We’re looking for a skilled Data Engineer to join our enterprise data organisation and help shape the next generation of our cloud‑native data platform. If you enjoy solving complex data problems at scale, building robust pipelines, and working with modern tooling across Azure and Snowflake , this is the kind of role where your work genuinely moves the needle. What you’ll be working on: Designing and building high‑performance data pipelines using Python and SQL Developing scalable ELT/ETL workflows across Azure Data Factory , Azure Functions , Databricks , or similar cloud services Implementing and optimising Snowflake data models, warehouses, and performance tuning Partnering with product, analytics, and engineering teams to deliver clean, reliable, well‑documented data Contributing to enterprise‑wide data governance, quality frameworks, and best practices...

Senior Data Engineer - Outside IR35 - Contract (Insurance Client) About the role Softwire is seeking an experienced Data Engineer with a strong knowledge of Python (including PySpark) and SQL, and a good understanding of software engineering best practices (including SDLC, CI/CD, automated testing, DevOps) to join an established small team working on delivering a data & analytics platform in Microsoft Fabric for a speciality insurance provider. This is a senior, hands-on role that will require owning and delivering workstreams independently while supporting a junior team member. Key Responsibilities Building new ingestion pipelines in Microsoft Fabric using Python (PySpark) notebooks Modelling data for consumption in Power BI through a dimensional gold warehouse layer and a semantic model Improving platform performance Working across cross-functional areas such as logging, monitoring (with Azure Log Analytics and Fabric) and data governance (within...

Data Engineer (Contract) Cloud / Data Platform Location: London (Hybrid) Rate: £550–£700 per day (Outside IR35) Contract: 6 months (likelihood of extension) We’re working with a growing financial services organisation investing heavily in its data platform and AI capabilities. They’re building out a modern, cloud-first data environment and need an experienced Data Engineer to help design and scale robust data pipelines What we're looking for: Strong experience as a Data Engineer in production environments Experience building cloud-based data platforms Ability to work in fast-paced, delivery-focused teams Strong communication - able to work with both technical & business stakeholders Tech Stack: Python / SQL AWS / Azure / GCP Snowflake or Databricks Airflow / dbt APIs / data integration tools If you’re available (or becoming available) and this aligns with what you’re looking for - feel free to apply.

Data Engineer - Python, Azure, Snowflake, Large-Scale Enterprise Environment - OUTSIDE IR35 We're looking for a skilled Data Engineer to join our enterprise data organisation and help shape the next generation of our cloud-native data platform. If you enjoy solving complex data problems at scale, building robust pipelines, and working with modern tooling across Azure and Snowflake , this is the kind of role where your work genuinely moves the needle. What you'll be working on: Designing and building high-performance data pipelines using Python and SQL Developing scalable ELT/ETL workflows across Azure Data Factory , Azure Functions , Databricks , or similar cloud services Implementing and optimising Snowflake data models, warehouses, and performance tuning Partnering with product, analytics, and engineering teams to deliver clean, reliable, well-documented data Contributing to enterprise-wide data governance, quality frameworks, and best practices...

Data Engineer (SC & NPPV3) - £400/day Outside IR35 - 6 Month Contract - West Midlands (Occasional Visits) - SCC Flex Contract We are looking for a skilled Data Engineer (SC & NPPV3) to support with designing and delivering data migration, pipelines, and the analytics layer underpinning a critical new system, while working across Legacy systems (Athena/Connect) and Niche RMS. Your responsibilities as the Data Engineer (SC & NPPV3): Design and build scalable data pipelines to support migration and reporting requirements Deliver ETL/ELT processes across Legacy systems (Athena/Connect) and Niche RMS Drive data transformation, cleansing, and validation to ensure accuracy, integrity, and compliance Collaborate with suppliers, architects, and stakeholders on data models and migration strategies Support trial migrations, user acceptance testing (UAT), dress rehearsals, and final cutover Produce high-quality, reporting-ready datasets and analytics outputs Ensure...

Databricks Platform Buildout Senior Data Engineer Outside IR35 Fully Remote £500 - £575 per day Overview & Objective We are seeking 3x Senior Data Engineers for a Databricks Platform Buildout project which is part of a bigger engagement. The main project focus is to review the group-level Databricks platform foundations to confirm readiness for replication and then rollout across country-level platforms. These Engineers will participate in the rollout and replication phase. Requirements 4+ Years Data Engineering Experience, 5+ years of consulting experience Minimum 2-3 projects delivered with hands-on experience in Databricks Experience in Spark and/or Hadoop, Familiarity with Databricks multi-hop pipeline architecture Technical Stack and Required Capabilities Python, SQL Strong Databricks knowledge (PySpark, SQL, Delta Lake, Unity Catalog) Azure ETL/ELT development and data pipeline orchestration (eg, Databricks Workflows,...

Location: Newcastle upon Tyne (primarily remote, occasional travel) Contract Type: Contract (Outside IR35) Day Rate: Up to £800 per day The Opportunity We're partnering with a highly respected Software business to find an experienced Data Engineer to support a major client engagement click apply for full job details

Postgres Data Engineer - Outside IR35/Remote We are looking for 3 to 4 Postgres data engineers from junior to senior level. You will have the following experience: - Good proficiency of SQL - Working experience on PostgreSQL - Experience in data analysis and data transformation - Experience in data remediations and data fix in production environment - Maintain highly scalable PostgreSQL and SQL database solutions. - Build, and Profile and optimize complex SQL queries, views, indexes, and stored procedures - Deliver robust ETL/ELT data pipelines to ingest, transform, and load data This will be on a 3 month contract (outside IR35) and is based remotely. Candidates need to be based in the UK. To be considered please send over your latest CV. LA International is an award-winning partner of choice for many of the world's most influential companies and government organisations. Holding Enhanced Government Security Accreditation, we are recognised as the European market...

Postgres Data Engineer - Outside IR35 / Remote We are looking for 3 to 4 Postgres data engineers from junior to senior level. You will have the following experience: - Good proficiency of SQL - Working experience on PostgreSQL - Experience in data analysis and data transformation - Experience in data remediations and data fix in production environment - Maintain highly scalable PostgreSQL and SQL database solutions. - Build, and Profile and optimize complex SQL queries, views, indexes, and stored procedures - Deliver robust ETL/ELT data pipelines to ingest, transform, and load data This will be on a 3 month contract (outside IR35) and is based remotely. Candidates need to be based in the UK. To be considered please send over your latest CV. LA International is an award-winning partner of choice for many of the world's most influential companies and government organisations. Holding Enhanced Government Security Accreditation, we are recognised as the European market...

Contract Data Engineer - Specialty Insurance Contract Length: 6 Months Location: Hybrid / London Rate: £475 - £500 per day IR35 Status: Outside IR35 Start Date: ASAP An experienced Data Engineer is required to take ownership of the build of a data pipeline to consolidate bordereaux reporting data into a standardised, reporting-ready structure. This is a hands-on delivery role sitting within the BI team, where you will act as the sole Data Engineer on the project, responsible for end-to-end pipeline development, design, and delivery. You will be building scalable Azure Databricks-based data pipelines, working independently to define and implement robust, production-ready solutions that support reporting and downstream analytics. Key Responsibilities Take ownership of the end-to-end build of a scalable ETL pipeline in Azure Databricks to ingest and consolidate bordereaux reporting data Design and implement data ingestion processes leveraging existing email-based...

Snowflake Data Engineer - 5 Months - Outside IR35 A leading tech company requires a data engineer for an initial 5-month contract. The position is hybrid, outside IR35, and will likely extend long-term due to the amount of work they have in the pipeline. The Role: You will be part of a rapidly growing data team helping to deliver their leading data platform, which is being used to drive key decision-making in renewable energy and its use around the world-tech for good, you could say! They are looking for a data engineer with demonstrable experience with Snowflake building complex systems to ingest and process large volumes of data. The main tools you will be using day to day are: ** Snowflake ** Python ** SQL ** DBT You: Our customer is looking for someone well-versed in the above tools/technologies. They also need someone who understands the principles of Data Engineering and is willing to roll up their sleeves, as this project is critical for them. As a Senior member...

Senior Data Engineer | Hybrid | Outside IR35 | £450 - £500 | Blackburn We are currently supporting a leading mechanical engineering company who are looking for a senior data engineer on an initial 3-month contract to support with their current projects they are falling behind on. This is a hybrid role working 2/3 days on site per week in Blackburn. Key requirements Extensive experience as a Senior Data Engineer Confident with the whole Azure tech stack Microsoft Fabric experience Strong data governance and data warehousing Exposure to Ai is a added benefit but not crucial If this is a role that suits your skill set and can work 2/3 days on site then please apply directly with your most up to date CV or email me at (url removed).

Job Title: Data Engineer Location: UK Remote Contract: Outside IR35 Duration: 6 months initially Why Apply? An exciting opportunity for a Data Engineer to support the delivery of modern data and analytics solutions for a leading organisation. This role is ideal for someone who enjoys working across data engineering, data architecture, and analytics, helping to design and deliver scalable data platforms within a Microsoft environment. Responsibilities: Design, develop, and optimise data pipelines and ELT processes across multiple data sources and systems. Support the design and implementation of modern data platforms using Azure and/or Microsoft Fabric technologies. Contribute to data architecture, data modelling, and warehouse/lakehouse design decisions. Develop and maintain SQL and Python-based data solutions, automation, and transformation processes. Support semantic models, reporting datasets, and analytics requirements using Power BI where required....

Snowflake Data Engineer - 5 Months - Outside IR35 A leading tech company requires a data engineer for an initial 5-month contract. The position is hybrid, outside IR35, and will likely extend long-term due to the amount of work they have in the pipeline. The Role: You will be part of a rapidly growing data team helping to deliver their leading data platform, which is being used to drive key decision-making in renewable energy and its use around the world-tech for good, you could say! They are looking for a data engineer with demonstrable experience with Snowflake building complex systems to ingest and process large volumes of data. The main tools you will be using day to day are: ** Snowflake ** Python ** SQL ** DBT You: Our customer is looking for someone well-versed in the above tools/technologies. They also need someone who understands the principles of Data Engineering and is willing to roll up their sleeves, as this project is critical for them. As a Senior...