30 data engineer jobs found

La Fosse is currently recruiting a contract Data Engineer (12 months) on behalf of a global financial services company. They require an experienced Python Data Engineer with extensive experience in building and maintaining Data Lakehouses in Azure. The ideal candidate will have a strong background in both Scala and Python programming, with specific experience building high performance and scalable pipelines in Databricks with Spark. The new data platform will serve a range of end users in the Capital Markets division, so experience across areas such as derivatives, risk, PnL, trade lifecycle, market data are highly desired. Key Responsibilities: Engineer robust, scalable and efficient data pipelines using Spark/PythonDatabricks Demonstrate best practices in the design & development of data pipelines Data modelling on medallion architecture, ensuring schema is intuitive and serves business users analytical and reporting objectives What you'll need: Expert in...

Principal AI / Data Engineer (Contract): Length:  3 months initally (extension is likely)  Start Date:  ASAP  Location:  London, Hybrid (1 day per week)  Pay Rate / Determination: £525-575 p/d | Outside IR35  About:  Opus is supporting a UK-based digital consultancy partnering with organisations to design, build and scale high‑impact digital and AI‑driven products, with a strong people‑first culture. The role:  A hands‑on Principal AI / Data Engineer contract to assess, shape and deliver improvements to a live AI platform across two critical workstreams. You'll be responsible for: Assessing the current AI and data platform and define clear, actionable improvements Lead on delivery across two workstreams, aligning product, data and engineering Improving the natural language data exploration platform, focusing on trust and semantic consistency Designing and implementing scalable, multi‑source data pipelines and architecture About you: Strong experience with...

Contract Senior Data Engineer - £500 - £600 per day - Outside IR35 - Python/Snowflake/AWS Role: Contract Senior Data Engineer Rate: £500 - £600 per day Determination: Outside IR35 Interview Process: 2x Call Technology: SQL/Python/DBT/AWS/Snowflake/Airflow In office requirement: 1 day per week Duration: 6 months Burns Sheehan have been supporting the build of a new team and we are adding to this with another Contract Senior Data Engineer. As a Contract Senior Data Engineer, you will support on core Data Engineering capabilities as well as modernising the Data stack and supporting a migration. Working alongside their Director of Data & Principal Data Engineer, you will be a key component. If this Contract Data Engineer sounds like you, please apply now for immediate consideration. Contract Senior Data Engineer - £500 - £600 per day - Outside IR35 - Python/Snowflake/AWS

Principal AI/Data Engineer (Contract): Length: 3 months initially (extension is likely) Start Date: ASAP Location: London, Hybrid (1 day per week) Pay Rate/Determination: £525-575 p/d | Outside IR35 About: Opus is supporting a UK-based digital consultancy partnering with organisations to design, build and scale high impact digital and AI driven products, with a strong people first culture. The role: A hands on Principal AI/Data Engineer contract to assess, shape and deliver improvements to a live AI platform across two critical workstreams. You'll be responsible for: Assessing the current AI and data platform and define clear, actionable improvements Lead on delivery across two workstreams, aligning product, data and engineering Improving the natural language data exploration platform, focusing on trust and semantic consistency Designing and implementing scalable, multi source data pipelines and architecture About you: Strong experience with...

🚀 Databricks Data Engineer | Contract | Outside IR35 | Fully Remote (UK) We’re partnering with a leading organisation to support the build of an AI-enabled data platform, and we’re looking for an experienced Databricks Data Engineer to join on a long-term contract. 🔹 Contract: 12-month rolling 🔹 Location: Fully remote (UK-based) 🔹 Rate: Up to £550/day (Outside IR35) 🔹 Clearance: Active SC required 🔹 Start: ASAP / Flexible You’ll be hands-on designing and building scalable, production-grade data pipelines using Databricks, Spark, Delta Lake, and cloud services (Azure preferred), working closely with data science and platform teams. If you have strong Databricks experience and hold active SC clearance, this is a high-impact opportunity on a modern data platform.

Contract Data Engineer / MLE (Databricks, GCP) Location: London (hybrid) Contract: Outside IR35 Day Rate: Negotiable ~ £600-£700 DW Search are partnering on a high-impact contract opportunity within a fast-paced, data-driven environment supporting portfolio company initiatives for a major asset management firm. This role sits at the intersection of Data Engineering and Machine Learning Engineering, with a strong focus on building and productionising end-to-end ML pipelines. You will be working on real-world applications of neural networks, enabling scalable feature engineering, model training, and inference in production. Key Responsibilities Build and productionise feature engineering pipelines for ML models Develop and manage training and inference workflows at scale Deploy and monitor machine learning models in production environments Collaborate with data scientists and engineering teams to optimise model performance and reliability Contribute...

Job Title: Contract Data Engineer (Banking Experience Required) Location: London (Hybrid) Day Rate: £550–£600 per day (Outside IR35 – subject to assessment) Contract Length: 6 months initial (extensions likely) Overview Chapman Tate are looking for an experienced Contract Data Engineer with a strong background in banking or financial services to support a range of high-priority data initiatives. You will play a key role in delivering scalable data solutions, enabling regulatory reporting, and improving data architecture across the organisation. Key Responsibilities Design, build, and optimise scalable data pipelines and ETL/ELT processes Integrate and transform large volumes of financial data from multiple sources Work closely with stakeholders across technology, risk, and business teams Ensure high standards of data quality, governance, and compliance Contribute to data platform enhancements and cloud migration projects Troubleshoot and...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

AWS Data Engineer - Snowflake Cortex London (Hybrid)  -  £550/day  -  Outside IR35 | Retail 6‑month contract (extendable) working on a cutting‑edge Snowflake Cortex / GenAI data platform for a major retail organisation. What you’ll be doing: Building data pipelines on AWS Developing high‑performance Snowflake data models Delivering Snowflake Cortex AI/LLM use cases Working with large‑scale retail data (sales, customer, inventory) You’ll need: Strong AWS Data Engineering background Hands‑on Snowflake experience Exposure to Snowflake Cortex / GenAI SQL + Python **ASAP start, please reach out to Adam Akhtar at Opus for more detail.

Senior Data Engineer - PySpark, GCP We're recruiting for a Senior Data Engineer with strong PySpark skills, to join a growing team in building out a modern Lakehouse platform in GCP. This is a hands-on role for someone who can take ownership, work independently, work iteratively and delivery quickly. Key skills and experience: Strong experience as a Data Engineer in Cloud Environments (ideally GCP but not essentially) Hands on experience with PySpark and SQL Experience building data lake / lakehouse platforms Strong understanding of distributed data processing (Spark) Experience with Airflow or similar orchestration tools Ability to design and deliver pipelines end-to-end, independently Nice to have: Strong GCP experience Terraform / Infrastructure-as-Code Experience with data quality tools (Great Expectations, Soda) Exposure to data catalog / governance tools Experience of working towards / setting up AI, Agentic Workflows etc What you'll...

Senior Data Engineer - PySpark, GCP We're recruiting for a Senior Data Engineer with strong PySpark skills, to join a growing team in building out a modern Lakehouse platform in GCP. This is a hands-on role for someone who can take ownership, work independently, work iteratively and delivery quickly. Key skills and experience: Strong experience as a Data Engineer in Cloud Environments (ideally GCP but not essentially) Hands on experience with PySpark and SQL Experience building data lake/lakehouse platforms Strong understanding of distributed data processing (Spark) Experience with Airflow or similar orchestration tools Ability to design and deliver pipelines end-to-end, independently Nice to have: Strong GCP experience Terraform/Infrastructure-as-Code Experience with data quality tools (Great Expectations, Soda) Exposure to data catalog/governance tools Experience of working towards/setting up AI, Agentic Workflows etc What you'll be doing:...

AWS Data Engineer - Snowflake Cortex London (Hybrid) - £550/day - Outside IR35 | Retail 6 month contract (extendable) working on a cutting edge Snowflake Cortex/GenAI data platform for a major retail organisation.  What you'll be doing: Building data pipelines on AWS Developing high performance Snowflake data models Delivering Snowflake Cortex AI/LLM use cases Working with large scale retail data (sales, customer, inventory) You'll need: Strong AWS Data Engineering background Hands on Snowflake experience Exposure to Snowflake Cortex/GenAI SQL + Python *ASAP start, please reach out to Adam Akhtar at Opus for more detail.

La Fosse are partnered with a market leading, high profile financial services company who urgently require a Lead Data & AI Engineer contractor (Agentic AI, PySpark) to join a dynmaic, fast placed, greenfield project team who are leveraging cutting edge AI technology to build a new ineractive data-driven platform. To be suitable, candidates must have substantial experience as a Data & AI Engineer (or similar) with the following technical experience: ETL pipeline engineering with PySpark SQL Expertise, knowkeged of Databricks Agentic AI development, working effectively with LLMs Test-Driven Development (TDD) Senior level engineerm, led engineering projects or spearheaded small sized delviery teams Initial term: 3 months (high potential for extension) 1-2 stage remote interview process Hybrid working model: 3 days per week in the City of London This is an urgent requirement and requires a contractor available to start with 1-2 weeks' notice. If you are...

Data Engineer - Data Platform migration, SQL Server to Fabric - 3 months, remote, to £500 p/d outside IR35 A Data Engineer is required to work on a large data platform migration from SQL Server to Fabric. You will have extensive data engineering, development experience, preferable gained within a highly regulated environment with excellent knowledge of Fabric, Python, Azure Cloud, Azure Synapse, SQL Server, T-SQL, data factory, data bricks, data lakes, CI/CD pipelines, data flows, dimensional modelling, Git and Kimball. You will be a team player with strong communication skills. The role will involve working as part of a team on the migration of SQL Server to fabric dealing with the data engineering, development, dimensional modelling etc. Must be able to work in a fast paced, dynamic, unstructured environment. As a data engineer you will have the following: Data engineering BI/data warehouse development SQL Server T-SQL Fabric Python Azure Cloud Azure Synapse...

Data Engineer Tecknuovo is a digital delivery partner with a Deliberately Different approach. This means we focus on people, not technology. We move at pace and ensure Zero Dependency on us at the end of each project. What you'll be working towards We are currently looking to engage with Data Engineers on a large organisation project within the public sector. The successful candidate will have: Azure Python MS Fabric PowerBI Your Journey : Passing the TeckBar The Teckbar is a benchmark we set for our associates to make sure we consistently deploy bestin-class teams to work with our clients. Talent Screen: Our Talent Team will be in touch to talk Tecknuovo, the role & values Tech Screen: We'll focus on real-life experience and deep dive into your technical background Offer: Job Done! During the process, we promise you'll have: An understanding of Tecknuovo's mission and values Feel that this is where you want to work...or not...

Data Migration Engineer - Outside IR35 - Remote Overview We are seeking an experienced Data Migration Analyst/Engineer to support a major data warehouse rebuild for a wealth management firm undergoing a large-scale system and data migration programme. Working closely with the Lead Data Engineer, this role will play a critical part in ensuring the new data warehouse accurately replicates existing outputs, while identifying and resolving any data gaps introduced during migration. This is a hands-on role requiring strong analytical capability, deep SQL expertise, and experience working in complex, regulated data environments. Key Responsibilities Perform source-to-target mapping , documenting field-level lineage across systems and transformation layers Analyse and interpret complex Legacy SQL stored procedures (including multi-CTE logic, temp tables, and parameterised pipelines) Support data migration validation , ensuring accuracy and completeness of migrated datasets...

Data Platform Engineer (GCP, PySpark, Airflow) - Contract Rate : £550 - £575 per day Outside IR35 Location : Remote (UK) Travel : London once per month (preferred) Duration : 3 months (initial) Start : ASAP The Role We're hiring a Data Platform Engineer (GCP, PySpark, Airflow) to support a modern data platform/Lakehouse environment . This is a hands-on engineering role focused on building and optimising data pipelines , while also contributing to the underlying platform and infrastructure. You'll work closely with the data engineering team, delivering production-grade pipelines and ensuring systems are reliable, scalable, and performant. Key Responsibilities Design and build end-to-end data pipelines (PySpark/SQL) Develop and manage workflows using Airflow (DAGs, scheduling, orchestration) Work with BigQuery for large-scale data processing and analytics Monitor, debug, and optimise pipelines for performance and...

Data Migration Engineer - Active SC, HealthShare Up to £500 (Outside IR35) Primarily remote/London 6 months We're seeking a hands‑on Data Migration Engineer to support delivery of a new healthcare platform. The role focuses on designing and delivering secure, high‑volume clinical data migrations into InterSystems HealthShare and IRIS. Key Requirements: Proven experience as a Data Migration Engineer, with Active SC (Security Clearance) Strong background in designing, developing, and delivering ETL pipelines for clinically coded healthcare data. Hands on experience working with InterSystems HealthShare and HealthConnect, including EMPI, HPD, the Integration Engine, and IRIS. Solid experience producing and maintaining data mappings and transformation logic aligned with target data models and business rules. Practical experience handling clinical terminology mappings, including SNOMED and local code sets. Experience building and managing staging‑layer pipelines...

Data Migration Engineer - Active SC, HealthShare Up to £500 (Outside IR35) Primarily remote/London 6 months We're seeking a hands-on Data Migration Engineer to support delivery of a new healthcare platform. The role focuses on designing and delivering secure, high-volume clinical data migrations into InterSystems HealthShare and IRIS. Key Requirements: Proven experience as a Data Migration Engineer, with Active SC (Security Clearance) Strong background in designing, developing, and delivering ETL pipelines for clinically coded healthcare data. Hands on experience working with InterSystems HealthShare and HealthConnect, including EMPI, HPD, the Integration Engine, and IRIS. Solid experience producing and maintaining data mappings and transformation logic aligned with target data models and business rules. Practical experience handling clinical terminology mappings, including SNOMED and local code sets. Experience building and managing staging-layer pipelines...

Databricks Data Engineer | Contract | Outside IR35 | Fully Remote (UK) We're partnering with a leading organisation to support the build of an AI-enabled data platform, and we're looking for an experienced Databricks Data Engineer to join on a long-term contract. Contract: 12-month rolling Location: Fully remote (UK-based) Rate: Up to £550/day (Outside IR35) Clearance: Active SC required Start: ASAP/Flexible You'll be hands-on designing and building scalable, production-grade data pipelines using Databricks, Spark, Delta Lake, and cloud services (Azure preferred), working closely with data science and platform teams. If you have strong Databricks experience and hold active SC clearance, this is a high-impact opportunity on a modern data platform.