58 senior data engineer jobs found in London

🚀 Senior Data Engineer – Storage Optimisation Engagement 🚀 📍London (Hybrid) 📅 Starting ASAP for an initial 8 week engagement 💰 Outside IR35 - rate depending on experience We’re supporting a client looking for a Senior Data Engineer to lead a short-term, high-impact storage optimisation engagement within an ML-heavy environment. This is not a generic BAU role – it’s a focused piece of work with clear deliverables, governance ownership and measurable impact. 🔑 The Role • Assess large-scale storage usage across ML data prep, training and experimentation • Design and execute structured clean-up & optimisation strategies • Implement retention policies and lifecycle governance • Reduce reliance on manual storage management • Deliver a high-level data engineering roadmap • You’ll work closely with ML and Infrastructure engineers, mapping workflows and introducing sustainable improvements. 🎯 We’re looking for someone who: 👉 Has strong...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

Senior Data Engineer - Azure, Databricks, Datafactory, Phinsys Tandem, Insurance Our sister company Stellarmann is seeking an experienced Data Engineer to join their team, who are building out a new data platform for processing Finance and Actuarial data. You will be working as part of a talented team building a cutting edge data platform using Azure Databricks, Datafactory and Python integrating with Phinsys Tandem. We're seeking someone with: Proven experience as a Data Engineer Strong hands on experience with Azure Databricks and Azure Data Factory Experience in the Lloyd's/London Market (specialty insurance) Experience working with Phinsys Tandem - essential Proficiency in Python Experience working with Medallion architecture/tiered medallion Lakehouse Experience using Databricks Notebooks for data pipelines This is a 6 month initial engagement, outside IR35 with scope to extend beyond the initial term. If this opportunity aligns with your...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35)Location: Hybrid in South Wales Role OverviewWe are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands‑on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark‑driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time‑aware joins and dimensional transformations Support optimisation of Spark workloads and Delta tables Solid...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35) Location: Hybrid in South Wales Role Overview We are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands-on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark-driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time-aware joins and dimensional transformations Support optimisation of Spark workloads and Delta tables...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35) Location: Hybrid in South Wales Role Overview We are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands-on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark-driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time-aware joins and dimensional transformations Support optimisation of Spark workloads and Delta tables...

Contract Length: Initial 6 months (extension likely) Day Rate: £500 per day (Outside IR35) Location: Hybrid in South Wales Role Overview We are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands-on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark-driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time-aware joins and dimensional transformations Support optimisation of...

Databricks Data Engineer £500 - £550 per day Outside IR35 We 're partnering with a leading online retail company that 's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create personalised journeys for millions of shoppers worldwide. The Role As a Senior Data Engineer, you 'll play a key role in developing and optimising the backbone of the company 's data platform. You 'll be responsible for building and maintaining large-scale, real-time data pipelines that power analytics, machine learning, and operational systems across the business. You 'll collaborate with software engineers, data scientists, and analytics teams to ensure the platform delivers reliable, high-quality, and compliant data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture...

🚀 Contract Opportunity – Snowflake Technical Lead | 🟢 Outside IR35 | Hybrid London A leading Data Consultancy is supporting a large enterprise insurance organisation delivering a major cloud data platform programme and we’re looking to bring in an experienced Snowflake Technical Lead to take ownership of a key delivery workstream. This is a genuinely hands-on leadership role - ideal for someone who enjoys building solutions rather than sitting purely in architecture or governance discussions. The Role You’ll be responsible for leading the technical delivery of a standalone data pipeline within Snowflake, working as part of a wider transformation programme modernising core data capabilities. Responsibilities will include: Designing and building Snowflake data pipelines end-to-end Implementing transformation logic using dbt Applying validation rules and data quality controls Designing logging, monitoring and failure handling approaches Supporting...

Senior Data Engineer, Qlik Sense to BigQuery Migration, Berlin Contract: 6 months (extension likely) Location: Berlin – Hybrid (3 days onsite, must be fine to travel) Rate: £525 - £550 outside IR35 Overview We are urgently looking for a Senior Data Engineer to support a large-scale migration from Qlik Sense to Google BigQuery. This is a hands-on role, working closely with technical and business stakeholders to modernise the analytics and data platform. The ideal candidate will have strong experience across GCP, BigQuery, SQL, and BI/data warehouse migrations, with the confidence to own delivery end-to-end. Key Responsibilities Lead and deliver the migration from Qlik Sense to BigQuery Rebuild and optimise data models and reporting structures in BigQuery Translate existing Qlik logic into scalable, performant SQL-based solutions Work closely with stakeholders to validate data, reports, and outputs Improve data performance, reliability, and...

Join a forward-thinking team where your expertise in data engineering will directly shape retail insights and drive commercial success. Salary: £525 - 550 per day Senior Analytics Engineer – Urgent Contract Role (Looker + BigQuery) Outside IR35 £525–£550/day Hybrid in London Initial 3 months ASAP start We're supporting a client building a new Retail Reporting solution on GCP, covering ingestion, modelling, and semantic layers. This is a hands-on role leading the technical build across BigQuery, Dataform, and Looker, working with diverse retail datasets and a fast-moving commercial team. You'll own the delivery of robust data pipelines, scalable retail data models, and optimised Looker-ready structures. You must be available within the next 2 weeks and 1-2 Central London office days will be required. Key Responsibilities Integrate and configure multiple retail data sources into GCP. Build and maintain Dataform pipelines across raw, staging, and gold layers....

Senior Analytics Engineer - Urgent Contract Role (Looker + BigQuery) Outside IR35 | £525-£550/day | Hybrid in London | Initial 3 months | ASAP start We're supporting a client building a new Retail Reporting solution on GCP, covering ingestion, modelling, and semantic layers. This is a hands-on role leading the technical build across BigQuery, Dataform, and Looker, working with diverse retail datasets and a fast-moving commercial team. You'll own the delivery of robust data pipelines, scalable retail data models, and optimised Looker-ready structures. You must be available within the next 2 weeks and 1-2 Central London office days will be required. Key Responsibilities Integrate and configure multiple retail data sources into GCP. Build and maintain Dataform pipelines across raw, staging, and gold layers. Develop unified sales, inventory, and shipping models in BigQuery. Implement key retail logic: on-hand vs on-order, Weeks of Supply, and calendar alignment....

Platform Engineer | Trading Firm Central London | 3 days on site Outside IR35 | Up to £650 per day A trading firm in central London has rolled out a business wide data platform and now needs a senior Platform Engineer to take full control of the platform layer. Kubernetes is the heart of this environment and they need someone who can run it with confidence, precision and zero drama. What they need you to bring Serious Kubernetes depth covering cluster design, workload orchestration, autoscaling strategies, multi cluster operations, network policy, resource tuning and deep debugging across pods, nodes and the control plane Deep Linux fluency with the ability to harden, tune and own production environments from top to bottom Strong SQL engineering skills covering schema design, performance tuning and high throughput optimisation Solid C# background with clean, maintainable service patterns Ability to design, build and refine CI/CD...

Platform Engineer | Trading Firm Central London | 3 days on site Outside IR35 | Up to £650 per day A trading firm in central London has rolled out a business wide data platform and now needs a senior Platform Engineer to take full control of the platform layer. Kubernetes is the heart of this environment and they need someone who can run it with confidence, precision and zero drama. What they need you to bring Serious Kubernetes depth covering cluster design, workload orchestration, autoscaling strategies, multi cluster operations, network policy, resource tuning and deep debugging across pods, nodes and the control plane Deep Linux fluency with the ability to harden, tune and own production environments from top to bottom Strong SQL engineering skills covering schema design, performance tuning and high throughput optimisation Solid C# background with clean, maintainable service patterns Ability to design, build and refine CI/CD...

CONTRACT SENIOR SOFTWARE ENGINEER - eDV CLEARED NEW CONTRACT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY COMPANY FOR A SENIOR SOFTWARE ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Senior Software Engineer Globally leading defence / cyber security company £500 - £750 per day (inside and outside IR35 roles available) London based organisation in an easily accessible location Contract Senior Software Engineer To apply please call or email WHO WE ARE? We are recruiting multiple contract Senior Software Engineers to work with various clients in London ranging from R &D companies, Multi-National Consultancies to SME 's and product based companies. Due to the nature of the work these clients do, you must hold enhanced DV Security Clearance. WHAT WILL THE SENIOR SOFTWARE ENGINEER BE DOING? As a Senior Software Engineer, you will work with an experienced agile team to design and deliver...

Senior Power BI Consultant - Outside IR35 Location: Central London (2-3 days on-site) Contract: 6-12 months, Outside IR35 Industry: Oil & Gas/Commodity Trading Role Summary A leading energy & commodity trading business is looking for a Senior Power BI Consultant to support ongoing analytics and data-modelling work. The role blends hands-on BI development with business engagement. Key Responsibilities * Build and optimise Power BI dashboards, semantic models, and data flows. * Lead data modelling across complex trading datasets. * Translate business requirements into technical specifications for offshore developers. * Ensure best practice in DAX, SQL, and BI design. * Work within the organisation's Databricks environment (platform familiarity expected). * Provide leadership, guidance, and clear communication to both business and technical teams. Required Skills * Expert-level Power BI, DAX, and data modelling. * Strong SQL and experience with large datasets. *...

Senior IT Risk Analyst – 12 Month Day Rate Contract Central London 12 months (April start) | Technology Risk Rate: £200 - £350/day Outside IR35 We are partnering with a global financial clients are undertaking a major technology and cloud transformation, moving from traditional data centres to AWS and GCP. They are looking for an IT Risk Analyst, to help genuinely shape how technology risk is managed. This is a great opportunity for a Risk Analyst, who is keen to work in a modern, engineering-led environment. Why this role? Direct influence on a flagship cloud transformation Small, high-impact team where your work is visible and valued Opportunity to modernise and automate how risk and controls are run (not a clipboard/tick‑box role) Broad stakeholder exposure across engineering, platforms, InfoSec, Audit, and senior technology leadership Culture that values pace, outcomes, and pragmatism What you’ll be doing Leading IT risk and control assessments...

We're partnering with a fast-growing sports/entertainment business looking to hire a Senior Backend Engineer on a 6-month contract (outside IR35), with potential to convert to permanent (£95k). This is a hands-on tech lead role with ownership of core platform systems powering multiple websites and internal services. The Role You'll take full technical ownership of the NextGen CMS and Master Data (MDM) systems, designing, developing, and mentoring a small team of engineers. This role is perfect for someone who thrives in complex, high-scale environments and wants real impact from day one. Key Responsibilities: Lead development across CMS and MDM systems Maintain and expand complex backend systems (not standard CMS) Mentor engineers and set engineering standards/patterns Drive architecture, integrations, and system scalability Work closely with stakeholders to deliver features and improvements Team Environment: 5 Backend, 3 Frontend engineers, 1 Delivery...

Enterprise Data Architect - Research & Innovation Outside IR35 | £DOE | Immediate Start We are supporting a leading organisation within the Research & Innovation space and are seeking an experienced Enterprise Data Architect to join on a contract basis. This role sits at the intersection of enterprise strategy and data delivery. It is not a pure Enterprise Architect position focused on governance alone, nor is it a hands-on Data Engineer role. We are looking for someone who can think at enterprise level while remaining close enough to delivery to shape practical, scalable solutions. The organisation operates in a complex medical and scientific data environment, and the successful candidate will help align technology and data architecture to broader organisational strategy while influencing future direction. Key Responsibilities Shape and influence enterprise data architecture across a broad research portfolio Align data and technology strategy to...

We 're partnering with a fast-growing sports/entertainment business looking to hire a Senior Backend Engineer on a 6-month contract (outside IR35), with potential to convert to permanent ( £95k). This is a hands-on tech lead role with ownership of core platform systems powering multiple websites and internal services. The Role You 'll take full technical ownership of the NextGen CMS and Master Data (MDM) systems, designing, developing, and mentoring a small team of engineers. This role is perfect for someone who thrives in complex, high-scale environments and wants real impact from day one. Key Responsibilities: Lead development across CMS and MDM systems Maintain and expand complex backend systems (not standard CMS) Mentor engineers and set engineering standards/patterns Drive architecture, integrations, and system scalability Work closely with stakeholders to deliver features and improvements Team Environment: 5 Backend, 3...