45 senior data engineer jobs found in London

Senior Data Engineer (Snowflake & dbt) A London-based insurer is seeking a Senior Data Engineer to help design, build, and scale its modern data platform. You'll play a key role in transforming raw data into reliable, well-structured datasets that power analytics, reporting, and data-driven decision-making across the business. Key Responsibilities of the Senior Data Engineer: Design, develop, and maintain scalable data pipelines and ELT workflows Build and optimize data models using dbt to support analytics and business intelligence Manage and enhance our Snowflake data warehouse environment Ensure data quality, integrity, and performance across pipelines Collaborate with analysts, data scientists, and stakeholders to understand data needs Implement testing, monitoring, and documentation for data systems Contribute to data architecture decisions and best practices Essential skills of the Senior Data Engineer: Strong experience with Snowflake (data...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

Senior Data Engineer – Analytics (Contract) Hybrid – London/Reading A data engineer is required to deliver insight‑ready datasets and support advanced analytics across a cloud‑based environment. The role focuses on building scalable pipelines, refining complex data sources, and enabling analysts and data scientists with high‑quality, well‑structured data. Key Responsibilities Develop and optimise data pipelines for analytics and modelling. Cleanse, transform, and analyse large datasets using Python/R . Maintain SQL‑driven processing workflows in the cloud. Perform EDA to identify trends, anomalies, and data issues. Collaborate with BI teams to deliver reliable analytical datasets. Skills & Experience Strong SQL and data wrangling. Proficient in Python or R. Experience with large, complex datasets and Power BI. AWS experience preferred: Glue, S3, Athena, Lambda, Redshift, Step Functions . Advantageous: statistics/ML exposure and telecom‑style data...

Senior Data Engineer/Data Platform Engineer (Databricks) Contract | Outside IR35 Remote (UK) £550-£650 per day (DOE) 6 months We're partnering with a forward-thinking Data & AI consultancy that is helping to scale a Databricks Lakehouse platform. They are looking for a Senior Data Engineer/Data Platform Engineer who can operate across both Data Engineering & Platform Engineering. This is an end-to-end hands-on role. What You'll Be Doing: Designing and building end-to-end data pipelines using Databricks (PySpark/SQL/Delta Lake) Developing and managing robust, scalable Lakehouse architectures Implementing Delta Live Tables (DLT) for reliable, testable, production-grade pipelines Optimising performance using: Working with Unity Catalog to implement Centralised governance Leveraging Databricks Workflows/Jobs for orchestration Building CI/CD pipelines for data & platform deployments (Terraform, GitHub Actions, Azure DevOps etc.) Enabling Real Time and...

Senior Data Engineer (GCP) - Outside IR35 - Hybrid 2/3 days onsite London - 3 year B2B contract I'm working with a client looking for a Senior GCP Data Engineer to help build and scale a modern data platform across GCP and Azure.  Role: Design and build scalable data pipelines (batch & streaming) Work with BigQuery, Dataflow, Pub/Sub, Airflow Deliver cloud data solutions across GCP & Azure Contribute to architecture and engineering best practices Key Skills: 5-6+ years Data Engineering experience 3-5 years with GCP Strong Python & SQL Experience with BigQuery, Dataflow, Pub/Sub, Airflow/dbt Modern data platform/lakehouse experience Desirable: Multi-cloud (GCP & Azure) Kafka/Event Hub BI tools (Power BI/Tableau) Cloud certifications Senior Data Engineer (GCP) - Outside IR35 - Hybrid 2/3 days onsite London - 3 year B2B contract

Senior Data Engineer - Analytics (Contract) Hybrid - London/Reading A data engineer is required to deliver insight-ready datasets and support advanced analytics across a cloud-based environment. The role focuses on building scalable pipelines, refining complex data sources, and enabling analysts and data scientists with high-quality, well-structured data. Key Responsibilities Develop and optimise data pipelines for analytics and modelling. Cleanse, transform, and analyse large datasets using Python/R . Maintain SQL-driven processing workflows in the cloud. Perform EDA to identify trends, anomalies, and data issues. Collaborate with BI teams to deliver reliable analytical datasets. Skills & Experience Strong SQL and data wrangling. Proficient in Python or R. Experience with large, complex datasets and Power BI. AWS experience preferred: Glue, S3, Athena, Lambda, Redshift, Step Functions . Advantageous: statistics/ML exposure and telecom-style data environments....

Senior Data Engineer - Analytics (Contract) Hybrid - London/Reading A data engineer is required to deliver insight ready datasets and support advanced analytics across a cloud based environment. The role focuses on building scalable pipelines, refining complex data sources, and enabling analysts and data scientists with high quality, well structured data. Key Responsibilities Develop and optimise data pipelines for analytics and modelling. Cleanse, transform, and analyse large datasets using Python/R . Maintain SQL driven processing workflows in the cloud. Perform EDA to identify trends, anomalies, and data issues. Collaborate with BI teams to deliver reliable analytical datasets. Skills & Experience Strong SQL and data wrangling. Proficient in Python or R. Experience with large, complex datasets and Power BI. AWS experience preferred: Glue, S3, Athena, Lambda, Redshift, Step Functions . Advantageous: statistics/ML exposure and telecom style data...

Senior Data Engineer - Analytics (Contract) Hybrid - London/Reading A data engineer is required to deliver insight-ready datasets and support advanced analytics across a cloud-based environment. The role focuses on building scalable pipelines, refining complex data sources, and enabling analysts and data scientists with high-quality, well-structured data. Key Responsibilities Develop and optimise data pipelines for analytics and modelling. Cleanse, transform, and analyse large datasets using Python/R . Maintain SQL-driven processing workflows in the cloud. Perform EDA to identify trends, anomalies, and data issues. Collaborate with BI teams to deliver reliable analytical datasets. Skills & Experience Strong SQL and data wrangling. Proficient in Python or R. Experience with large, complex datasets and Power BI. AWS experience preferred: Glue, S3, Athena, Lambda, Redshift, Step Functions . Advantageous:...

Senior Data Engineer Contract Role Outside IR35 | £500-550/day | Milton Keynes | Hybrid | Initial 5 Months We have a new Senior Data Engineer contract opportunity with a global leading client with offices in Milton Keynes. You'll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, requires 1 day per week on-site, and offers an initial 5-month contract with an immediate start and strong potential for extension on a greenfield project. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices. Migrate and transform data into a Databricks Lakehouse architecture. Ensure data quality, reliability, and scalability for analytics and reporting. Collaborate with stakeholders to deliver robust solutions aligned with business needs. Support production environments and...

Senior Azure Data Engineer (Snowflake, Databricks, Dbt)  I'm urgently looking to speak with Senior Contractors bringing significant experience in Databricks + Snowflake, coupled with proven Azure-Databricks project expertise.  You must have valid right to work status in the UK to be considered for this opportunity.  Skills & Experience: - Proven Snowflake & Databricks, hands-on experience  - Significant expertise in Azure-Databricks, with demonstratable, hands-on leadership in Azure-heavy projects - Excellent stakeholder management, able to hit ground running and work closely with senior stakeholders - DBT experience - nice to have  Please note: This role requires someone who can operate autonomously from day one, with strong delivery focus in fast‑paced, enterprise-scale data environments. Reason for role:  Urgent interim replacement  Rate : £500-550 p/d | Outside IR35  Start date : End of March  Working Patterns:  Remote first, 1 week in Milton...

Senior Azure Data Engineer (Snowflake, Databricks, Dbt) I'm urgently looking to speak with Senior Contractors bringing significant experience in Databricks + Snowflake, coupled with proven Azure-Databricks project expertise. You must have valid right to work status in the UK to be considered for this opportunity. Skills & Experience: - Proven Snowflake & Databricks, hands-on experience - Significant expertise in Azure-Databricks, with demonstratable, hands-on leadership in Azure-heavy projects - Excellent stakeholder management, able to hit ground running and work closely with senior stakeholders - DBT experience - nice to have Please note: This role requires someone who can operate autonomously from day one, with strong delivery focus in fast paced, enterprise-scale data environments. Reason for role: Urgent interim replacement Rate : £500-550 p/d | Outside IR35 Start date : End of March Working Patterns: Remote first, 1 week in Milton...

Senior Azure Data Engineer (Snowflake, Databricks, Dbt) I 'm urgently looking to speak with Senior Contractors bringing significant experience in Databricks + Snowflake, coupled with proven Azure-Databricks project expertise. You must have valid right to work status in the UK to be considered for this opportunity. Skills & Experience: - Proven Snowflake & Databricks, hands-on experience - Significant expertise in Azure-Databricks, with demonstratable, hands-on leadership in Azure-heavy projects - Excellent stakeholder management, able to hit ground running and work closely with senior stakeholders - DBT experience - nice to have Please note: This role requires someone who can operate autonomously from day one, with strong delivery focus in fast-paced, enterprise-scale data environments. Reason for role: Urgent interim replacement Rate : £500-550 p/d | Outside IR35 Start date : End of March Working Patterns: Remote...

We are hiring a Senior GCP Data Engineer to design and build scalable, high-performance data platforms on Google Cloud for a leading banking/financial services client. This role involves working on large-scale data systems, building both batch and real-time pipelines, and delivering enterprise-grade data solutions. Key Responsibilities Design and build batch & real-time data pipelines on GCP Work with BigQuery, Dataflow, Cloud Storage, Spanner Develop real-time streaming solutions (Kafka / Apache Beam) Implement Infrastructure as Code using Terraform Deploy workloads on Kubernetes (GKE) Build and manage CI/CD pipelines (Jenkins / Spinnaker) Collaborate on data modelling and architecture Ensure systems are secure, scalable, and cost-optimized Required Skills 6+ years of overall experience in Data Engineering 3+ years of hands-on experience in Google Cloud Platform (GCP) Strong expertise in: BigQuery Dataflow / Apache Beam Kafka...

Contract Data Engineer / 6 month duration / Outside IR35 / £575 per day / London Market Insurance / We are partnered closely with a London Market Insurance Syndicate, recruiting for a Contract Data Engineer. As Data Engineer you will be responsible for the build / development / enhancement and support the Data ecosystem (Data Platform, Datawarehouse), including but not restricted to Syndicate Data Hub. The Senior Data Engineer will promote good data hygiene across the Syndicate and wider group. Key duties and responsibilities Build / enhance / deliver / support the Data ecosystem, including but not restricted to Syndicate Data Hub: Develop data pipelines leveraging ELT / ETL techniques to ingest, transform and display data following state-of-the-art-approach and internal standards (testing, reconciling and documenting changes is a key part of this role) Design and propose changes to the group data model (with specific focus on Syndicate) Support data scheduled...

Databricks Data Engineer £500 - £550 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and Real Time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create personalised journeys for millions of shoppers worldwide. The Role As a Senior Data Engineer, you'll play a key role in developing and optimising the backbone of the company's data platform. You'll be responsible for building and maintaining large-scale, Real Time data pipelines that power analytics, machine learning, and operational systems across the business. You'll collaborate with software engineers, data scientists, and analytics teams to ensure the platform delivers reliable, high-quality, and compliant data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key...

Principal Data Modeller | Credit / Financial Data Contract London | Hybrid / flexible working £600 p/d Outside of IR35 | 6 Months Rolling Contract This role requires a senior data modeller to take ownership of a complex financial data domain within a global data and analytics environment focused on defining and stabilising a core credit data model used across multiple products and consumers. You’ll be expected to operate independently, make modelling decisions with incomplete information, and leave behind a clear, buildable structure for engineering teams. This is a hands-on modelling authority position! THE ROLE: Own the conceptual → logical → physical data model for a core credit domain Define and refine key entities such as issuer, instrument, rating, event, and time/history Work across fragmented and under-documented data sources to establish clean, canonical definitions Produce source-to-target mappings, data dictionaries, and lineage...

Title: AI & ML Senior Engineer Role Rate: Up to £600 Per Day (Outside IR35) Contract length: 3 months (Initially) Start date: ASAP Our Client, a rapidly expanding international beauty brand celebrated for innovation and excellence, is seeking a skilled Lead AI & ML Engineer to join their forward-thinking team. Operating across numerous markets worldwide, this company offers a vibrant, collaborative culture that rewards creativity, technical mastery, and strategic thinking. Employees benefit from a stimulating work environment, ongoing development opportunities, and the chance to work at the forefront of AI technology within the beauty industry. Role Overview: As a Lead AI & ML Engineer, you will be instrumental in advancing AI and machine learning capabilities across the organisation. This pivotal role is designed for an ambitious professional eager to influence company-wide strategy, manage cutting-edge projects, and lead a talented team. Your...

We are seeking a Senior Data Scientist/AI Innovation Lead to help shape and deliver data science and machine learning innovation within a critical government workstream. This role will play a key part in driving 2-3 week innovation sprints , leading the development of proof-of-concepts that surface actionable insight to Home Office Tableau users . The successful candidate will combine strong hands-on technical depth with the ability to frame problems, shape experiments, guide delivery, and influence how innovative data science capability is applied in practice. The focus is on rapidly testing high-value opportunities across areas such as LLM-driven summarisation, machine learning for data quality, anomaly detection, and statistical modelling , while working closely with stakeholders, engineers and analysts in a cloud-first environment. Key Responsibilities Lead the design and execution of data science, AI and ML innovation sprints , translating ambiguous problems into...

AI Engineer - LLM & Agentic Systems London - Hybrid. Circa £500 – £675 per day (and negotiable DOE) Contract (Outside IR35) Mid-level, Senior & Lead. Agentic AI / Machine Learning. Company: Our client is a globally established B2B information and professional services business, operating across multiple high-value industry sectors. They have established data science and machine learning engineering teams already delivering in production, and are now expanding their AI capability significantly across the global organisation. This is a role for people who ship. If you've built LLM-powered systems and agentic workflows that are live in production - not demos, not prototypes - and you want to do that at genuine scale, this is worth applying for. What you'll be working on as an AI Engineer - LLM & Agentic Systems: Designing and building AI agents and agentic workflows - combining LLMs, RAG, reasoning, memory and tool orchestration to...

Senior Java Engineer (Low Latency / Trading Systems) - £950-1150/Day Outside IR35 Contract London (Hybrid) | High-Performance, Real-Time Platform We’re working with a high-performing engineering team building real-time, high-throughput systems at the core of a complex trading and data platform. This is a hands-on contract role focused on designing and optimising low latency Java systems that process live market data, power pricing and risk engines, and support high-frequency decision-making. You’ll be operating in an environment where performance is critical, latency is measurable, and engineering quality directly impacts production systems. What you’ll be working on Building and optimising low latency, high-throughput Java systems for real-time data and trading workflows Designing components within a distributed, event-driven architecture handling large-scale streaming data Developing pricing, risk, and data processing systems used in live...