34 senior data engineer jobs found in London

Senior Data Engineer (Snowflake & dbt) A London-based insurer is seeking a Senior Data Engineer to help design, build, and scale its modern data platform. You'll play a key role in transforming raw data into reliable, well-structured datasets that power analytics, reporting, and data-driven decision-making across the business. Key Responsibilities of the Senior Data Engineer: Design, develop, and maintain scalable data pipelines and ELT workflows Build and optimize data models using dbt to support analytics and business intelligence Manage and enhance our Snowflake data warehouse environment Ensure data quality, integrity, and performance across pipelines Collaborate with analysts, data scientists, and stakeholders to understand data needs Implement testing, monitoring, and documentation for data systems Contribute to data architecture decisions and best practices Essential skills of the Senior Data Engineer: Strong experience with Snowflake (data...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

Senior Data Engineer – Analytics (Contract) Hybrid – London/Reading A data engineer is required to deliver insight‑ready datasets and support advanced analytics across a cloud‑based environment. The role focuses on building scalable pipelines, refining complex data sources, and enabling analysts and data scientists with high‑quality, well‑structured data. Key Responsibilities Develop and optimise data pipelines for analytics and modelling. Cleanse, transform, and analyse large datasets using Python/R . Maintain SQL‑driven processing workflows in the cloud. Perform EDA to identify trends, anomalies, and data issues. Collaborate with BI teams to deliver reliable analytical datasets. Skills & Experience Strong SQL and data wrangling. Proficient in Python or R. Experience with large, complex datasets and Power BI. AWS experience preferred: Glue, S3, Athena, Lambda, Redshift, Step Functions . Advantageous: statistics/ML exposure and telecom‑style data...

Senior Data Engineer/Data Platform Engineer (Databricks) Contract | Outside IR35 Remote (UK) £550-£650 per day (DOE) 6 months We're partnering with a forward-thinking Data & AI consultancy that is helping to scale a Databricks Lakehouse platform. They are looking for a Senior Data Engineer/Data Platform Engineer who can operate across both Data Engineering & Platform Engineering. This is an end-to-end hands-on role. What You'll Be Doing: Designing and building end-to-end data pipelines using Databricks (PySpark/SQL/Delta Lake) Developing and managing robust, scalable Lakehouse architectures Implementing Delta Live Tables (DLT) for reliable, testable, production-grade pipelines Optimising performance using: Working with Unity Catalog to implement Centralised governance Leveraging Databricks Workflows/Jobs for orchestration Building CI/CD pipelines for data & platform deployments (Terraform, GitHub Actions, Azure DevOps etc.) Enabling Real Time and...

Senior Data Engineer (GCP) - Outside IR35 - Hybrid 2/3 days onsite London - 3 year B2B contract I'm working with a client looking for a Senior GCP Data Engineer to help build and scale a modern data platform across GCP and Azure.  Role: Design and build scalable data pipelines (batch & streaming) Work with BigQuery, Dataflow, Pub/Sub, Airflow Deliver cloud data solutions across GCP & Azure Contribute to architecture and engineering best practices Key Skills: 5-6+ years Data Engineering experience 3-5 years with GCP Strong Python & SQL Experience with BigQuery, Dataflow, Pub/Sub, Airflow/dbt Modern data platform/lakehouse experience Desirable: Multi-cloud (GCP & Azure) Kafka/Event Hub BI tools (Power BI/Tableau) Cloud certifications Senior Data Engineer (GCP) - Outside IR35 - Hybrid 2/3 days onsite London - 3 year B2B contract

We are hiring a Senior GCP Data Engineer to design and build scalable, high-performance data platforms on Google Cloud for a leading banking/financial services client. This role involves working on large-scale data systems, building both batch and real-time pipelines, and delivering enterprise-grade data solutions. Key Responsibilities Design and build batch & real-time data pipelines on GCP Work with BigQuery, Dataflow, Cloud Storage, Spanner Develop real-time streaming solutions (Kafka / Apache Beam) Implement Infrastructure as Code using Terraform Deploy workloads on Kubernetes (GKE) Build and manage CI/CD pipelines (Jenkins / Spinnaker) Collaborate on data modelling and architecture Ensure systems are secure, scalable, and cost-optimized Required Skills 6+ years of overall experience in Data Engineering 3+ years of hands-on experience in Google Cloud Platform (GCP) Strong expertise in: BigQuery Dataflow / Apache Beam Kafka...

Contract Data Engineer / 6 month duration / Outside IR35 / £575 per day / London Market Insurance / We are partnered closely with a London Market Insurance Syndicate, recruiting for a Contract Data Engineer. As Data Engineer you will be responsible for the build / development / enhancement and support the Data ecosystem (Data Platform, Datawarehouse), including but not restricted to Syndicate Data Hub. The Senior Data Engineer will promote good data hygiene across the Syndicate and wider group. Key duties and responsibilities Build / enhance / deliver / support the Data ecosystem, including but not restricted to Syndicate Data Hub: Develop data pipelines leveraging ELT / ETL techniques to ingest, transform and display data following state-of-the-art-approach and internal standards (testing, reconciling and documenting changes is a key part of this role) Design and propose changes to the group data model (with specific focus on Syndicate) Support data scheduled...

Databricks Data Engineer £500 - £550 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and Real Time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create personalised journeys for millions of shoppers worldwide. The Role As a Senior Data Engineer, you'll play a key role in developing and optimising the backbone of the company's data platform. You'll be responsible for building and maintaining large-scale, Real Time data pipelines that power analytics, machine learning, and operational systems across the business. You'll collaborate with software engineers, data scientists, and analytics teams to ensure the platform delivers reliable, high-quality, and compliant data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key...

Principal Data Modeller | Credit / Financial Data Contract London | Hybrid / flexible working £600 p/d Outside of IR35 | 6 Months Rolling Contract This role requires a senior data modeller to take ownership of a complex financial data domain within a global data and analytics environment focused on defining and stabilising a core credit data model used across multiple products and consumers. You’ll be expected to operate independently, make modelling decisions with incomplete information, and leave behind a clear, buildable structure for engineering teams. This is a hands-on modelling authority position! THE ROLE: Own the conceptual → logical → physical data model for a core credit domain Define and refine key entities such as issuer, instrument, rating, event, and time/history Work across fragmented and under-documented data sources to establish clean, canonical definitions Produce source-to-target mappings, data dictionaries, and lineage...

Title: AI & ML Senior Engineer Role Rate: Up to £600 Per Day (Outside IR35) Contract length: 3 months (Initially) Start date: ASAP Our Client, a rapidly expanding international beauty brand celebrated for innovation and excellence, is seeking a skilled Lead AI & ML Engineer to join their forward-thinking team. Operating across numerous markets worldwide, this company offers a vibrant, collaborative culture that rewards creativity, technical mastery, and strategic thinking. Employees benefit from a stimulating work environment, ongoing development opportunities, and the chance to work at the forefront of AI technology within the beauty industry. Role Overview: As a Lead AI & ML Engineer, you will be instrumental in advancing AI and machine learning capabilities across the organisation. This pivotal role is designed for an ambitious professional eager to influence company-wide strategy, manage cutting-edge projects, and lead a talented team. Your...

We are seeking a Senior Data Scientist/AI Innovation Lead to help shape and deliver data science and machine learning innovation within a critical government workstream. This role will play a key part in driving 2-3 week innovation sprints , leading the development of proof-of-concepts that surface actionable insight to Home Office Tableau users . The successful candidate will combine strong hands-on technical depth with the ability to frame problems, shape experiments, guide delivery, and influence how innovative data science capability is applied in practice. The focus is on rapidly testing high-value opportunities across areas such as LLM-driven summarisation, machine learning for data quality, anomaly detection, and statistical modelling , while working closely with stakeholders, engineers and analysts in a cloud-first environment. Key Responsibilities Lead the design and execution of data science, AI and ML innovation sprints , translating ambiguous problems into...

AI Engineer - LLM & Agentic Systems London - Hybrid. Circa £500 – £675 per day (and negotiable DOE) Contract (Outside IR35) Mid-level, Senior & Lead. Agentic AI / Machine Learning. Company: Our client is a globally established B2B information and professional services business, operating across multiple high-value industry sectors. They have established data science and machine learning engineering teams already delivering in production, and are now expanding their AI capability significantly across the global organisation. This is a role for people who ship. If you've built LLM-powered systems and agentic workflows that are live in production - not demos, not prototypes - and you want to do that at genuine scale, this is worth applying for. What you'll be working on as an AI Engineer - LLM & Agentic Systems: Designing and building AI agents and agentic workflows - combining LLMs, RAG, reasoning, memory and tool orchestration to...

Senior Java Engineer (Low Latency / Trading Systems) - £950-1150/Day Outside IR35 Contract London (Hybrid) | High-Performance, Real-Time Platform We’re working with a high-performing engineering team building real-time, high-throughput systems at the core of a complex trading and data platform. This is a hands-on contract role focused on designing and optimising low latency Java systems that process live market data, power pricing and risk engines, and support high-frequency decision-making. You’ll be operating in an environment where performance is critical, latency is measurable, and engineering quality directly impacts production systems. What you’ll be working on Building and optimising low latency, high-throughput Java systems for real-time data and trading workflows Designing components within a distributed, event-driven architecture handling large-scale streaming data Developing pricing, risk, and data processing systems used in live...

Overview We are supporting a major enterprise technology transformation programme requiring a Senior Endpoint Engineer/Modern Workplace Specialist to step into a critical delivery role. This is a hands-on technical position focused on endpoint transformation, application deployment, identity integration, and ensuring a seamless end-user experience during an active migration programme. This role suits someone comfortable working in fast-paced environments where delivery timelines are tight and user-facing systems are business critical. Key Responsibilities Endpoint & Application Delivery Package and deploy enterprise applications to managed laptop environments Handle complex deployments including custom plug-ins, certificates, and configuration dependencies Coordinate deployment activities with internal engineering teams and third-party providers Migration & Transformation Support Analyse existing application environments and dependencies...

This is a chance to join a newly formed product engineering squad focused on shaping smarter pricing experiences for a global digital platform. You'll play a key role in building features that directly impact how users discover value. Role Overview: Location: London / Hybrid Package: £400 - £450 per day (Outside IR35) Industry: Technology What You'll Be Doing: Building and enhancing customer-facing features using modern JavaScript frameworks Developing components that surface dynamic pricing, discounts, and price changes Collaborating with product and design teams to shape new functionality as the roadmap evolves Contributing to a newly formed squad with a focus on experimentation and innovation Working in an AI-enabled development environment, integrating tools into daily workflows Ensuring performance, accessibility, and compliance standards are met across the platform Main Skills Needed:...

Role - Senior Platform Engineer - Azure - Databricks Location - Remote (UK Based) Start Date - ASAP (Interviews to start immediately) Can wait notice periods 2-4 weeks. Rate - Market Rates (Outside IR35) Contract Length - 6 months initially (Will extended based on good performance) The roles are Outside IR35 & Fully remote Description: We've partnered an award winning SME Consulting firm, with a unique opportunity. They have won a large Financial Services project, looking for multiple Azure Platform Engineers, with extensive Azure and Databricks experience. We are searching for UK based Data consultants, with a strong consulting background, high level communication skills are paramount! Please share your CV if you are interested

🚀 Building a Senior AI Engineering Team (LLM + Distributed Systems) Global Investment Bank | Capital Markets Platform 📍 London (1–2 days onsite) 💰 £700–£1,200/day (Outside IR35) Contract to permanent available 📅 12-month contracts The Mandate We are building a production-grade AI platform inside a global investment bank. This is not a research team or a chatbot project. This is engineering-heavy , focused on integrating LLM systems into large-scale, distributed environments used by trading and quant teams. We are hiring across multiple levels: Lead Engineer (Agentic / RAG focus) Architect (end-to-end platform design- Agentic / RAG focus) Senior Engineers (x3) Agentic / RAG focus Potential Director-level hire to oversee the function What This Role Requires (Read Before Applying) You must have: Experience building distributed systems at scale Strong background in backend or data engineering Proven experience working on...

Data Engineer £450-475 per day | Outside IR35 | SC Cleared Public Sector Programme | Mid/Late April 2026 Start We're recruiting for an SC-cleared Data Engineer to join a major public sector programme delivering critical data capability in a secure, operational environment. This is a hands-on role for someone who can build and improve data pipelines, shape robust data models, and work directly with stakeholders to turn operational requirements into effective technical solutions. You'll be joining at a key point in the programme, with work focused on enhancing existing datasets and pipelines, alongside potential greenfield development as new datasets are introduced. The role is highly stakeholder-facing, so strong communication skills are essential alongside solid technical delivery capability. Key responsibilities Build, enhance and optimise data pipelines Translate business and operational requirements into schemas, data models and efficient data jobs Improve...

Product Owner | FinTech Payments – Product Owner | Up to £700 per day (Outside IR35) We’re looking for a Product Owner with experience within FinTech, Payments or the banking sector who will define the vision, strategy, and roadmap of the product, ensuring it delivers value to customers and the business. Reporting to the VP of Product and work closely with engineers, designers, analytics, marketing, and operations, building and deploying the technology that powers the future of consumer lending. Key Responsibilities Define and deliver the product vision and roadmap Collaborate cross-functionally to design and ship impactful, scalable solutions. Use data and experimentation to measure success and drive continuous improvement. Communicate a clear, inspiring product narrative that aligns teams and stakeholders. 💰 Paying up to £700 per day (Outside IR35) 🏢 2-3 days per week on-site in London What We’re Looking For Proven experience as a Product Owner...

AI ENGINEER | £550 - £650 We're working with a leading innovator in the Higher Education sector on this exciting opportunity. Are you ready to build the future of academic technology? We are looking for a high-calibre AI Engineer to lead the charge in developing transformative LLM-based solutions and conversational agents within a dynamic, intellectual environment. This is a chance to leverage cutting-edge AWS infrastructure to revolutionise how students and faculty interact with information. The Role Design and develop sophisticated conversational agents and LLM-based assistants tailored for the education sector. Lead the creation of AI proof-of-concepts (POCs) using AWS Bedrock and Microsoft Copilot Studio. Implement robust prompt engineering strategies and fine-tune foundation models to ensure accuracy and relevance. Collaborate closely with non-technical stakeholders to co-create AI solutions that address real-world academic challenges. Ensure all...