18 infrastructure data engineer jobs found in London, greater london

Infrastructure Data Engineer - Kafka Focus Fully Remote Outside IR35 Working pattern: Sunday to Thursday Supporting a team based in Israel Exalto Consulting is supporting a client looking to appoint an experienced Infrastructure Data Engineer with strong Apache Kafka expertise. This is a fully remote contract role for someone who has hands-on experience running and improving Kafka in live produc click apply for full job details

**ML Applied Engineer – 6 month initial contract (temporary) – outside IR35 – London – day rate dependent on experience** We are looking for a senior, hands-on Applied ML Engineer to bridge the gap between classical data science and generative AI. This is an initial 6-month contract, with the possibility of a Phase-2 extension subject to successful delivery of first phase 1. The role is focused on delivery, execution, and technical ownership. You will be brought in to accelerate the product roadmap, transitioning capabilities from experimentation into robust, enterprise-grade systems embedded directly into our products and client solutions. You will be tasked to create Hybrid AI systems: using LLMs to provide interaction and explanation, grounded strictly by quantitative ML models (cost-to-serve, forecasting, and optimisation). You will own the transition from experimental notebooks to enterprise-grade solutions. Key responsibilities and deliverables: AI...

We are hiring a Senior GCP Data Engineer to design and build scalable, high-performance data platforms on Google Cloud for a leading banking/financial services client. This role involves working on large-scale data systems, building both batch and real-time pipelines, and delivering enterprise-grade data solutions. Key Responsibilities Design and build batch & real-time data pipelines on GCP Work with BigQuery, Dataflow, Cloud Storage, Spanner Develop real-time streaming solutions (Kafka / Apache Beam) Implement Infrastructure as Code using Terraform Deploy workloads on Kubernetes (GKE) Build and manage CI/CD pipelines (Jenkins / Spinnaker) Collaborate on data modelling and architecture Ensure systems are secure, scalable, and cost-optimized Required Skills 6+ years of overall experience in Data Engineering 3+ years of hands-on experience in Google Cloud Platform (GCP) Strong expertise in: BigQuery Dataflow / Apache Beam...

Senior Software Developer / Data Engineer - (Contract Outside IR35) In brief We’re looking for well-rounded software developers with experience in data engineering, with a proven ability to tackle complex data challenges, make an excellent impression on clients, and have a high impact on the output of your entire team. We provide a supportive environment with a strong focus on individual career progression, where you will have both the mentorship and project opportunities you need to develop your technical skills. You’ll work in a team alongside other talented developers and data engineers, supported by a Technical Lead. Projects span a range of sizes and multiple sectors and technologies. The role Experience and qualifications You have 4+ years’ experience and a breadth & depth of technical knowledge & expertise, particularly in data engineering, and can solve technical challenges across front-end, back-end, and infrastructure. You have...

Agentic RAG Engineer / Architect Department: Global Markets — AI & Intelligent Automation Location: London City, Hybrid - Contract (Outside IR35) About the Team My client's Global Markets Division are building an enterprise-grade agentic platform that will transform how trading, sales, risk, and operations teams access, reason over, and act on information. A critical pillar of this platform is an agentic Retrieval-Augmented Generation (RAG) layer — not a simple search and stuff pipeline, but an intelligent, self-directing retrieval system that can plan queries, route across heterogeneous data sources, assess and refine its own results, and feed high-fidelity context to downstream agents. The data landscape is complex: unstructured research, regulatory documents, structured trade and risk data in relational and tabular stores, graph-based entity relationships, real-time market data, and internal knowledge bases. The RAG layer must unify all of this behind a...

Agentic Systems Engineer / Architect Department: Global Markets — AI & Intelligent Automation Location: London City, Hybrid - Contract (Outside IR35) About the Team My client's Global Market Division is building a next-generation agentic platform that will fundamentally transform how their trading, sales, and risk functions operate. This initiative sits at the intersection of large language models, autonomous workflow orchestration, and mission-critical financial infrastructure. The platform will power a fleet of intelligent agents capable of reasoning, planning, executing multi-step tasks, and collaborating across domains. You will be joining at the ground floor of this build-out and will have outsized influence on the architecture, engineering culture, and technical direction of the programme. Role Purpose They are looking for a hands-on architect and engineer who will design, build, and own the core agentic orchestration framework that underpins...

*ML Applied Engineer - 6 month initial contract (temporary) - outside IR35 - London - day rate dependent on experience* We are looking for a senior, hands-on Applied ML Engineer to bridge the gap between classical data science and generative AI. This is an initial 6-month contract, with the possibility of a Phase-2 extension subject to successful delivery of first phase 1. The role is focused on delivery, execution, and technical ownership. You will be brought in to accelerate the product roadmap, transitioning capabilities from experimentation into robust, enterprise-grade systems Embedded directly into our products and client solutions. You will be tasked to create Hybrid AI systems: using LLMs to provide interaction and explanation, grounded strictly by quantitative ML models (cost-to-serve, forecasting, and optimisation). You will own the transition from experimental notebooks to enterprise-grade solutions. Key responsibilities and deliverables: AI & Machine...

Platform Engineer Outside IR35  Fully remote   We’re looking for a strong Azure Platform Engineer for a contract role focused on building and supporting secure, scalable internal engineering platforms. This is not a standard data engineer role. The work sits across Azure platform engineering, Databricks, Terraform, CI/CD, governance, identity, and secure access environments . You’ll be helping shape and improve core cloud services used by engineering teams across the business. What you’ll be doing Build and improve secure, scalable Azure platform services Support and enhance Azure Databricks environments with a focus on governance, access, cost control and operational stability Develop and maintain Terraform for infrastructure provisioning and platform changes Improve CI/CD platforms and engineering workflows Help design and manage secure access environments for internal users, remote teams and contractors Work across platform,...

Join a globally recognised organisation where your infrastructure expertise will support mission-critical digital and media services reaching audiences worldwide. Salary:  £450 - 500 per day Infrastructure Engineer £450 - £500 per day London (Hybrid): 3 days on-site Contract | outside IR35 Our client is a globally recognised organisation delivering large-scale digital and media services to audiences worldwide. They operate in a high-availability, enterprise technology environment where infrastructure plays a critical role in supporting production, distribution, and operational systems. As part of continued growth and technology investment, they are expanding their infrastructure capability and modernising their on-premise and cloud platforms to support high-volume data and mission-critical services. This is an opportunity to join a technically strong team working on complex infrastructure within a large-scale, performance-driven...

Infrastructure Engineer £450 - £500 p/d London (Hybrid): 3 days on-site Contract | outside IR35 Our client is a globally recognised organisation delivering large-scale digital and media services to audiences worldwide. They operate in a high-availability, enterprise technology environment where infrastructure plays a critical role in supporting production, distribution, and operational systems. As part of continued growth and technology investment, they are expanding their infrastructure capability and modernising their on-premise and cloud platforms to support high-volume data and mission-critical services. This is an opportunity to join a technically strong team working on complex infrastructure within a large-scale, performance-driven environment. The Role We are looking for an experienced Infrastructure Engineer to support and maintain core server, storage, and virtualisation platforms across a hybrid infrastructure environment. You will work across physical and...

Full job description Join a globally recognised organisation where your infrastructure expertise will support mission-critical digital and media services reaching audiences worldwide. Salary:  £450 - 500 per day Infrastructure Engineer £450 - £500 per day London (Hybrid): 3 days on-site Contract | outside IR35 Our client is a globally recognised organisation delivering large-scale digital and media services to audiences worldwide. They operate in a high-availability, enterprise technology environment where infrastructure plays a critical role in supporting production, distribution, and operational systems. As part of continued growth and technology investment, they are expanding their infrastructure capability and modernising their on-premise and cloud platforms to support high-volume data and mission-critical services. This is an opportunity to join a technically strong team working on complex infrastructure within a...

Title: AI & ML Senior Engineer Role Rate: Up to £600 Per Day (Outside IR35) Contract length: 3 months (Initially) Start date: ASAP Our Client, a rapidly expanding international beauty brand celebrated for innovation and excellence, is seeking a skilled Lead AI & ML Engineer to join their forward-thinking team. Operating across numerous markets worldwide, this company offers a vibrant, collaborative culture that rewards creativity, technical mastery, and strategic thinking. Employees benefit from a stimulating work environment, ongoing development opportunities, and the chance to work at the forefront of AI technology within the beauty industry. Role Overview: As a Lead AI & ML Engineer, you will be instrumental in advancing AI and machine learning capabilities across the organisation. This pivotal role is designed for an ambitious professional eager to influence company-wide strategy, manage cutting-edge projects, and lead a talented team. Your...

We are seeking a Senior Data Scientist/AI Innovation Lead to help shape and deliver data science and machine learning innovation within a critical government workstream. This role will play a key part in driving 2-3 week innovation sprints , leading the development of proof-of-concepts that surface actionable insight to Home Office Tableau users . The successful candidate will combine strong hands-on technical depth with the ability to frame problems, shape experiments, guide delivery, and influence how innovative data science capability is applied in practice. The focus is on rapidly testing high-value opportunities across areas such as LLM-driven summarisation, machine learning for data quality, anomaly detection, and statistical modelling , while working closely with stakeholders, engineers and analysts in a cloud-first environment. Key Responsibilities Lead the design and execution of data science, AI and ML innovation sprints , translating ambiguous problems into...

Lead Data Engineer Contract outside IR35 Mostly Remote The Lead Data Engineer/Technical Lead will own the end-to-end technical delivery of a data migration and platform modernisation programme in AWS. This role acts as the single technical point of accountability, setting architecture, defining standards, and coordinating delivery across workstreams. While the programme includes data engineering, the focus is heavily on DevOps, infrastructure, and platform engineering, enabling scalable, secure, and automated migration and ingestion of enterprise data. Required Experience & Skills 5+ years in data/platform engineering, including leadership experience Strong AWS experience: S3, Lambda, IAM, VPC/networking, DMS Proven experience with Infrastructure-as-Code (Terraform) and CI/CD pipelines Experience delivering large-scale data migrations, including CDC approaches Strong Python and SQL skills Understanding of data platforms (eg Snowflake/CDP)...

Data Engineer £450-475 per day | Outside IR35 | SC Cleared Public Sector Programme | Mid/Late April 2026 Start We're recruiting for an SC-cleared Data Engineer to join a major public sector programme delivering critical data capability in a secure, operational environment. This is a hands-on role for someone who can build and improve data pipelines, shape robust data models, and work directly with stakeholders to turn operational requirements into effective technical solutions. You'll be joining at a key point in the programme, with work focused on enhancing existing datasets and pipelines, alongside potential greenfield development as new datasets are introduced. The role is highly stakeholder-facing, so strong communication skills are essential alongside solid technical delivery capability. Key responsibilities Build, enhance and optimise data pipelines Translate business and operational requirements into schemas, data models and efficient data jobs Improve...

Data Platform Architect - Contract (6 months) Rate: (Outside IR35) Hybrid Overview A leading consultancy is seeking a Data Platform Architect to design and deliver modern, cloud-native data, analytics and AI platforms. You will work across the full data value chain, shaping scalable, secure and sustainable solutions for a range of clients. This role suits an experienced architect who enjoys advising stakeholders, leading small teams or workstreams, and remaining actively involved in hands-on delivery. Key Responsibilities Architect end-to-end cloud data, analytics and AI platforms. Design solutions that integrate batch and Real Time processing. Establish robust data management, governance and life cycle approaches. Guide clients on modern analytics, Machine Learning, Generative AI and Large Language Model adoption. Lead small implementation teams or workstreams through design and delivery. Shape best practices around CI/CD, cloud infrastructure and platform engineering....

Senior Full Stack Engineer: Up to £500 per day Outside IR35: Fully Remote: London A growing EdTech company is seeking a Senior Full Stack Engineer to join an ambitious team building a creator-led tutoring platform. They are moving fast and building something genuinely new in education. As a Senior Full Stack Engineer, you will work closely with the engineering team, ship features end-to-end, and see your code reach real users within days. Key Responsibilities as a Senior Full Stack Engineer: Build and ship features across the full stack Design and implement APIs and database schemas for new product features Integrate and optimise video streaming infrastructure Work with AI and ML models to power personalised tutoring features Implement payment flows and subscription management via Stripe Skills & Key Requirements: Strong React and Next.js skills Proficiency with Claude Code and agentic development patterns PostgreSQL experience: complex queries,...

We are seeking a Data Scientist/ML Analyst to support a critical government data and analytics workstream focused on innovation, experimentation, and rapid proof-of-concept delivery. Working as part of a multidisciplinary team, you will contribute to 2-3 week innovation sprints aimed at developing and testing new approaches to help surface insight to Tableau users across a complex operational environment. The work will sit at the intersection of data science, machine learning, AI experimentation, analytics enablement, and cloud-based engineering . This is an opportunity for someone who enjoys hands-on problem solving, prototyping, and translating data into practical use cases that can improve decision-making in high-profile environments. Key Responsibilities Support the design and delivery of data science and AI proof-of-concepts within short innovation sprint cycles. Build, test and iterate models and analytical approaches across use cases such as: LLM-based...