83 data engineer jobs found in London

Senior Data Engineer (Contract) Outside IR35 Location: London (Hybrid 2 days per week on-site, mandatory ) Contract: Initial 6 months with strong likelihood of extension IR35: Outside IR35 We're working with an established, data-driven business looking for a Senior Data Engineer to join a small, high-impact data team click apply for full job details

AI Data Engineer - Agentic AI In Prod - Eval's - Context Engineering - RAG - LLM's - AWS Bedrock AI Data Engineer - Agentic AI In Prod - Eval's - Context Engineering - RAG - LLM's - AWS Bedrock requirement for an urgent start. The AI Data Engineer - Agentic AI In Prod - Eval's - Context Engineering - RAG - LLM's - AWS Bedrock will be working for us, Blackstone&, at an enterprise client in London AI Data Engineer - Agentic AI In Prod - Eval's - Context Engineering - RAG - LLM's - AWS Bedrock Key Skills A data engineering background with a strong, current understanding of how AI systems consume data. You know the difference between building pipelines for analytics and building pipelines for agents. Hands-on experience with AWS, including the data services (S3, Glue, Lambda, RDS) and AI services (Bedrock, Knowledge Bases) and how they connect. The ability to take unstructured data and transform it into structured, agent-ready formats in production, not just in a...

Lead Data Engineer Key Points Location: London Or Reading, Hybrid Duration: 12 months Rate: Competitive Day Rate, Outside IR35 Overview This is an opportunity to join a leading organisation undertaking a major cloud transformation and data modernisation programme, delivering enterprise-scale data solutions across a complex technology landscape. As a Lead Data Engineer, you will provide technical leadership across the design, development, automation, and optimisation of cloud-based data platforms, ensuring secure, scalable, and high-performing solutions are delivered to support business and operational objectives. Working closely with architects, stakeholders, analysts, and engineering teams, you will drive best practice across data engineering, infrastructure automation, CI/CD, and cloud technologies while mentoring and leading other engineers within the delivery team. Key Responsibilities Lead the design and delivery of enterprise-scale data engineering...

Azure | Databricks | SQL | Outside IR35 | Hybrid THE COMPANY We 're partnering with a global mining organisation that is investing heavily in the evolution of its enterprise data platform. Following significant growth and a wider transformation programme, they 're looking to bring in an experienced Senior Data Engineer to strengthen the technical capability of the team and support the delivery of several high-profile data initiatives. This is a business that places real value on engineering best practice and is looking for someone who can provide immediate technical expertise, influence engineering standards through delivery and help solve complex data engineering challenges across the organisation. THE ROLE This is a hands-on Senior Data Engineering contract where you 'll operate as a senior individual contributor within a highly collaborative team. Rather than leading people, you 'll lead technically, owning complex engineering problems, partnering with...

🚨 Senior Data Engineer | Outside IR35 | £550–£675/day | Central London I'm currently partnering with a global organisation undergoing a major transformation of its data platform and engineering capability. They're looking to bring in an experienced Senior Data Engineer to help define engineering standards, improve platform performance and deliver scalable, enterprise-grade data solutions. This is an excellent opportunity to join a high-performing team where you'll have a real influence over architecture, engineering best practices and the future direction of the data platform. 📍 The Opportunity Senior Data Engineer Outside IR35 £550–£650 per day (depending on experience) 6-month initial contract ASAP Start Central London – 1-2 days onsite per week What You'll Be Doing As a Senior Data Engineer you'll be responsible for designing, building and optimising modern cloud-based data platforms while helping establish engineering standards across the...

Data/AI Engineer (Databricks) - Outside of IR35Contract We're taking an AI decision-support product from proof-of-concept to full production on Databricks and need a hands-on engineer to build, run and own it. It analyses data across ~1,000 sites, uses an LLM (Anthropic Claude) to generate per-site recommendations, and includes a conversational agent that lets managers question their own data. Delivery role, not advisory - you'll fill our gap in Databricks engineering, LLM pipelines and agent development, and build the capability in-house. Initial 6 Month Contract (Ext) & Remote Working What you'll do Build ingestion pipelines (PySpark) into a governed medallion layer in Unity Catalog. Productionise the LLM pipeline - run Claude across the estate on a schedule, with retries and validation gates. Build and tune the conversational agent - grounding, guardrails, benchmarking. Own evaluation (prompt versioning, MLflow) and CI/CD across dev/UAT/prod. Essential...

Data Engineer - South West England - 6 months - £500pd Outside IR35 - Local Authority - A major public sector organisation in the South West of England is seeking an experienced Data Engineer to lead the design, build and operation of enterprise data platforms, data pipelines and analytical data products. Working within a modern Digital, Data & Technology function, you will be responsible for engineering scalable, secure and reliable data solutions that enable trusted reporting, analytics and operational decision-making. You will work alongside architects, analysts, service teams and stakeholders to deliver robust data platforms whilst driving engineering standards, automation and continuous improvement across the organisation's data estate. This is an exciting opportunity to contribute to a significant data transformation programme and help shape the future of the organisation's data engineering capability. - Key Responsibilities: Data Platform & Pipeline...

Data Engineer - Snowflake/3NF Rate - £550 - £600 per day - Outside IR35 Location - London, once a month onsite Duration - Initial 6 Month Contract - Extensions Expected The Opportunity: We're supporting a major UK household brand within its loyalty and rewards division as it continues to invest heavily in its data platform and wider data strategy. As part of this growth, they are looking to engage experienced Data Engineers to help design, build and enhance cloud based data solutions using AWS, Snowflake and DBT. Working alongside senior technical leadership, you'll play a key role in developing scalable data products, improving platform capability and delivering high quality data solutions that support critical business outcomes. This is an excellent opportunity to join a long term programme within a mature engineering environment where data is a strategic priority. Key Responsibilities: Develop, maintain and optimise data pipelines and data products within...

Data Engineer - Snowflake / 3NF Rate - £550 - £600 per day - Outside IR35 Location - London, once a month onsite Duration - Initial 6 Month Contract - Extensions Expected The Opportunity: We 're supporting a major UK household brand within its loyalty and rewards division as it continues to invest heavily in its data platform and wider data strategy. As part of this growth, they are looking to engage experienced Data Engineers to help design, build and enhance cloud based data solutions using AWS, Snowflake and DBT. Working alongside senior technical leadership, you 'll play a key role in developing scalable data products, improving platform capability and delivering high quality data solutions that support critical business outcomes. This is an excellent opportunity to join a long term programme within a mature engineering environment where data is a strategic priority. Key Responsibilities:...

Data Engineer - Data Migration Programme | London (Hybrid) | Contract - up to £500/d (outside IR35) Are you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client - a fast-scaling European digital infrastructure provider with 100+ sites across the continent - is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform. You'll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams. What you'll be doing: Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling Implementing source-to-target mappings and transformation logic for the...

Data Engineer - Data Migration Programme | London (Hybrid) | Contract - up to £500/d (outside IR35) Are you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client - a fast-scaling European digital infrastructure provider with 100+ sites across the continent - is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform. You 'll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams. What you 'll be doing: Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling Implementing source-to-target mappings and transformation logic...

Contract Data Engineer Duration - 6 months Outside IR35 - Competitive Market Rate Fully Remote British Citizenship and SC clearance is required Fruition Group are representing a boutique technology consultancy who are specialist at delivering cutting edge solutions for public and private sector clients. They're known as the "Knights in Shining Armour". Join a high-impact government programme using AI, machine learning and computer vision to solve real-world national challenges. You'll build scalable data pipelines and ML infrastructure alongside a specialist consultancy renowned for delivering mission-critical solutions, working with modern technologies in a secure, cutting-edge environment Key Skills required: - PyTorch - TensorFlow - SciKit - Airflow or Prefect - ML flow (really nice to have) - Python - SQL - Data Modelling This role will require an active SC Clearance and British Citizenship is required due to the secure nature of the project. We are...

Data Engineer - AI Data Platform - Outside IR35 - Remote The Data Engineer will be responsible for building the core data infrastructure underpinning next-generation AI products, integrating enterprise and third-party data sources, and developing scalable data services to support AI-driven applications. Data Engineer - AI Data Platform - Key Skills: - Proven experience building scalable enterprise data platforms and data infrastructure. - Must have strong understanding of AI/LLM data architectures and enabling AI agents to retrieve and prioritise enterprise data. - Investment Management background preferred - Strong Azure experience, including Azure Service Bus and cloud-native data services. - Experience developing MCP registries, connectors, and data integration frameworks. - Strong experience integrating third-party data providers (eg S&P or similar external data sources). - Experience designing universal data layers to support AI, analytics, and enterprise data...

Data Engineer (Microsoft Fabric / Azure) | 6-Month Contract | Outside IR35 | £400 per Day We 're supporting a client who is looking for a Data Engineer to join them on an initial 6-month contract , operating Outside IR35 , paying £400 per day . This role will suit someone with experience designing and developing modern data solutions within the Microsoft ecosystem, working closely with both technical and business stakeholders to deliver scalable reporting and analytics capabilities. Key Skills & Experience 2-5 years ' experience in a Data Engineer or similar role Strong experience across the Microsoft data stack, including: Microsoft Fabric Azure Data Factory Azure Synapse Analytics Azure SQL / SQL Server Power BI Strong understanding of: Data warehousing Data modelling ETL/ELT processes Data integration Advanced SQL skills Ability to engage with stakeholders and...

We are scaling a major data transformation programme and hiring multiple Data Engineers at both senior and mid-level. The team is building a modern Azure-based data platform and needs contractors who can deliver high-quality, production-ready engineering at pace. Project Overview You will work across Databricks, Azure and Genie to build pipelines, optimise workflows and contribute to a best-practice engineering environment. The programme moves quickly, and you will have autonomy to deliver meaningful impact from day one. Responsibilities Designing and building Databricks pipelines for batch and streaming workloads Implementing medallion architecture using Delta Lake Engineering solutions across Azure Data Lake, ADF, Functions, DevOps and Key Vault Orchestrating workflows using Genie Writing clean, testable, production-ready code Working closely with product and data teams to deliver efficiently Senior Data Engineer Requirements Deep...

Data Engineer Contract Outside IR35 We require an experienced Data Engineer to play a critical role in the successful delivery of an AI Product Delivery programme which will fundamentally reshape how customers interact with a leading insurance company. To measure, optimise, and demonstrate the impact of this transformation, we need robust data engineering capability to enable the development of management information and operational dashboards. These reporting solutions will provide clear visibility of programme performance, customer outcomes, operational efficiency, and value realisation, ensuring stakeholders can effectively monitor progress and make data-driven decisions. Proven experience within a similar role is required ideally within the insurance or financial services sector. Required skills Databricks Data Engineering Desirable Experience Looker instance BigQuery Understanding of Google CES Data for - CX Insights CCaaS Dialogflow CX/Conversational...

Lead Data Platform Engineer - Outside IR35 - 1 day pw London (rest remote) - 3 months Initially We are currently recruiting for a Lead Data Platform Engineer to join a programme focused on data platforms, analytics engineering, and modern Lakehouse solutions. The client is looking for a hands-on engineering professional with strong Microsoft Fabric, Spark, PySpark and SparkSQL expertise, capable of designing, building and supporting enterprise-scale data platforms. Start Date: ASAP Duration: 3 months Initially Pay Rate: Competitive IR35 Status: Outside IR35 Location: London (1 day per week onsite, remainder remote) The Role: The core requirement is strong Lakehouse expertise, particularly Spark, PySpark, and SparkSQL. Hands-on experience in low-code is essential. Data & Analytics Expertise: Particularly relevant to your current Data Platform background: Data architecture (Lakehouse, Medallion, Kimball, 3NF). Data ingestion and processing. Data...

A public sector organisation is seeking a Senior Data & Reporting Engineer to join via a Consultancy to support a major cloud-based data programme focused on occupancy analytics and smart building technologies. You will play a pivotal role in designing, developing and optimising data pipelines, reporting datasets and analytical solutions that transform complex operational data into trusted business insights. Working as part of a multi-disciplinary Agile team, you will help evolve a sophisticated AWS-hosted platform that ingests data from WiFi, IoT sensors and other property technology systems. This is an exciting opportunity for someone who enjoys combining data engineering, analytics engineering and reporting expertise to deliver high-quality data products that inform strategic and operational decision-making. This is an initial contract until May 2027 with potential to be extended, it is one day per week in the office in Central London with a daily rate of £610...

Lead Data Platform Engineer - Outside IR35 - 1 day pw London (rest remote) - 3 months Initially We are currently recruiting for a Lead Data Platform Engineer to join a programme focused on data platforms, analytics engineering, and modern Lakehouse solutions. The client is looking for a hands-on engineering professional with strong Microsoft Fabric, Spark, PySpark and SparkSQL expertise, capable of designing, building and supporting enterprise-scale data platforms. Start Date: ASAP Duration: 3 months Initially Pay Rate: Competitive IR35 Status: Outside IR35 Location: London (1 day per week onsite, remainder remote) The Role: The core requirement is strong Lakehouse expertise, particularly Spark, PySpark, and SparkSQL. Hands-on experience in low-code is essential. Data & Analytics Expertise: Particularly relevant to your current Data Platform background: Data architecture (Lakehouse, Medallion, Kimball, 3NF). Data ingestion and processing. Data...

Senior Data Quality Engineer £500-525 per day | Outside IR35 | Initial contract to December 2026| Hybrid (London) Leading Financial Services business is looking to bring in a Senior Data Quality Engineer to join its Finance Data & Reporting Product Team. This is a hands-on contract focused on data quality, testing, reconciliation and automation across a modern cloud data platform. Working across the full data life cycle, you will validate finance data from source systems through to Snowflake, dbt and Power BI, while enhancing an existing data quality framework and driving improvements in test automation and quality engineering practices. Key Responsibilities Design and execute end-to-end data quality, validation and reconciliation testing. Validate data across source systems, Snowflake, dbt transformations and Power BI reporting. Enhance and extend the existing dbt Core testing framework. Build automated data quality, regression and reconciliation checks....