81 data engineer jobs found in London

We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory reporting or financial services Exposure to Tagetik...

Senior Data Engineer Location: London (Hybrid Working) Type: Contract Pay Rate: £350-£400 (Outside IR35) We're looking for a Senior Data Engineer to join a high-performing data team responsible for delivering scalable, reliable, and innovative data solutions that power analytics and decision-making across a global streaming and digital ecosystem. This is an opportunity to work with modern cloud technologies, large-scale datasets, and a collaborative engineering culture where you'll help shape the future of data platforms used by millions of customers worldwide. What You'll Be Doing Design, build, and support scalable data models and distributed ETL pipelines using modern big data technologies. Collaborate with stakeholders across multiple business functions to understand data challenges and translate requirements into robust technical solutions. Champion DataOps principles, engineering best practices, and continuous improvement initiatives....

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer/Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore...

Data Engineer - Contract - Outside IR35 - Wembley Hybrid This position will focus on improving and maturing the existing data platform, developing scalable data structures and pipelines, and supporting the wider business in maximising the value of its data. The environment has been established within Microsoft Fabric for several years, however there remains significant opportunity to improve data warehousing structures, data modelling, governance and reporting capabilities. The successful candidate will work across the full data lifecycle, from ingestion and transformation through to reporting and security, while collaborating closely with Data Analysts and business stakeholders. This is a hands-on role suited to someone who enjoys building practical, maintainable solutions and can balance strong technical capability with a business-focused approach. Key Responsibilities Design, develop and maintain data pipelines within Microsoft Fabric. Build and enhance...

Data Engineer - SQL/Fabric/ADF/PySpark/ETL - Insurance - OUTSIDE IR35 Our client, a leading insurance broker, urgently requires an experienced Data Engineer to join their team to work on a high-profile, time-critical project. This is a hybrid role with 1-2 days a week in the office (London/Manchester). If you don't have insurance/insurance broking experience, please DON'T apply. ESSENTIAL SKILLS & EXPERIENCE: 5+years data engineering experience within insurance/insurance broking; Strong experience in SQL, Fabric, ADF, PySpark and ETL; and Understanding of insurance broking systems eg OpenGI, Applied, Guidewire, Instanda, Acturis. Key skills; Data Engineer, BI Developer, SQL, Fabric, ADF, PySpark, ETL, OpenGI, Applied, Guidewire, Instanda, Acturis, insurance, insurance broking, data, data warehousing.

Senior Data Engineer - Contract (outside IR35) - up to £550 per day We’re hiring a Senior Data Engineer to join a leading global organisation, helping to build and enhance a modern data platform within the insurance sector. NB London Market Insurance experience is essential. If you do not have this experience, you will not be eligible for this role. The role You’ll design and develop data pipelines using ETL/ELT, ensuring strong standards in testing, reconciliation, and documentation. You’ll contribute to data modelling, support data delivery, and build APIs/services for stakeholders. You’ll also collaborate across teams, promote best practices, and mentor junior colleagues in an Agile environment. Key requirements London Market Insurance experience (must-have) Advanced T-SQL, SSIS, Azure Data Factory Power BI/SSRS, MDX/DAX Strong data modelling Experience with Azure & on-prem SQL Azure DevOps, data APIs, solid documentation/testing practices...

Data Engineer | Snowflake | SQL | Python | Dynamics CRM We're looking for an experienced Data Engineer to play a key role in a high-profile data transformation programme. You'll lead the modelling of CRM data into Snowflake, develop scalable data pipelines, and help shape the future of analytics, reporting and insight across the organisation. Working closely with both technical teams and business stakeholders, you'll bridge the gap between data users and IT, ensuring robust, trusted data solutions. Key skills: • Snowflake • SQL & Python • dbt • ETL/Data Warehousing • Dynamics CRM (or similar) • Git This is an opportunity to influence architecture, lead technical delivery, and make a real impact within a complex, evolving environment. The role has been deemed Outside IR35, with onsite requirements driven by project needs rather than a fixed mandate. 6 month initial contract.

Senior Data Engineer - Contract - Outside IR35 Hybrid working, Central London Up to £650 per day FinTech | London We’re partnered with a fast-growing FinTech at the heart of Private Market Investments, looking to scale their Data function. What They’re Looking For Strong grounding in computer science fundamentals and data modelling Commercial experience with more than one programming language (Python, Scala, Java, C++) (and strong SQL skills) Experience with streaming and data processing (e.g. Kafka, Spark, Athena or similar) Hands-on experience with Azure Familiarity with data containerisation, ingestion, and orchestration Clear communicator who can explain technical decisions to non-technical stakeholders Why Join? Work on genuinely difficult engineering problems Exposure to large, complex systems in real production environments A culture built by engineers, for engineers Hybrid working, Central London Up to £650 per day If you’re...

Data Engineer £550-600/day outside IR35 6-month contract Remote working Working with a FTSE 100 client who have a requirement for a hands-on Senior Data Engineer. The role will be involved in designing and delivering data models, integrations, orchestration pipelines, rule engines and contributing to the platform/infrastructure - MUST have Terraform experience. Data Engineer, key skills: MUST have experience using Terraform to build and manage IAC Proven experience with AWS (eg S3, Lambda, Glue etc) Background in building data pipelines, integrations and transformation layers Strong hands-on SQL experience Data modelling Data quality rules and validation frameworks Snowflake is massively desirable Data Engineer, AWS, Terraform, Snowflake Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and...

Data Engineer £550-600/day outside IR35 6-month contract Remote working Working with a FTSE 100 client who have a requirement for a hands-on Senior Data Engineer. The role will be involved in designing and delivering data models, integrations, orchestration pipelines, rule engines and contributing to the platform/infrastructure - MUST have Terraform experience. Data Engineer, key skills: MUST have experience using Terraform to build and manage IAC Proven experience with AWS (E.g S3, Lambda, Glue etc) Background in building data pipelines, integrations and transformation layers Strong hands-on SQL experience Data modelling Data quality rules and validation frameworks Snowflake is massively desirable Data Engineer, AWS, Terraform, Snowflake Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have...

Microsoft Fabric Data Engineer - P &C Insurance - 6-12 months London (1 day per week onsite) £400- £500 per day (Outside IR35) Contract We 're working with a forward-thinking company supporting major insurance clients, who are looking to bring in a Microsoft Fabric Data Engineer to help deliver modern data and analytics solutions across the P &C domain. This is a great opportunity to work at the cutting edge of Microsoft 's data ecosystem, helping insurers unlock value from complex datasets across underwriting, claims, and portfolio performance. The Role You 'll play a key role in designing and building scalable data platforms within Microsoft Fabric, taking ownership from ingestion through to insight delivery. Working closely with technical and business stakeholders, you 'll help shape solutions that drive smarter decision-making across the insurance lifecycle. Key responsibilities will include: Delivering end-to-end data...

Contract – Senior Data Engineer Contract : 6 month sRate : £750 - £800 PD (Outside IR35 )Location : London / Hybrid x2 days onsit e Overvi ewWe are seeking an experienced Senior Data Engineer to join a major data programme transforming how organisations and industry partners access and use health data across the UK. You will design, build and optimise scalable data platforms and pipelines that enable secure, trusted and efficient access to health data. You will collaborate closely with architects, product teams, analysts and engineers to deliver high-quality data solutions that support research, innovation and operational decision-making. This role is ideal for a hands-on Data Engineer who enjoys solving complex data challenges, working with large datasets and building modern cloud-based data solutions within regulated environment s. Role & Responsibilit iesData Engineering & Platform Developm entDesign, build and maintain scalable data...

Azure/Microsoft Fabric Data Engineer - remote - outside IR35 - £500 - 535 (and a perm role - up to £80k) You will be an experienced Azure/Microsoft Fabric Data Engineer and will help design, build and maintain modern data platforms. The role will focus on Microsoft Fabric, Azure data services, Lakehouse architecture, data ingestion, transformation, modelling, governance and AI-ready analytics. Skills/Experience Strong experience with Microsoft Azure data services and modern cloud data engineering. Hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, Pipelines, Dataflows, Notebooks and Power BI. Good understanding of data lake, lakehouse and warehouse architecture. Experience building data ingestion and transformation pipelines from multiple source systems. Strong SQL skills and experience working with relational data models. Experience with Python and/or PySpark for data transformation and automation. Understanding of Power BI, semantic models, DAX and...

Azure/Microsoft Fabric Data Engineer - remote - outside IR35 - £500 - 535 (and a perm role - up to £80k) You will be an experienced Azure/Microsoft Fabric Data Engineer and will help design, build and maintain modern data platforms. The role will focus on Microsoft Fabric, Azure data services, Lakehouse architecture, data ingestion, transformation, modelling, governance and AI-ready analytics. Skills/Experience Strong experience with Microsoft Azure data services and modern cloud data engineering. Hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, Pipelines, Dataflows, Notebooks and Power BI. Good understanding of data lake, lakehouse and warehouse architecture. Experience building data ingestion and transformation pipelines from multiple source systems. Strong SQL skills and experience working with relational data models. Experience with Python and/or PySpark for data transformation and automation. Understanding of Power BI, semantic models,...

Analytics Engineer Hybrid (3 days on site in Central London) £400-500p/d (Outside IR35) Role Overview We’re looking for an Analytics Engineer to join a small, focused data team on a 6-month contract to rebuild reporting infrastructure and migrate from a legacy CRM system to a modern cloud data stack. This is a hands-on, scoped delivery role where you’ll own a defined workstream, working closely with analysts who hold the domain context and manage stakeholder relationships. You’ll bring build velocity to the intermediate and fact-layer modelling while reconciling historical legacy data into new formats. Technical Stack Cloud Platform: GCP / BigQuery Core Transformation Tool: dbt Data Lineage / Catalog: Secoda, DataHub, or OpenMetadata (tool to be implemented) Migration Project Experience: Legacy CRM system onto BigQuery & dbt Requirements Must have: Production dbt experience, BigQuery/SQL proficiency, data...

MLOps Platform Manager London Rate: £550- £650 Outside IR35 Per Day Work Type: Fully remote Start: ASAP The Company They are a well established organisation with a strong enterprise data estate and a clear commitment to using data and AI responsibly at scale. The business operates in a complex environment where reliability, security and governance are essential. Data, analytics and machine learning teams work closely together, supported by a central platform function focused on operational excellence. The Role and Deliverables Own the day to day operation of Palantir platforms and associated MLOps services, ensuring availability, performance and a strong user experience. Establish and run service management processes including incident, problem and change management, supported by clear documentation and runbooks. Define and embed standard MLOps patterns covering model development, deployment, monitoring and lifecycle...

Senior ML Platform Engineer London 5 Days a Week In Office £550- £700 Per Day, Outside IR35 Immediate Start The Company They are a technically ambitious organisation building advanced machine learning systems tightly integrated with real-world systems. Their platform supports the full lifecycle from data collection through to large-scale training and deployment. Engineering quality, reliability, and thoughtful system design are core to how they operate. The Role and Deliverables Own and evolve the operator-facing platform, including web UIs, backend services, and CLI tooling used for live data collection and dataset workflows. Design and maintain robust recording and orchestration systems that scale across robots, sensors, and lab environments. Collaborate with the ML team on dataset builders, ingestion pipelines, and infrastructure supporting large-scale distributed training. Partner with robotics engineers on ROS2 integration,...

Senior Software Engineer - Geospatial Data (Contract) Location: Farnborough (3 days per week onsite) Contract Length: Initial 3-month contract IR35 Status: Outside IR35 Security Clearance: All candidates must be eligible for security clearance prior to appointment click apply for full job details

AI Architect | Contract | 6 Months | £400/day | Outside IR35 | Remote (UK Based) Start straight away The Opportunity A leading enterprise AI services firm is looking for a hands-on AI Architect to define and deliver next-generation GenAI and agentic AI platforms across a global client base. You 'll own end-to-end architecture across Azure AI Foundry, Databricks, and AWS - from discovery through production - and act as a trusted technical voice in pre-sales, CXO conversations, and partner co-innovation. Rate: £400/day Duration: 6 months IR35: Outside Location: Remote (UK based candidates only) What You 'll Be Doing Designing reference architectures and platform standards for repeatable, scalable client delivery Architecting production-grade GenAI platforms on Azure AI Foundry - RAG, copilots, and multi-agent systems Building Lakehouse-based AI platforms using Databricks, Mosaic AI, MLflow 3.0, and Unity Catalog Designing...