91 data engineer jobs found in London

Senior Data Engineer / GCP / Looker / Big Query £500 - 550 per day (Outside IR35) London / Hybrid (1 day a week) This is an opportunity for you to join a rapidly growing ecommerce business who are looking for a Senior Data Engineer. This role is ideal for someone who has built and operated modern data platforms natively within GCP and can take ownership of the full data engineering lifecycle, from ingestion and transformation through to semantic modelling and reporting enablement. You must have experience in designing, building and optimising scalable data pipelines within the GCP ecosystem. You must also have experience working with Looker as this role with be integral between the commercial and BI teams. Key Requirements: Expert experience across the Google Cloud Platform ecosystem Hands-on experience with BigQuery, including optimisation, modelling and performance tuning Proven experience building scalable data pipelines within GCP Strong knowledge of...

Senior Data Engineer/GCP/Looker/Big Query £500 - 550 per day (Outside IR35) London/Hybrid Senior Data Engineer/GCP/Looker/Big Query This is an opportunity for you to join a rapidly growing E-commerce business who are looking for a Senior Data Engineer to build and maintain data pipelines for a new reporting solution within the business. You'll be responsible for the build across ingestion, modelling and creating semantic layers using their GCP stack. Successful applicants will have experience with: Looker BigQuery GCP Gemini Exceptional candidates would have worked with: Retail Data If you're interested in the role please apply to be considered. London/Hybrid £500 - 550 per day (Outside IR35) Senior Data Engineer/GCP/Looker/Big Query

Data Engineer (SC & NPPV3 Cleared) - Contract (Outside IR35) Location: London (3 days onsite per week) Duration: 3 months (initial) Rate: Up to £570 per day (Outside IR35) Start: ASAP We are currently seeking an experienced Data Engineer for an urgent contract opportunity with a London-based client click apply for full job details

Data Engineer (SC & NPPV3 Cleared) - Contract (Outside IR35) Location: London (3 days onsite per week) Duration: 3 months (initial) Rate: Up to £570 per day (Outside IR35) Start: ASAP We are currently seeking an experienced Data Engineer for an urgent contract opportunity with a London-based client. This role requires candidates to already hold active NPPV3 and SC clearance, due to the nature of the work. Key Requirements Proven experience as a Data Engineer in enterprise environments Strong expertise in data pipelines, ETL processes, and data integration Hands-on experience with modern data tools and platforms (eg Azure, AWS, Databricks, Spark, SQL, Python) Ability to design, build, and optimise scalable data solutions Strong understanding of data modelling and data warehousing concepts Excellent stakeholder communication skills Mandatory Criteria Active NPPV3 clearance Active SC (Security Clearance) Ability to work onsite in London 3 days per week...

Lead Data Engineer (BigQuery Consolidation, Migration & Architecture) – Contract Location: Hybrid - London Contract Length: Initial 4-week engagement with extension Day Rate: £700 per day (Outside IR35) Start Date: ASAP An ambitious, data-driven organisation is seeking a highly experienced Lead Data Engineer to assess and potentially lead the consolidation of a complex, fragmented data landscape into a single Google BigQuery platform. The business currently operates across multiple technologies and data warehouses, creating challenges around data consistency, reporting accuracy, and stakeholder trust. The objective is to establish a scalable, future-proof architecture that delivers a true single source of truth while supporting an AI-enabled data strategy. Initially, this will be a four-week exploratory engagement focused on validating the migration approach, identifying risks, and proving technical feasibility. For the right individual, there is...

Senior Data Engineer – DBT, AWS (native), AWS DMS, ETL, Warehouse Architecture, Redshift, IaC (Terraform) Reporting to the Head of Data for this global, rapidly modernising SaaS platform , this business is scaling its data capabilities to support native AI engineering and agentic workflows. We’re looking for a Senior AWS Data Engineer who wants to shape the future of their data platform, modern analytics stack, and the way data powers decisions across the business. This is a hands‑on, architecture‑shaping, strategy‑influencing role for someone who thrives at the intersection of engineering excellence, data modelling, platform design and cross‑functional leadership. You’ll own the full data lifecycle from ingestion to modelling to consumption , and play a pivotal role in building a reliable, governed, cloud‑native data ecosystem. What you’ll be doing: Architect and deliver a cloud‑native data platform across ingestion, modelling, warehousing and BI...

Azure Data Engineer Flexible office presence offered in line with your preference (West London office) Up to £500 per day outside IR35 6 month contract term initially *Please only apply for consideration if you have full, independent right to work in the UK and you are already living in the UK permanently. Our client cannot offer visa sponsorship or support with relocation to the UK.* Support a data warehouse migration with a very well-established housing association who have been building and maintaining quality homes across London and Southern England for over 70 years so far as a not-for-profit organisation. Requirements for this Azure Data Engineer position: Solid Azure skills across Azure Data Factory and Azure Databricks, ideally also Synapse Ability to write in Python Excellent communication and collaboration skills. A desire to embed yourself into a team culture This Azure Data Engineer role is offers...

Senior Data Engineer | Hybrid | Outside IR35 | £475 - £525 | London We are looking for a Senior Data Engineer to join a leading organisation on a contract basis. This role will suit someone with strong experience across the Azure data platform , particularly Databricks and PySpark , who can take ownership of data engineering delivery from design through to implementation. This is a hybrid role requiring the candidate to be on site 2 days per month. You will be working on building and enhancing modern data platforms, delivering scalable data pipelines, and supporting high-volume data processing in a cloud environment. Key Responsibilities Design and build scalable data pipelines using Azure technologies Develop and optimise solutions in Databricks using PySpark Work with large and complex datasets, including streaming and batch data Build and maintain data platforms and data warehouses Implement ETL/ELT processes and data transformation logic Collaborate...

Senior Data Engineer - DBT, AWS (native), AWS DMS, ETL, Warehouse Architecture, Redshift, IaC (Terraform) - OUTSIDE IR35 Reporting to the Head of Data for this global, rapidly modernising SaaS platform , this business is scaling its data capabilities to support native AI engineering and agentic workflows. We're looking for a Senior AWS Data Engineer who wants to shape the future of their data platform, modern analytics stack, and the way data powers decisions across the business. This is a hands-on, architecture-shaping, strategy-influencing role for someone who thrives at the intersection of engineering excellence, data modelling, platform design and cross-functional leadership. You'll own the full data life cycle from ingestion to modelling to consumption , and play a pivotal role in building a reliable, governed, cloud-native data ecosystem. What you'll be doing: Architect and deliver a cloud-native data platform across ingestion, modelling, warehousing...

Azure Data Engineer Flexible office presence offered in line with your preference (West London office) Up to £500 per day outside IR35 6 month contract term initially *Please only apply for consideration if you have full, independent right to work in the UK and you are already living in the UK permanently. Our client cannot offer visa sponsorship or support with relocation to the UK.* Support a data warehouse migration with a very well-established housing association who have been building and maintaining quality homes across London and Southern England for over 70 years so far as a not-for-profit organisation. Requirements for this Azure Data Engineer position: Solid Azure skills across Azure Data Factory and Azure Databricks, ideally also Synapse Ability to write in Python Excellent communication and collaboration skills. A desire to embed yourself into a team culture This Azure Data Engineer role is offers...

Senior Data Engineer | Hybrid | Outside IR35 | £475 - £525 | London We are looking for a Senior Data Engineer to join a leading organisation on a contract basis. This role will suit someone with strong experience across the Azure data platform , particularly Databricks and PySpark , who can take ownership of data engineering delivery from design through to implementation. This is a hybrid role requiring the candidate to be on site 2 days per month. You will be working on building and enhancing modern data platforms, delivering scalable data pipelines, and supporting high-volume data processing in a cloud environment. Key Responsibilities Design and build scalable data pipelines using Azure technologies Develop and optimise solutions in Databricks using PySpark Work with large and complex datasets, including streaming and batch data Build and maintain data platforms and data warehouses Implement ETL/ELT processes and data...

Azure Data Engineer Flexible office presence offered in line with your preference (West London office) Up to £500 per day outside IR35 6 month contract term initially *Please only apply for consideration if you have full, independent right to work in the UK and you are already living in the UK permanently. Our client cannot offer visa sponsorship or support with relocation to the UK.* Support a data warehouse migration with a very well-established housing association who have been building and maintaining quality homes across London and Southern England for over 70 years so far as a not-for-profit organisation. Requirements for this Azure Data Engineer position: Solid Azure skills across Azure Data Factory and Azure Databricks, ideally also Synapse Ability to write in Python Excellent communication and collaboration skills. A desire to embed yourself into a team culture This Azure Data Engineer role is offers flexibility around hybrid working as...

We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory reporting or financial services Exposure to Tagetik...

Senior Data Engineer Location: London (Hybrid Working) Type: Contract Pay Rate: £350-£400 (Outside IR35) We're looking for a Senior Data Engineer to join a high-performing data team responsible for delivering scalable, reliable, and innovative data solutions that power analytics and decision-making across a global streaming and digital ecosystem. This is an opportunity to work with modern cloud technologies, large-scale datasets, and a collaborative engineering culture where you'll help shape the future of data platforms used by millions of customers worldwide. What You'll Be Doing Design, build, and support scalable data models and distributed ETL pipelines using modern big data technologies. Collaborate with stakeholders across multiple business functions to understand data challenges and translate requirements into robust technical solutions. Champion DataOps principles, engineering best practices, and continuous improvement initiatives....

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer/Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore...

Data Engineer - Contract - Outside IR35 - Wembley Hybrid This position will focus on improving and maturing the existing data platform, developing scalable data structures and pipelines, and supporting the wider business in maximising the value of its data. The environment has been established within Microsoft Fabric for several years, however there remains significant opportunity to improve data warehousing structures, data modelling, governance and reporting capabilities. The successful candidate will work across the full data lifecycle, from ingestion and transformation through to reporting and security, while collaborating closely with Data Analysts and business stakeholders. This is a hands-on role suited to someone who enjoys building practical, maintainable solutions and can balance strong technical capability with a business-focused approach. Key Responsibilities Design, develop and maintain data pipelines within Microsoft Fabric. Build and enhance...

Lead Data Engineer  (BigQuery Consolidation, Migration & Architecture) Contract Location: Hybrid - London Contract Length: Initial 4-week engagement with extension Day Rate: £700 per day (Outside IR35) Start Date: ASAP An ambitious, data-driven organisation is seeking a highly experienced Lead Data Engineer to assess and potentially lead the consolidation of a complex, fragmented data landscape into a single Google BigQuery platform. The business currently operates across multiple technologies and data warehouses, creating challenges around data consistency, reporting accuracy, and stakeholder trust. The objective is to establish a scalable, future-proof architecture that delivers a true single source of truth while supporting an AI-enabled data strategy. Initially, this will be a four-week exploratory engagement focused on validating the migration approach, identifying risks, and proving technical feasibility. For the right individual, there is...

Contract – Senior Data Engineer Contract : 6 month sRate : £750 - £800 PD (Outside IR35 )Location : London / Hybrid x2 days onsit e Overvi ewWe are seeking an experienced Senior Data Engineer to join a major data programme transforming how organisations and industry partners access and use health data across the UK. You will design, build and optimise scalable data platforms and pipelines that enable secure, trusted and efficient access to health data. You will collaborate closely with architects, product teams, analysts and engineers to deliver high-quality data solutions that support research, innovation and operational decision-making. This role is ideal for a hands-on Data Engineer who enjoys solving complex data challenges, working with large datasets and building modern cloud-based data solutions within regulated environment s. Role & Responsibilit iesData Engineering & Platform Developm entDesign, build and maintain scalable data...

Azure/Microsoft Fabric Data Engineer - remote - outside IR35 - £500 - 535 (and a perm role - up to £80k) You will be an experienced Azure/Microsoft Fabric Data Engineer and will help design, build and maintain modern data platforms. The role will focus on Microsoft Fabric, Azure data services, Lakehouse architecture, data ingestion, transformation, modelling, governance and AI-ready analytics. Skills/Experience Strong experience with Microsoft Azure data services and modern cloud data engineering. Hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, Pipelines, Dataflows, Notebooks and Power BI. Good understanding of data lake, lakehouse and warehouse architecture. Experience building data ingestion and transformation pipelines from multiple source systems. Strong SQL skills and experience working with relational data models. Experience with Python and/or PySpark for data transformation and automation. Understanding of Power BI, semantic models, DAX and...