153 data engineer jobs found

Data Engineer 6-months £400 - £450 per day (outside IR35) Remote This is an opportunity to join a leading organisation within the media sector, supporting a major data transformation programme across their cloud data platform. You'll play a key role in building and optimising scalable data pipelines and analytics solutions, working across AWS, Snowflake, dbt and Airflow to deliver high-quality data products. The Company They are a well-established media organisation with a large and diverse audience, using data and technology to drive content, commercial, and customer decisions. As part of a significant data platform modernisation initiative, they are expanding their data engineering capability and investing in modern cloud technologies. This role offers the chance to work with large-scale data within a highly collaborative engineering environment. The Role and Deliverables Develop, enhance, and maintain scalable data pipelines using AWS, Snowflake, dbt and...

Data Engineer / GCP / LookML / BigQuery £525- 575 per day (Outside IR35) London / Hybrid Data Engineer / GCP / LookML / BigQuery This is an opportunity for you to join a growing ecommerce business who are looking for a Data Engineer with strong experience in the GCP stack to build and maintain data pipelines and create new dashboards and reports across the business. You'll be using their newly adopted GCP stack, BigQuery, Looker etc. and work closely with the wider data engineering team. We're interested in hearing from people who have experience with some of the following: SQL BigQuery GCP LookML Please apply to be considered. London / Hybrid £525- 575 per day (Outside IR35) Data Engineer / GCP / LookML / BigQuery

Data Engineer – Azure / Databricks / Financial Services / 3-month contract / Remote Data Engineer / Data Engineering / Azure / Databricks / Ingestion / Pipelines / API / Azure API Management (APIM) / Python / 3-month contract / Outside IR35 / Fully remote / £400 – 500 per day. One of our leading clients is looking to recruit a Data Engineer. Location – Remote / home based / WFH Duration – Initial 3 month  Day Rate – £400-500 per day Outside IR35 Role / Responsibilities: · Define and build a data lake architecture on Azure (ADLS + Databricks) · Layered data model (bronze / silver / gold) for ingestion, processing, and reporting · Develop ingestion patterns from API sources (batch and streaming) · Establish data governance, metadata, and access controls · Define storage structures, naming conventions, and schema design · Develop API connectors and ingestion pipelines using Python · Implement integration services feeding into...

Senior Data Engineer - GCP/BigQuery/Data Products DURATION: Contract until 31st December 2026, with potential to extend for a further 6 months LOCATION: London/Hybrid START DATE: ASAP ONSITE REQUIREMENTS: Hybrid - 2 days per week onsite in London ENGAGEMENT TYPE: Outside IR35 DAY RATE: Upto £600 per day (DoE) LEGAL RIGHT TO WORK: Candidates must have the legal right to work in the UK. Sponsorship is not available for this role. GIBBS CONSULTING SUMMARY As part of our continued business growth, we at Gibbs Consulting are expanding our Data Product Feature Team and are looking to bring in an experienced Senior Data Engineer. You will join our growing consulting team and deliver for an end-customer within the banking sector, supporting a large-scale data platform modernisation programme. This is a hands-on engineering role focused on building scalable, governed and cloud-native data capabilities within Google Cloud Platform. JOB OVERVIEW We are looking for a Senior Data Engineer...

Data Engineer/GCP/LookML/BigQuery £525- 575 per day (Outside IR35) London/Hybrid Data Engineer/GCP/LookML/BigQuery This is an opportunity for you to join a growing E-commerce business who are looking for a Data Engineer with strong experience in the GCP stack to build and maintain data pipelines and create new dashboards and reports across the business. You'll be using their newly adopted GCP stack, BigQuery, Looker etc. and work closely with the wider data engineering team. We're interested in hearing from people who have experience with some of the following: SQL BigQuery GCP LookML Please apply to be considered. London/Hybrid £525- 575 per day (Outside IR35) Data Engineer/GCP/LookML/BigQuery

Data Engineer - Reporting Migration Project Up to £600 per day | Outside IR35 | 6 Month Initial Contract | London (3 Days Per Week) We are seeking an experienced Data Engineer to join a high-profile data transformation and reporting migration programme. This is a hands-on contract role focused on supporting the transition from a Legacy reporting environment to a modern data platform while ensuring business-critical reporting remains stable and accurate throughout the migration. The Role You will play a key role in designing and implementing data mapping frameworks, compatibility layers and reporting solutions that enable Legacy and new platforms to operate in parallel. Working closely with both technical teams and business stakeholders, you will help validate data quality, resolve reporting challenges and support the successful adoption of the new reporting foundation. Key responsibilities include: Designing and maintaining metadata-driven mapping frameworks between...

Data Engineer/Data Engineering/Azure/Databricks/Ingestion/Pipelines/API/Azure API Management (APIM)/Python/3-month contract/Outside IR35/Fully remote/£400 - 500 per day. One of our leading clients is looking to recruit a Data Engineer. Location - Remote/home based/WFH Duration - Initial 3 month Day Rate - £400-500 per day Outside IR35 Role/Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Layered data model (bronze/silver/gold) for ingestion, processing, and reporting Develop ingestion patterns from API sources (batch and streaming) Establish data governance, metadata, and access controls Define storage structures, naming conventions, and schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and...

Data Engineer 6-months £400 - £450 per day (outside IR35) Remote This is an opportunity to join a leading organisation within the media sector, supporting a major data transformation programme across their cloud data platform. You 'll play a key role in building and optimising scalable data pipelines and analytics solutions, working across AWS, Snowflake, dbt and Airflow to deliver high-quality data products. The Company They are a well-established media organisation with a large and diverse audience, using data and technology to drive content, commercial, and customer decisions. As part of a significant data platform modernisation initiative, they are expanding their data engineering capability and investing in modern cloud technologies. This role offers the chance to work with large-scale data within a highly collaborative engineering environment. The Role and Deliverables Develop, enhance, and maintain scalable data pipelines...

Data Engineer - Azure / Databricks / 3-month contract / Remote Data Engineer / Data Engineering / Azure / Databricks / Ingestion / Pipelines / API / Azure API Management (APIM) / Python / 3-month contract / Outside IR35 / Fully remote / £400 - 500 per day. One of our leading clients is looking to recruit a Data Engineer. Location - Remote / home based / WFH Duration - Initial 3 month Day Rate - £400-500 per day Outside IR35 Role / Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Layered data model (bronze / silver / gold) for ingestion, processing, and reporting Develop ingestion patterns from API sources (batch and streaming) Establish data governance, metadata, and access controls Define storage structures, naming conventions, and schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks...

Data Engineer (Contract) 6-Month Contract Fully Remote ASAP Start Circa £350-£400 per day (Outside IR35) Our small Data & AI Consultancy Client is currently seeking an experienced Data Engineer Contractor to join a growing Data Engineering team on an initial 6-month contract . You'll work closely with Product Owners, Architects, and Engineering teams to design and deliver modern data solutions for clients across highly regulated industries – Financial Services, Energy, Legal & Pharmaceuticals etc. Key Responsibilities will include: Designing, building, and maintaining scalable data pipelines Developing data ingestion, transformation, and reporting solutions Working with stakeholders to understand data requirements and deliver business value Supporting data modelling, analytics, and visualisation initiatives Apply best practices in Data Engineering, Agile, and DevOps delivery To be successful in the Contract, Required Skills will...

Senior Data Engineer – Microsoft Fabric Contract: Outside IR35 Start date: Expected 14 September 2026 Duration: To 18 December 2026 Location : Onsite in London 4 days/week We are looking for a Senior Data Engineer to support a major financial-services data transformation programme. You will build and migrate enterprise data pipelines, with a focus on moving workloads from Azure Data Factory and ADLS to Microsoft Fabric . Key Responsibilities Build and enhance metadata-driven ingestion frameworks. Develop incremental loads, watermarks and merge processes. Migrate ETL workloads to Microsoft Fabric Pipelines . Integrate cloud platforms with on-premises environments. Develop reusable deployment patterns and technical documentation. Support CI/CD across DEV, TEST, UAT and PROD. Test pipelines, resolve defects and support UAT. Work within Agile delivery teams. Essential Experience Strong Microsoft Fabric / Fabric Pipelines experience. Strong...

If you are an experienced Data Engineer/GenAI Developer we have anew contract we would like to discuss with you. Please note this role falls outside IR35 and will require some occasional onsite attendance in London. We are seeking an experienced Data Engineer to design and build modern data solutions supporting enterprise AI and Generative AI use cases. This is a hands-on engineering position spanning trusted data pipelines, RAG and LLM services, APIs and production deployment. What you'll do: Design and optimise scalable ETL/ELT pipelines for structured, semi-structured and unstructured data. Build production-ready RAG pipelines covering ingestion, chunking, embeddings, vector search, retrieval and grounding. Integrate enterprise data with LLM and AI services through secure, reusable APIs and components. Take AI use cases from prototype through production, including testing, CI/CD, monitoring and troubleshooting. Work with data scientists, AI...

We're working with a UK-based financial services business supporting clients across investment management and wealth planning. Their data team is currently going through a period of improvement following a major data platform implementation, and they're looking to bring in an experienced Data Engineer to help build out and improve the platform. You'll work closely with the existing data team, taking ownership of data engineering and pipeline development while helping improve the overall architecture. You'll also be expected to share knowledge, challenge existing approaches and help develop the permanent team. Key requirements: Strong Data Engineering background Hands-on experience with Databricks Experience building data pipelines and working with Medallion Architecture Experience with Azure Understanding of temporal/bi-temporal data Strong experience with GitHub and GitHub Actions Experience with Terraform/Infrastructure as Code Experience with...

Data/BI Engineer | 3 Month Contract | (Outside IR35) | Hybrid, Enfield, London| Starting ASAP Day Rate: £400 About the Role: Our client is a growing UK retail business investing in a significant technology modernisation programme, including a new digital platform, API-led integrations, and the rollout of Microsoft Fabric. With executive sponsorship and a defined target architecture already in place, the business is now looking to build its data capability. Reporting is currently heavily reliant on manual processes, with data sourced from multiple systems and prepared before insights can be delivered. The organisation has invested in Microsoft Fabric to create a more scalable, automated, and self-service data environment. This role will lead the delivery of a greenfield Microsoft Fabric platform, building the agreed architecture from the ground up and enabling improved reporting, analytics, and business insight across the organisation. Main Duties Design and build a...

Data Engineer / Data Engineering / Azure / Databricks / Ingestion / Pipelines / API / Azure API Management (APIM) / Python / 3-month contract / Outside IR35 / Fully remote / £400 – 500 per day.   One of our leading clients is looking to recruit a Data Engineer.   Location – fully remote / home based Duration – Initial 3 month Day Rate – £400-500 per day Outside IR35   Role / Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Layered data model (bronze / silver / gold) for ingestion, processing, and reporting Develop ingestion patterns from API sources (batch and streaming) Establish data governance, metadata, and access controls Define storage structures, naming conventions, and schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data...

Data Engineer / Data Engineering / Azure / Databricks / Ingestion / Pipelines / API /  Azure API Management (APIM ) / Python / 3-month contract / Outside IR35 / Fully remote / £400 – 500 per day. One of our leading clients is looking to recruit a Data Engineer. Location – fully remote / home based Duration – Initial 3 month  Day Rate – £400-500 per day Outside IR35 Role / Responsibilities: · Define and build a data lake architecture on Azure (ADLS + Databricks) · Layered data model (bronze / silver / gold) for ingestion, processing, and reporting · Develop ingestion patterns from API sources (batch and streaming) · Establish data governance, metadata, and access controls · Define storage structures, naming conventions, and schema design · Develop API connectors and ingestion pipelines using Python · Implement integration services feeding into the Databricks environment · Build data transformation logic using PySpark /...

Role overview We are seeking Senior Data Engineers to join a delivery team supporting a major financial-services client's Data Strategy implementation. You will be onsite 4 days a week 1 day remote. Outside IR35 You will design, build, test and deploy data-engineering features, including onboarding new data sources and migrating existing ETL processes from Azure Data Factory and Azure Data Lake Storage to Microsoft Fabric. Responsibilities Enhance an existing metadata-driven ADF ingestion framework to onboard new data sources. Develop incremental load processes, watermarks, merge logic and ingestion mappings. Migrate ETL processes from ADF and ADLS to Microsoft Fabric Pipelines. Integrate Fabric Pipelines through On-Premises Data Gateways. Build parameterised templates and reusable Fabric deployment patterns. Produce and maintain source-to-target data mappings and technical specifications. Promote build artefacts through DEV, TEST, UAT and PROD using established...

Remote working U.K *SC and NPPV3 clearance essential* Outside IR35 *Please do NOT apply if you do not hold SC/NPPV3 clearance, these are non negotiables* We're looking for a Data Engineer/Developer to join a specialist team delivering innovative data solutions within the law enforcement and digital investigations space. This role centres on transforming complex investigative and forensic datasets into structured intelligence, developing automated data processing workflows, and supporting the integration of policing data standards into modern analytical platforms. You'll work with large volumes of digital evidence and intelligence data, designing robust transformation pipelines and automation that enable investigators and analysts to derive value from complex information quickly and accurately. This is an excellent opportunity for someone with a background in digital forensics, eDiscovery, law enforcement data, or data engineering who enjoys solving complex...

Data Engineer/Data Engineering/Azure/Databricks/Ingestion/Pipelines/API/Azure API Management (APIM)/Python/3-month contract/Outside IR35/Fully remote/£400 - 500 per day. One of our leading clients is looking to recruit a Data Engineer. Location - fully remote/home based Duration - Initial 3 month Day Rate - £400-500 per day Outside IR35 Role/Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Layered data model (bronze/silver/gold) for ingestion, processing, and reporting Develop ingestion patterns from API sources (batch and streaming) Establish data governance, metadata, and access controls Define storage structures, naming conventions, and schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging,...

Senior Data Engineer - Contract - Python/ Azure/ airflow/ TypeScript/ APIs Outside IR35 | £600–£800/day | 6 months initially | August/September start Senior contract Data Engineers for an initial 6-month contract, helping scale the data layer behind a global investment platform. The project is about turning that fragmented data into a clean, scalable and reliable data layer. Data engineer deliverables: Build and evolve data ingestion pipelines from multiple external data sources Design scalable data models across complex investment data Build APIs and product-facing data services Solve reconciliation and data-quality problems at scale Develop lakehouse and streaming capabilities Improve reliability, observability and performance Develop AI-driven approaches to ingestion, processing and reconciliation Technology environment: Core: TypeScript, Python, SQL, Azure Data engineering: Azure Data Lake, Airflow, Delta, lakehouse architecture,...