193 data engineer jobs found

Data Engineer (SC) Croydon - 2-4 days per month on site £500/day outside IR-35 Contract until the end of the financial year We are seeking an experienced AWS Data Engineer to support a major government programme delivering secure, scalable data solutions click apply for full job details

Senior Data Engineer Location: UK (Fully remote) Contract Length: 6 months initial Rate: £450 - £550 per day IR35 Status: Outside IR35 We're hiring a Senior Data Engineer for an initial 6-month contract with a client delivering large-scale, cloud-native data platforms. This role is hands-on and execution-focused. We are not looking for architects or consultants, we need strong engineers who can design, build, and deliver robust data solutions in Google Cloud environments. Essential Experience Strong Google Cloud Platform (GCP) experience Advanced SQL and Python skills Proven ability to model and structure data effectively Experience building and maintaining scalable data pipelines Senior-Level Experience (Highly Desirable) Advanced data engineering with: Apache Spark Apache ecosystem tooling Experience with orchestration frameworks such as: Airflow Dagster Strong understanding of distributed data processing and performance optimisation. Google...

Senior Data Engineer (GCP) Fintech London Outside IR35 I'm working with a fast-growing fintech businessseeking a Senior Data Engineer to help design, build, and evolve a modern cloud-based data platform. Youll play a key role in architecting and maintaining scalable, reliable data pipelines that support analytics, data science, and business decision-making across the organisation click apply for full job details

Senior Data Engineer (GCP) Fintech | London | Outside IR35 I'm working with a fast-growing fintech business seeking a Senior Data Engineer to help design, build, and evolve a modern cloud-based data platform. You'll play a key role in architecting and maintaining scalable, reliable data pipelines that support analytics, data science, and business decision-making across the organisation. This is a hands-on role with real ownership over data infrastructure, quality, and delivery. The environment is Google Cloud-led, but the team values engineers who bring broader cloud experience and strong engineering fundamentals. Key responsibilities Design, build, and maintain scalable data pipelines for ingestion, transformation, and distribution of large datasets Develop and evolve a robust cloud-based data architecture that supports analytical and operational use cases Partner closely with data scientists, analysts, and product teams to ensure data is reliable, accessible, and...

Lead AWS Data Engineer | London | Finance | AWS | Java | Outside IR35 | Contract | 12 MonthsOpus is partnered with financial services client to deliver a major programme of work.You’ll join an established engineering group, working alongside internal teams to build a new reporting workflow, upgrade an existing pipeline, and lead a full data‑sourcing uplift across multiple reporting workflows. The team will also be responsible for helping upgrade the framework for two critical internal workflows. This role will require you to be on site in either the London or Birmingham office 5 days per week, please only apply if you hit this criteria.Required Experience Strong background in data engineering within distributed data environments Hands-on expertise with AWS, Spark, Glue, and Snowflake Experience building and optimising data pipelines & reporting workflows Ability to work closely with internal engineering and controls teams Experience upgrading or modernising existing...

Contract Role: Data Engineer (Database Migration Project) / Up to £500 per day / 6 months (likely to extend) / London / Fintech We're looking for an experienced Data Engineer / Migration specialist to lead a critical database migration for one of our fintech clients. Start Date: ASAP Length: 6 months (extension likely) Type: Contract Day rate: up to £500 per day (outside IR35) Location: London/Hybrid What You’ll Be Doing Mapping the new database into the existing reporting framework. Building robust ETL pipelines to keep BAU reporting flowing. Handling three active data sources, including one undergoing a full structural change. Preserving data lake functionality, including time‑based parameters and historical logic. What We’re Looking For Proven platform‑to‑platform database migration experience (essential). Strong data engineering background (ETL, schema mapping, pipelines). Someone who thrives under pressure and can operate...

Senior Data Engineer | Azure | Snowflake | Fivetran | DBT | ETL / ELT | APIs Rate: £225 per day (Outside IR35) Contract: Initially 9 months - likely to extend Start: ASAP Working model: Remote depending on location or Hybrid 1 day p/w Working hours: UK (GMT) Required: Azure, Fivetran (Airbyte or Airflow is considered), Snowflake, Python & APIs (Non Negotiable) 🚨 Non‑Negotiables - Please only apply if you have ALL of the following 🚨 Core technologies: Snowflake (data warehouse) Fivetran (data connectors) DBT (data transformation) Python (including building custom API connectors) Environment: Strong experience working in Azure‑based data environments Proven, hands‑on experience as a Data Engineer Strong experience building and maintaining ETL/ELT pipelines Solid understanding of data warehousing and data modelling concepts Key skills: Experience with Fivetran, Snowflake, Python, and APIs Strong knowledge...

Lead AWS Data Engineer | Birmingham | Finance | AWS | Java | Outside IR35 | Contract | 12 Months Opus is partnered with financial services client to deliver a major programme of work. You'll join an established engineering group, working alongside internal teams to build a new reporting workflow , upgrade an existing pipeline , and lead a full data sourcing uplift across multiple reporting workflows. The team will also be responsible for helping upgrade the framework for two critical internal workflows. This role will require you to be on site in either the London or Birmingham office 5 days per week, please only apply if you hit this criteria. Required Experience Strong background in data engineering within distributed data environments Hands-on expertise with AWS , Spark , Glue , and Snowflake Experience building and optimising data pipelines & reporting workflows Ability to work closely with internal engineering and controls teams Experience...

Lead AWS Data Engineer | London | Finance | AWS | Java | Outside IR35 | Contract | 12 Months Opus is partnered with financial services client to deliver a major programme of work. You'll join an established engineering group, working alongside internal teams to build a new reporting workflow , upgrade an existing pipeline , and lead a full data sourcing uplift across multiple reporting workflows. The team will also be responsible for helping upgrade the framework for two critical internal workflows. This role will require you to be on site in either the London or Birmingham office 5 days per week, please only apply if you hit this criteria. Required Experience Strong background in data engineering within distributed data environments Hands-on expertise with AWS , Spark , Glue , and Snowflake Experience building and optimising data pipelines & reporting workflows Ability to work closely with internal engineering and controls teams Experience upgrading...

We have a new requirement for a Data Engineer to work for a client of ours based in Central London. Skills required: * SQL Development * DBT, Python, PySpark * Databricks * Azure Cloud platform * Working knowledge and experience of key Data warehousing concepts, tools, and languages: Data ingestion, Data processing, ETL and Data modelling * Experience of working in using agile methodologies and tools ie, JIRA, Confluence * Excellent documentation and communication skills * Experience of working with financial services data Role is Outside IR35 and will be working onsite in London 3 days per week. To be considered please submit an up-to-date CV. LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome...

SC Cleared Databricks Data Engineer - Hybrid - Outside IR35 We are seeking a skilled Databricks Data Engineer to design, build, and optimize scalable data pipelines and analytics platforms. In this role, you will work closely with data scientists, analysts, and product teams to deliver reliable, high-performance data solutions using Databricks and modern cloud technologies. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake Build and optimize ETL/ELT workflows for batch and streaming data Develop data models to support analytics, reporting, and machine learning use cases Ensure data quality, reliability, and performance across data platforms Integrate data from multiple sources including APIs, databases, and cloud storage Collaborate with data scientists and analysts to enable advanced analytics and ML workloads Implement monitoring, logging, and cost-optimization best practices...

Lead AWS Data Engineer | Birmingham | Finance | AWS | Java | Outside IR35 | Contract | 12 Months Opus is partnered with financial services client to deliver a major programme of work. You'll join an established engineering group, working alongside internal teams to build a new reporting workflow , upgrade an existing pipeline , and lead a full data-sourcing uplift across multiple reporting workflows. The team will also be responsible for helping upgrade the framework for two critical internal workflows. This role will require you to be on site in either the London or Birmingham office 5 days per week, please only apply if you hit this criteria. Required Experience Strong background in data engineering within distributed data environments Hands-on expertise with AWS , Spark , Glue , and Snowflake Experience building and optimising data pipelines & reporting workflows Ability to work closely with internal...

Lead AWS Data Engineer | London | Finance | AWS | Java | Outside IR35 | Contract | 12 Months Opus is partnered with financial services client to deliver a major programme of work. You'll join an established engineering group, working alongside internal teams to build a new reporting workflow , upgrade an existing pipeline , and lead a full data-sourcing uplift across multiple reporting workflows. The team will also be responsible for helping upgrade the framework for two critical internal workflows. This role will require you to be on site in either the London or Birmingham office 5 days per week, please only apply if you hit this criteria. Required Experience Strong background in data engineering within distributed data environments Hands-on expertise with AWS , Spark , Glue , and Snowflake Experience building and optimising data pipelines & reporting workflows Ability to work closely with internal engineering...

Lead Data Engineer (Azure Synapse) - Watford - £550-£600/day - Outside IR35Global organisation in Watford is seeking a hands-on Lead Data Engineer to review and modernise their data engineering practice. You'll consolidate pipelines, implement best practices, and lead a small team - while remaining actively involved in delivery.3-month contract with a strong chance of extension.What you'll do: Build and optimise Azure Synapse pipelines and integrations Apply Lakehouse / ADLS Gen2 patterns and medallion architecture Lead and mentor engineers while delivering hands-on Ensure secure, scalable, production-ready engineering Coding across SQL, Python, CI/CD, DevOps You'll need: Experience in data engineering, including strong expertise in Azure Synapse Experience stabilising/modernising live platforms Strong SQL, Python, performance tuning, and security focus Exposure to multiple source systems (Finance, CRM, ERP) Hybrid working (2-3 days onsite), competitive rate, outside...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration layer to replace legacy systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part of integration improvements. Rebuild and enhance data flows between Salesforce and other systems. Design and implement a new integration layer to replace old estate connections. Key Skills & Experience: Proven experience as a Databricks Specialist in enterprise environments. Strong knowledge of Azure Data...

Contract Data Engineer / Web Scraping / Data Ingestion / Outside IR35 / £450 - 600 per day / Remote Info Role: Contract Data Engineer Requirements: Web Scraping & Data Ingestion as a must Rate: £450 - £600 per day Determination: Outside IR35 Duration: 6 months Interview Process: 1 stage Office Requirements: Fully remote Contract Data Engineer Quite simply, this Contract Data Engineer positions requires a Python specialist who has worked extensively on Web Scraping & Data Ingestion for a project for our client which will go on for a minimum of 6 months. We are looking for a strong background in Contract Data Engineering or Contract Software Engineering. Please apply now for immediate consideration.

GCP Data Engineer Hybrid 2/3 days - London OUTSIDE IR/35 As a Data Engineer, you’ll design, build, and operate scalable, reliable data pipelines and data infrastructure. Your work will ensure high-quality data is accessible, trusted, and ready for analytics and data science - powering business insights and decision-making across the company. What you’ll do Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations Develop and evolve scalable data architecture to meet business and performance requirements Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics Implement best practices for data quality, testing, monitoring, lineage, and reliability Optimise workflows for performance, cost, and scalability (e.g., tuning Spark jobs, query optimisation, partitioning strategies) Ensure secure data handling and compliance with relevant data protection...

MLOps Data Engineer Hybrid 2/3 days – London Outside IR/35 We’re looking for a Data Engineer with strong MLOps ownership—someone who builds reliable data pipelines and designs, runs, and improves ML pipelines in production. You won’t be training models day-to-day like a Data Scientist; instead, you’ll enable Data Science by delivering high-quality datasets, reproducible training pipelines, robust deployments, and monitoring that keeps ML systems healthy and trustworthy. What you’ll do Design, build, and operate scalable data pipelines for ingestion, transformation, and distribution Develop and maintain ML pipelines end-to-end: data preparation, feature generation, training orchestration, packaging, deployment, and retraining Partner closely with Data Scientists to productionize models: standardise workflows, ensure reproducibility, and reduce time-to-production Build and maintain MLOps automation: CI/CD for ML, environment management, artefact handling,...

Lead Data Engineer (Azure Synapse) - Watford - £550-£600/day - Outside IR35 Global organisation in Watford is seeking a hands-on Lead Data Engineer to review and modernise their data engineering practice. You'll consolidate pipelines, implement best practices, and lead a small team - while remaining actively involved in delivery. 3-month contract with a strong chance of extension. What you'll do: Build and optimise Azure Synapse pipelines and integrations Apply Lakehouse / ADLS Gen2 patterns and medallion architecture Lead and mentor engineers while delivering hands-on Ensure secure, scalable, production-ready engineering Coding across SQL, Python, CI/CD, DevOps You'll need: Experience in data engineering, including strong expertise in Azure Synapse Experience stabilising/modernising live platforms Strong SQL, Python, performance tuning, and security focus Exposure to multiple source systems (Finance, CRM, ERP) Hybrid working (2-3 days onsite),...

AWS Data Engineer 4-6mth contract Onsite in West Yorkshire office (2-3 days per week) £450-550 per day - Outside IR35 Locally based candidates preferred - no relocators - no fully remote Experience AWS Data Engineer contractor required to join my Yorkshire based client at short-notice to work on a 6mth SOW. Key responsibilities include: - Collaborating with analysts and system owners to define data extraction and transformation rules, including interface contracts. - Supporting data modelling initiatives and maintaining transformation logic. - Building ETL/ELT batch and micro-batch pipelines. - Developing modeled data sources and products in Snowflake for end-users. - Maintaining metadata, enforcing data quality, and defining platform standards. - Administering the cloud data platform. Skills required: - Hands-on experience delivering ETL pipelines using tools like AWS Glue or FiveTran. - Experience with dbt. - Strong proficiency in SQL and Python....