122 data engineer jobs found in London

Senior Software Developer / Data Engineer - (Contract Outside IR35) In brief We’re looking for well-rounded software developers with experience in data engineering, with a proven ability to tackle complex data challenges, make an excellent impression on clients, and have a high impact on the output of your entire team. We provide a supportive environment with a strong focus on individual career progression, where you will have both the mentorship and project opportunities you need to develop your technical skills. You’ll work in a team alongside other talented developers and data engineers, supported by a Technical Lead. Projects span a range of sizes and multiple sectors and technologies. The role Experience and qualifications You have 4+ years’ experience and a breadth & depth of technical knowledge & expertise, particularly in data engineering, and can solve technical challenges across front-end, back-end, and infrastructure. You have...

Job Title: Data Engineer (Telecom Industry Experience Required) Location: Hybrid London/Reading (2days/week Onsite) Duration: 6months+ 500GBP/day Contract Outside IR35 Strong experience in Excel, Power BI, and SQL Role Overview We are looking for a skilled Data Analyst / Data Engineer to support data-driven decision-making for a telecom client. The role will focus on analysing data, building dashboards, and providing insights to support business and network operations. Key Responsibilities Work with large datasets to analyse and generate business insights Build and maintain dashboards using Power BI / Excel Write and optimise SQL queries for data extraction and analysis Support reporting and data visualisation for business teams Work closely with stakeholders to understand data requirements Present insights in a clear and structured way to senior stakeholders Support data-driven decision-making across telecom operations Required Skills &...

We are hiring a Senior GCP Data Engineer to design and build scalable, high-performance data platforms on Google Cloud for a leading banking/financial services client. This role involves working on large-scale data systems, building both batch and real-time pipelines, and delivering enterprise-grade data solutions. Key Responsibilities Design and build batch & real-time data pipelines on GCP Work with BigQuery, Dataflow, Cloud Storage, Spanner Develop real-time streaming solutions (Kafka / Apache Beam) Implement Infrastructure as Code using Terraform Deploy workloads on Kubernetes (GKE) Build and manage CI/CD pipelines (Jenkins / Spinnaker) Collaborate on data modelling and architecture Ensure systems are secure, scalable, and cost-optimized Required Skills 6+ years of overall experience in Data Engineering 3+ years of hands-on experience in Google Cloud Platform (GCP) Strong expertise in: BigQuery Dataflow / Apache Beam...

All our office locations considered: Newbury, Reading, London, Liverpool, Glasgow (UK); xc5 xa0ibenik, Croatia (considered) We 're on the hunt for builders . No, we 've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as telecoms, insurance, finance and mortgages. ? First and foremost we seek strong Consultants; so if you are ready to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We 're Intuita - a fast growing consultancy that 's making waves in both the consultancy and technology space. With our ambitious goals for the year ahead and beyond, we are looking for talented individuals...

Data Engineer l AWS l Terraform l Python l DynamoDB l Backend l API l 3-Month Contract to permanent | £500- £525 per day | Remote hybrid We 're supporting a fast-growing health tech organisation looking for a hands-on Data Engineer to help stabilise and scale their AWS serverless pipelines. With rapidly increasing data volumes, they need someone who can bring automation, structure, and production-ready engineering. The Role Improve and maintain pipelines across Lambda, AppSync, DynamoDB, Postgres, SQS, ECS, and Step Functions Standardise fragmented legacy processes into scalable, automated workflows Support internal and participant-facing applications Work closely with the outgoing engineer to ensure smooth knowledge transfer Must-Have Skills Strong Terraform Deep AWS serverless experience Python for production workloads Solid DynamoDB knowledge Nice to Have GraphQL / AppSync Node.js or Python API background...

Job Title: Senior Data Engineer Day Rate: £400-450/day (Outside IR35) Location: 3 days per week on-site in either London or Birmingham Contract Length: 6 months Senior Data Engineer - Role & Responsibilities Design, build, and maintain scalable data pipelines and data models within Microsoft Fabric, supporting enterprise analytics and reporting needs. Lead the migration from Azure Synapse to Microsoft Fabric using a Medallion architecture approach, while ensuring stability of existing Azure and SQL Server environments. Integrate internal systems and third-party data sources into the Fabric platform using APIs and robust data integration patterns. Develop, optimise, and automate ETL workflows, ensuring high standards for data quality, validation, and performance. Deliver and govern Power BI dashboards and reports, while mentoring and upskilling business users to build a self-service analytics capability. Senior Data Engineer - Required Experience...

Senior Data Engineer (Snowflake & dbt) A London-based insurer is seeking a Senior Data Engineer to help design, build, and scale its modern data platform. You'll play a key role in transforming raw data into reliable, well-structured datasets that power analytics, reporting, and data-driven decision-making across the business. Key Responsibilities of the Senior Data Engineer: Design, develop, and maintain scalable data pipelines and ELT workflows Build and optimize data models using dbt to support analytics and business intelligence Manage and enhance our Snowflake data warehouse environment Ensure data quality, integrity, and performance across pipelines Collaborate with analysts, data scientists, and stakeholders to understand data needs Implement testing, monitoring, and documentation for data systems Contribute to data architecture decisions and best practices Essential skills of the Senior Data Engineer: Strong experience with Snowflake (data...

Lead Data Engineer Contract outside IR35 Mostly Remote The Lead Data Engineer/Technical Lead will own the end-to-end technical delivery of a data migration and platform modernisation programme in AWS. This role acts as the single technical point of accountability, setting architecture, defining standards, and coordinating delivery across workstreams. While the programme includes data engineering, the focus is heavily on DevOps, infrastructure, and platform engineering, enabling scalable, secure, and automated migration and ingestion of enterprise data. Required Experience & Skills 5+ years in data/platform engineering, including leadership experience Strong AWS experience: S3, Lambda, IAM, VPC/networking, DMS Proven experience with Infrastructure-as-Code (Terraform) and CI/CD pipelines Experience delivering large-scale data migrations, including CDC approaches Strong Python and SQL skills Understanding of data platforms (eg Snowflake/CDP)...

Data Engineer £450-475 per day | Outside IR35 | SC Cleared Public Sector Programme | Mid/Late April 2026 Start We're recruiting for an SC-cleared Data Engineer to join a major public sector programme delivering critical data capability in a secure, operational environment. This is a hands-on role for someone who can build and improve data pipelines, shape robust data models, and work directly with stakeholders to turn operational requirements into effective technical solutions. You'll be joining at a key point in the programme, with work focused on enhancing existing datasets and pipelines, alongside potential greenfield development as new datasets are introduced. The role is highly stakeholder-facing, so strong communication skills are essential alongside solid technical delivery capability. Key responsibilities Build, enhance and optimise data pipelines Translate business and operational requirements into schemas, data models and efficient data jobs Improve...

Contract Role: Data Engineer (Database Migration Project) / Up to £500 per day / 5 months (likely to extend) / London / Fintech We're looking for an experienced Data Engineer / Migration specialist to lead a critical database migration for one of our fintech clients. Start Date: ASAP Length: 5 months (extension likely) Type: Contract Day rate: up to £500 per day (outside IR35) Location: London - 3 days a week in Office What You’ll Be Doing Mapping the new database into the existing reporting framework. Building robust ETL pipelines to keep BAU reporting flowing. Handling three active data sources, including one undergoing a full structural change. Preserving data lake functionality, including time‑based parameters and historical logic. What We’re Looking For Proven platform‑to‑platform database migration experience (essential). Strong data engineering background (ETL, schema mapping, pipelines). Someone who thrives under pressure and...

Contract Data Engineer / 6 month duration / Outside IR35 / £575 per day / London Market Insurance / We are partnered closely with a London Market Insurance Syndicate, recruiting for a Contract Data Engineer. As Data Engineer you will be responsible for the build / development / enhancement and support the Data ecosystem (Data Platform, Datawarehouse), including but not restricted to Syndicate Data Hub. The Senior Data Engineer will promote good data hygiene across the Syndicate and wider group. Key duties and responsibilities Build / enhance / deliver / support the Data ecosystem, including but not restricted to Syndicate Data Hub: Develop data pipelines leveraging ELT / ETL techniques to ingest, transform and display data following state-of-the-art-approach and internal standards (testing, reconciling and documenting changes is a key part of this role) Design and propose changes to the group data model (with specific focus on Syndicate) Support data scheduled...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

We are hiring a Senior GCP Data Engineer to design and build scalable, high-performance data platforms on Google Cloud for a leading banking/financial services client. This role involves working on large-scale data systems, building both batch and real-time pipelines, and delivering enterprise-grade data solutions. Key Responsibilities Design and build batch & real-time data pipelines on GCP Work with BigQuery, Dataflow, Cloud Storage, Spanner Develop real-time streaming solutions (Kafka / Apache Beam) Implement Infrastructure as Code using Terraform Deploy workloads on Kubernetes (GKE) Build and manage CI/CD pipelines (Jenkins / Spinnaker) Collaborate on data modelling and architecture Ensure systems are secure, scalable, and cost-optimized Required Skills 6+ years of overall experience in Data Engineering 3+ years of hands-on experience in Google Cloud Platform (GCP) Strong expertise in: BigQuery Dataflow / Apache Beam Kafka...

We are currently supporting an Investment Bank as they look to expand their Data Engineering team supporting the Front Office Trading Business. They are seeking a hands-on Data Engineer with extensive experience in Databricks. The ideal candidate will have a strong background of building and maintaining a data lakehouse as well as strong data modelling and pipeline creation experience. They must have a solid understanding of modern data architecture principles. Key Skills: Databricks - ETL processes, data migration Python - OOP Spark (Scala) Azure SQL Experience withing financial services beneficial This role is outside IR35! If you believe you are a good match for the role please apply. We look forward to speaking with you!

Data Engineer - SC Cleared | Outside IR35 | £525/day | 5-Month Contract We are currently seeking a highly capable Data Engineer to join a fast-paced, delivery-focused environment working on large-scale, data-driven solutions. This role offers the opportunity to work on complex data challenges within a modern cloud ecosystem, contributing to the design, build, and optimisation of robust data platforms. Contract Overview: Duration: 5 months (with potential for extension) Rate: Up to £525 per day IR35 Status: Outside IR35 Clearance: Active SC Clearance is essential Role Responsibilities: Design, develop, and maintain scalable data engineering solutions Build and optimise batch and streaming data pipelines to support business-critical use cases Work with large, complex datasets, ensuring high levels of data quality, integrity, and availability Develop and manage data models , schemas, and database structures Deploy and manage cloud-based data...

Data Engineer (Databricks/AWS) | £450 - £475 day rate (Outside IR35) Are you a hands-on Data Engineer who loves moving legacy tech into the modern era? We are looking for a specialist to help a key client migrate away from legacy SQL stacks and stored procedures into a high-performance Databricks-based platform on AWS. This is a pure delivery role focused on building robust Python/SQL pipelines to handle real-time energy data, performing complex transformations and ensuring seamless delivery into Power BI. The Details: 💰 Rate: £450 - £475 per day (Multiple positions/levels available) ⏳ Duration: 6 Months 🛠️ Status: Outside IR35 🌍 Location: Fully Remote (UK Based) What you’ll be doing: Migrating legacy SQL-heavy processes into modern Databricks workflows. Building scalable data pipelines using Python, SQL, and Spark. Handling real-time/operational energy data and complex calculations. Preparing datasets and reporting outputs for Power BI...

Data Engineer Outside IR35 £450 - £500 6 months Hybrid London We're supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You'll be responsible for developing the code that drives their data pipelines, using Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end-to-end processing. Deliver new technical features and components aligned to approved solution designs and business requirements. Enhance, extend, and tune existing data frameworks to support additional use cases and improved performance. Create, manage, and optimise Databricks Workflows , including orchestration logic and operational behaviours. Carry out testing, performance tuning, and provide day-to-day operational support for data pipelines. Work...

Databricks Data Engineer £500 - £550 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and Real Time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create personalised journeys for millions of shoppers worldwide. The Role As a Senior Data Engineer, you'll play a key role in developing and optimising the backbone of the company's data platform. You'll be responsible for building and maintaining large-scale, Real Time data pipelines that power analytics, machine learning, and operational systems across the business. You'll collaborate with software engineers, data scientists, and analytics teams to ensure the platform delivers reliable, high-quality, and compliant data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key...

New Role: Staff Data Engineer (Azure) £400 - £500 per day Outside IR35 6 Month Contract Hybrid (UK-based) – 2 days/week in London Immediate Start 1-2 Stage Interview Process Must haves: 6+ years’ Data Engineering experience Strong SQL (complex queries, optimisation, indexing) Azure (ADF + cloud data platform experience) ETL / ELT and dimensional modelling Experience migrating legacy data into modern cloud environments FiveTran experience End-to-end pipeline ownership Git / DevOps This is a hands-on role focused on data migration, pipeline rebuilds, and improving gold-layer datasets , working closely with stakeholders to ensure data quality and consistency. UK ONLY – Must have recent Data Engineering experience.

Senior Data Engineer – Analytics (Contract) Hybrid – London/Reading A data engineer is required to deliver insight‑ready datasets and support advanced analytics across a cloud‑based environment. The role focuses on building scalable pipelines, refining complex data sources, and enabling analysts and data scientists with high‑quality, well‑structured data. Key Responsibilities Develop and optimise data pipelines for analytics and modelling. Cleanse, transform, and analyse large datasets using Python/R . Maintain SQL‑driven processing workflows in the cloud. Perform EDA to identify trends, anomalies, and data issues. Collaborate with BI teams to deliver reliable analytical datasets. Skills & Experience Strong SQL and data wrangling. Proficient in Python or R. Experience with large, complex datasets and Power BI. AWS experience preferred: Glue, S3, Athena, Lambda, Redshift, Step Functions . Advantageous: statistics/ML exposure and telecom‑style data...