90 senior data engineer jobs found

We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory reporting or financial services Exposure to Tagetik...

Senior Data Engineer Location: London (Hybrid Working) Type: Contract Pay Rate: £350-£400 (Outside IR35) We're looking for a Senior Data Engineer to join a high-performing data team responsible for delivering scalable, reliable, and innovative data solutions that power analytics and decision-making across a global streaming and digital ecosystem. This is an opportunity to work with modern cloud technologies, large-scale datasets, and a collaborative engineering culture where you'll help shape the future of data platforms used by millions of customers worldwide. What You'll Be Doing Design, build, and support scalable data models and distributed ETL pipelines using modern big data technologies. Collaborate with stakeholders across multiple business functions to understand data challenges and translate requirements into robust technical solutions. Champion DataOps principles, engineering best practices, and continuous improvement initiatives....

Senior Data Engineer Location: Bristol Contract: Outside IR35 Rate: £68 per hour Security Clearance: DV Cleared Working Pattern: 5 Days On Site Nationality Requirement: Sole British Nationals Only THE ROLE We are recruiting on behalf of a highly secure engineering and technology programme seeking an experienced Senior Data Engineer to support the design, development and delivery of secure, scalable and hi click apply for full job details

Senior Data Engineer – Azure Central government | Outside IR35 | Remote | 6 months + SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets. You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial. Requirements: Strong commercial experience delivering data engineering solutions in Azure. Strong hands-on experience...

Contract – Senior Data Engineer Contract : 6 month sRate : £750 - £800 PD (Outside IR35 )Location : London / Hybrid x2 days onsit e Overvi ewWe are seeking an experienced Senior Data Engineer to join a major data programme transforming how organisations and industry partners access and use health data across the UK. You will design, build and optimise scalable data platforms and pipelines that enable secure, trusted and efficient access to health data. You will collaborate closely with architects, product teams, analysts and engineers to deliver high-quality data solutions that support research, innovation and operational decision-making. This role is ideal for a hands-on Data Engineer who enjoys solving complex data challenges, working with large datasets and building modern cloud-based data solutions within regulated environment s. Role & Responsibilit iesData Engineering & Platform Developm entDesign, build and maintain scalable data...

Senior Data Engineer | Up to £650 per day | Outside IR35 | Fully Remote We are seeking an experienced Senior Data Engineer to join a fast-paced technology business on an initial 6-week contract, with the potential for extension. This is a fully remote opportunity offering up to £650 per day Outside IR3 5 and requires someone who can make an immediate impact from day one . This role will focus on designing, building, and optimising large-scale data platforms and distributed systems within a high-volume, real-time environment. You will work across stream processing, data architecture, multi-tenant data models, validation frameworks, and cloud infrastructure, helping to deliver critical business initiatives within tight timescale s. Key Responsibiliti es:Design and implement scalable, production-grade data pipelines and streaming soluti onsBuild and maintain real-time data processing capabilities using Kafka and stream processing technolog iesDesign and...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks-based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer/Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore...

Senior Data Engineer - Contract - Outside IR35 Hybrid working, Central London Up to £650 per day FinTech | London We’re partnered with a fast-growing FinTech at the heart of Private Market Investments, looking to scale their Data function. What They’re Looking For Strong grounding in computer science fundamentals and data modelling Commercial experience with more than one programming language (Python, Scala, Java, C++) (and strong SQL skills) Experience with streaming and data processing (e.g. Kafka, Spark, Athena or similar) Hands-on experience with Azure Familiarity with data containerisation, ingestion, and orchestration Clear communicator who can explain technical decisions to non-technical stakeholders Why Join? Work on genuinely difficult engineering problems Exposure to large, complex systems in real production environments A culture built by engineers, for engineers Hybrid working, Central London Up to £650 per day If you’re...

Senior Software Engineer - Geospatial Data (Contract) Location: Farnborough (3 days per week onsite) Contract Length: Initial 3-month contract IR35 Status: Outside IR35 Security Clearance: All candidates must be eligible for security clearance prior to appointment click apply for full job details

Senior ML Platform Engineer London 5 Days a Week In Office £550- £700 Per Day, Outside IR35 Immediate Start The Company They are a technically ambitious organisation building advanced machine learning systems tightly integrated with real-world systems. Their platform supports the full lifecycle from data collection through to large-scale training and deployment. Engineering quality, reliability, and thoughtful system design are core to how they operate. The Role and Deliverables Own and evolve the operator-facing platform, including web UIs, backend services, and CLI tooling used for live data collection and dataset workflows. Design and maintain robust recording and orchestration systems that scale across robots, sensors, and lab environments. Collaborate with the ML team on dataset builders, ingestion pipelines, and infrastructure supporting large-scale distributed training. Partner with robotics engineers on ROS2 integration,...

Senior Databricks Engineer Hybrid Cardiff Outside IR35 £400 - £500 Opus is partnering with a new client to support a major data platform build , and we're looking for a Senior Data Engineer to play a key role in the next phase of delivery. This is a hands-on contract position focused on building out a modern cloud-based data environment using Azure, Databricks, and Lakehouse architecture principles.You'll be working within a growing data function, helping to design and deliver scalable, production-grade data solutions that underpin reporting and analytics across the business. This role will suit someone who enjoys taking ownership, working closely with stakeholders, and translating business requirements into robust data engineering solutions. What you'll be doing: Design, build and optimise data pipelines using Azure Data Factory, Databricks, Python and SQL Work within a Lakehouse/Medallion architecture framework Develop and maintain data models and structures to support...

Senior Data Engineer - Azure Central government | Outside IR35 | Remote | 6 months + SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets. You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial. Requirements: Strong commercial experience delivering data engineering solutions in Azure. Strong hands-on experience working with...

Data Engineer - Contract - Outside IR35 - Wembley Hybrid This position will focus on improving and maturing the existing data platform, developing scalable data structures and pipelines, and supporting the wider business in maximising the value of its data. The environment has been established within Microsoft Fabric for several years, however there remains significant opportunity to improve data warehousing structures, data modelling, governance and reporting capabilities. The successful candidate will work across the full data lifecycle, from ingestion and transformation through to reporting and security, while collaborating closely with Data Analysts and business stakeholders. This is a hands-on role suited to someone who enjoys building practical, maintainable solutions and can balance strong technical capability with a business-focused approach. Key Responsibilities Design, develop and maintain data pipelines within Microsoft Fabric. Build and enhance...

Senior Data Engineer - Contract (outside IR35) - up to £550 per day We’re hiring a Senior Data Engineer to join a leading global organisation, helping to build and enhance a modern data platform within the insurance sector. NB London Market Insurance experience is essential. If you do not have this experience, you will not be eligible for this role. The role You’ll design and develop data pipelines using ETL/ELT, ensuring strong standards in testing, reconciliation, and documentation. You’ll contribute to data modelling, support data delivery, and build APIs/services for stakeholders. You’ll also collaborate across teams, promote best practices, and mentor junior colleagues in an Agile environment. Key requirements London Market Insurance experience (must-have) Advanced T-SQL, SSIS, Azure Data Factory Power BI/SSRS, MDX/DAX Strong data modelling Experience with Azure & on-prem SQL Azure DevOps, data APIs, solid documentation/testing practices...

Data Engineer £550-600/day outside IR35 6-month contract Remote working Working with a FTSE 100 client who have a requirement for a hands-on Senior Data Engineer. The role will be involved in designing and delivering data models, integrations, orchestration pipelines, rule engines and contributing to the platform/infrastructure - MUST have Terraform experience. Data Engineer, key skills: MUST have experience using Terraform to build and manage IAC Proven experience with AWS (E.g S3, Lambda, Glue etc) Background in building data pipelines, integrations and transformation layers Strong hands-on SQL experience Data modelling Data quality rules and validation frameworks Snowflake is massively desirable Data Engineer, AWS, Terraform, Snowflake Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and...

Data Engineer £550-600/day outside IR35 6-month contract Remote working Working with a FTSE 100 client who have a requirement for a hands-on Senior Data Engineer. The role will be involved in designing and delivering data models, integrations, orchestration pipelines, rule engines and contributing to the platform/infrastructure - MUST have Terraform experience. Data Engineer, key skills: MUST have experience using Terraform to build and manage IAC Proven experience with AWS (eg S3, Lambda, Glue etc) Background in building data pipelines, integrations and transformation layers Strong hands-on SQL experience Data modelling Data quality rules and validation frameworks Snowflake is massively desirable Data Engineer, AWS, Terraform, Snowflake Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and...

Data Engineer £550-600/day outside IR35 6-month contract Remote working Working with a FTSE 100 client who have a requirement for a hands-on Senior Data Engineer. The role will be involved in designing and delivering data models, integrations, orchestration pipelines, rule engines and contributing to the platform/infrastructure - MUST have Terraform experience. Data Engineer, key skills: MUST have experience using Terraform to build and manage IAC Proven experience with AWS (E.g S3, Lambda, Glue etc) Background in building data pipelines, integrations and transformation layers Strong hands-on SQL experience Data modelling Data quality rules and validation frameworks Snowflake is massively desirable Data Engineer, AWS, Terraform, Snowflake Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have...

Senior Software Engineer - Devon Senior Software Engineer - Devon - Outside IR35 - Our client is looking for an experienced Senior Software Developer for a short-term consultancy role with strong Angular and Authentication Specialisation (MSAL). The role will involve the final implementation of the project, including documentation and Automation Flow. If you have the following, please forward your CV:- Angular MSAL - SSO Azure AD Authentication knowledge Strong Development and Implementation knowledge Due to the volume of applications received for positions, it will not be possible to respond to all applications and only applicants who are considered suitable for interview will be contacted. Proactive Appointments Limited operates as an employment agency and employment business and is an equal opportunities organisation We take our obligations to protect your personal data very seriously. Any information provided to us will be processed as detailed in our Privacy...