7 senior data engineer jobs found in London

Senior Data Engineer - Outside IR35 - Contract (Insurance Client) About the role Softwire is seeking an experienced Data Engineer with a strong knowledge of Python (including PySpark) and SQL, and a good understanding of software engineering best practices (including SDLC, CI/CD, automated testing, DevOps) to join an established small team working on delivering a data & analytics platform in Microsoft Fabric for a speciality insurance provider. This is a senior, hands-on role that will require owning and delivering workstreams independently while supporting a junior team member. Key Responsibilities Building new ingestion pipelines in Microsoft Fabric using Python (PySpark) notebooks Modelling data for consumption in Power BI through a dimensional gold warehouse layer and a semantic model Improving platform performance Working across cross-functional areas such as logging, monitoring (with Azure Log Analytics and Fabric) and data governance (within...

Databricks Platform Buildout Senior Data Engineer Outside IR35 Fully Remote £500 - £575 per day Overview & Objective We are seeking 3x Senior Data Engineers for a Databricks Platform Buildout project which is part of a bigger engagement. The main project focus is to review the group-level Databricks platform foundations to confirm readiness for replication and then rollout across country-level platforms. These Engineers will participate in the rollout and replication phase. Requirements 4+ Years Data Engineering Experience, 5+ years of consulting experience Minimum 2-3 projects delivered with hands-on experience in Databricks Experience in Spark and/or Hadoop, Familiarity with Databricks multi-hop pipeline architecture Technical Stack and Required Capabilities Python, SQL Strong Databricks knowledge (PySpark, SQL, Delta Lake, Unity Catalog) Azure ETL/ELT development and data pipeline orchestration (eg, Databricks Workflows,...

Senior Software Engineer - AI-Assisted Legacy Medernisation Outside IR35 - Contract (Insurance Client) About the role Softwire is helping our client modernise a business-critical legacy platform, moving it off Oracle Forms and onto a modern React and .NET stack, with the underlying Oracle database migrating to Azure SQL. We're looking for a strong full-stack contract developer to join the existing team and drive this migration forward. What sets this role apart is that the use of AI tools is the main focus, not a nice-to-have. You'll use tools such as Claude to accelerate the translation of Oracle Forms logic into the new stack and to support the database migration. We want someone who already works this way day to day and can show how AI changes the pace and quality of their delivery. Key Responsibilities Work alongside our team to migrate the legacy product onto a React / .NET architecture, keeping pace with the team's Jira workflow. Use AI tools...

Senior Software Engineer - Outside IR35 - Contract (Insurance) About the role Essential: Self-starter, someone who can pick up context quickly, drive outcomes efficiently, and to a high quality Competent in doing high-level designs, solution management, and scoping Understanding of data modelling best practices Ability to translate technical solutions to non-technical stakeholders and bring them on the journey Experience working in an agile delivery environment Experience working with React, TypeScript, Azure, Microsoft SQL, and Databricks (if they don’t have all of these, that’s workable, but be good to understand any they don’t have experience with) Frontend: React + TypeScript + Vite Material UI with Emotion for styling TanStack React Query 5 for server state React Router 7 React Hook Form+Yup for forms/validation MSAL for Entra ID auth Jest+Testing Library for unit tests; Playwrightfor E2E and visual tests Hosted as an Azure Static...

Contract Full Stack / Backend Engineer III - Trust & Safety Platforms Duration: 6-Month Contract (with potential for extension) Location: 100% Remote (UK-based) Inside/Outside IR35: Insert IR35 The Opportunity We are looking for a Senior Full Stack / Backend Engineer (Level III) to join the Trust & Safety / Policy Platform team for one of the world's leading, household-name audio streaming platforms. If you are a backend-heavy engineer who enjoys the autonomy of building robust APIs and crafting the internal web tools that power them, this contract is for you. What You'll Do Engineers at Scale: Build and scale the core APIs and services that expose complex policy logic across detection, enforcement, and compliance surfaces. Data & ML Pipelines: Model data for strict auditability, versioning, and efficient querying, feeding structured datasets directly into downstream machine learning models. Empower Internal Teams: Design and implement intuitive,...

Cloud Security Engineer (GCP / IAM / Encryption) - Contract Rate: £600 day Outside IR35 Location: London - hybrid (3 days onsite) - Non negotable Duration: 12 month Clearance: Active SC, willingness for DV Overview Join a high-impact programme delivering secure, large-scale cloud infrastructure within a UK government environment. You'll help design and secure a private/distributed cloud platform supporting critical national services. Key Responsibilities Design & implement secure workloads in Google Distributed Cloud (GDC) / GCP (GDC experience not necessarily needed but would be strongly desired) Build and manage IAM architectures (SSO, MFA, privileged access lifecycle) Enforce least privilege via resource hierarchies, policies, and constraints Configure network security controls (firewalls, WAF, service perimeters) Deliver data protection & encryption (KMS, CMEK/EKM, sensitive data handling) Secure CI/CD pipelines with vulnerability scanning and...

Cloud Security Engineer (GCP/IAM/Encryption) - Contract Rate: £600 day Outside IR35 Location: London - hybrid (3 days onsite) - Non negotable Duration: 12 month Clearance: Active SC, willingness for DV Overview Join a high-impact programme delivering secure, large-scale cloud infrastructure within a UK government environment. You'll help design and secure a private/distributed cloud platform supporting critical national services. Key Responsibilities Design & implement secure workloads in Google Distributed Cloud (GDC)/GCP (GDC experience not necessarily needed but would be strongly desired) Build and manage IAM architectures (SSO, MFA, privileged access life cycle) Enforce least privilege via resource hierarchies, policies, and constraints Configure network security controls (Firewalls, WAF, service perimeters) Deliver data protection & encryption (KMS, CMEK/EKM, sensitive data handling) Secure CI/CD pipelines with vulnerability scanning and policy...