18 senior data engineer jobs found in London

Senior Data Engineer - Outside IR35 - Contract (Insurance Client) About the role Softwire is seeking an experienced Data Engineer with a strong knowledge of Python (including PySpark) and SQL, and a good understanding of software engineering best practices (including SDLC, CI/CD, automated testing, DevOps) to join an established small team working on delivering a data & analytics platform in Microsoft Fabric for a speciality insurance provider. This is a senior, hands-on role that will require owning and delivering workstreams independently while supporting a junior team member. Key Responsibilities Building new ingestion pipelines in Microsoft Fabric using Python (PySpark) notebooks Modelling data for consumption in Power BI through a dimensional gold warehouse layer and a semantic model Improving platform performance Working across cross-functional areas such as logging, monitoring (with Azure Log Analytics and Fabric) and data governance (within...

Databricks Platform Buildout Senior Data Engineer Outside IR35 Fully Remote £500 - £575 per day Overview & Objective We are seeking 3x Senior Data Engineers for a Databricks Platform Buildout project which is part of a bigger engagement. The main project focus is to review the group-level Databricks platform foundations to confirm readiness for replication and then rollout across country-level platforms. These Engineers will participate in the rollout and replication phase. Requirements 4+ Years Data Engineering Experience, 5+ years of consulting experience Minimum 2-3 projects delivered with hands-on experience in Databricks Experience in Spark and/or Hadoop, Familiarity with Databricks multi-hop pipeline architecture Technical Stack and Required Capabilities Python, SQL Strong Databricks knowledge (PySpark, SQL, Delta Lake, Unity Catalog) Azure ETL/ELT development and data pipeline orchestration (eg, Databricks Workflows,...

Senior Data Engineer / GCP / Looker / Big Query £500 - 550 per day (Outside IR35) London / Hybrid (1 day a week) This is an opportunity for you to join a rapidly growing ecommerce business who are looking for a Senior Data Engineer. This role is ideal for someone who has built and operated modern data platforms natively within GCP and can take ownership of the full data engineering lifecycle, from ingestion and transformation through to semantic modelling and reporting enablement. You must have experience in designing, building and optimising scalable data pipelines within the GCP ecosystem. You must also have experience working with Looker as this role with be integral between the commercial and BI teams. Key Requirements: Expert experience across the Google Cloud Platform ecosystem Hands-on experience with BigQuery, including optimisation, modelling and performance tuning Proven experience building scalable data pipelines within GCP Strong knowledge of...

Senior Data Engineer/GCP/Looker/Big Query £500 - 550 per day (Outside IR35) London/Hybrid Senior Data Engineer/GCP/Looker/Big Query This is an opportunity for you to join a rapidly growing E-commerce business who are looking for a Senior Data Engineer to build and maintain data pipelines for a new reporting solution within the business. You'll be responsible for the build across ingestion, modelling and creating semantic layers using their GCP stack. Successful applicants will have experience with: Looker BigQuery GCP Gemini Exceptional candidates would have worked with: Retail Data If you're interested in the role please apply to be considered. London/Hybrid £500 - 550 per day (Outside IR35) Senior Data Engineer/GCP/Looker/Big Query

Senior Data Engineer | Hybrid | Outside IR35 | £475 - £525 | London We are looking for a Senior Data Engineer to join a leading organisation on a contract basis. This role will suit someone with strong experience across the Azure data platform , particularly Databricks and PySpark , who can take ownership of data engineering delivery from design through to implementation. This is a hybrid role requiring the candidate to be on site 2 days per month. You will be working on building and enhancing modern data platforms, delivering scalable data pipelines, and supporting high-volume data processing in a cloud environment. Key Responsibilities Design and build scalable data pipelines using Azure technologies Develop and optimise solutions in Databricks using PySpark Work with large and complex datasets, including streaming and batch data Build and maintain data platforms and data warehouses Implement ETL/ELT processes and data...

Senior Data Engineer / GCP / Looker / Big Query £500 - 550 per day (Outside IR35) London / Hybrid Senior Data Engineer / GCP / Looker / Big Query This is an opportunity for you to join a rapidly growing ecommerce business who are looking for a Senior Data Engineer to build and maintain data pipelines for a new reporting solution within the business. You'll be responsible for the build across ingestion, modelling and creating semantic layers using their GCP stack. Successful applicants will have experience with: Looker BigQuery GCP Gemini Exceptional candidates would have worked with: Retail Data If you're interested in the role please apply to be considered. London / Hybrid £500 - 550 per day (Outside IR35) Senior Data Engineer / GCP / Looker / Big Query

Senior Data Engineer Contract Role Outside IR35 | £525-550/day | Milton Keynes | Hybrid | Initial 5 Months We have a new Senior Data Engineer contract opportunity with a global leading client with offices in Milton Keynes. You'll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, requires 1 day per week on-site, and offers an initial 5-month contract with an immediate start and strong potential for extension on a greenfield project. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices. Migrate and transform data into a Databricks Lakehouse architecture. Ensure data quality, reliability, and scalability for analytics and reporting. Collaborate with stakeholders to deliver robust solutions aligned with business needs. Support production environments and...

Senior Software Engineer - AI-Assisted Legacy Medernisation Outside IR35 - Contract (Insurance Client) About the role Softwire is helping our client modernise a business-critical legacy platform, moving it off Oracle Forms and onto a modern React and .NET stack, with the underlying Oracle database migrating to Azure SQL. We're looking for a strong full-stack contract developer to join the existing team and drive this migration forward. What sets this role apart is that the use of AI tools is the main focus, not a nice-to-have. You'll use tools such as Claude to accelerate the translation of Oracle Forms logic into the new stack and to support the database migration. We want someone who already works this way day to day and can show how AI changes the pace and quality of their delivery. Key Responsibilities Work alongside our team to migrate the legacy product onto a React / .NET architecture, keeping pace with the team's Jira workflow. Use AI tools...

Senior Software Engineer - Outside IR35 - Contract (Energy Client) About the role Softwire is looking for an experienced Software Engineer to join a team delivering the first phase of a major replatforming project. You will work in a collaborative, technically focused environment, helping to modernise a data platform that currently relies on Power Automate, Power BI, and Python scripts. You can work remotely from anywhere in the UK, as client site visits aren't mandatory. Phase one of the project will introduce a SQL database and Azure Function Apps, alongside a migration of data from SharePoint into the new database. This is a hands-on engineering role with real impact from day one. Key Responsibilities Design and build Azure Function Apps to support the replatforming initiative. Develop and maintain SQL database schemas, queries, and data pipelines. Contribute to the migration of data from SharePoint into the new database. Work with existing Power...

Senior Analytics Engineer – Urgent Contract Role (Looker + BigQuery) Outside IR35 | £525–£550/day | Hybrid in London | Initial 3 months | ASAP start We’re supporting a client building a new Retail Reporting solution on GCP, covering ingestion, modelling, and semantic layers. This is a hands‑on role leading the technical build across BigQuery, Dataform, and Looker, working with diverse retail datasets and a fast‑moving commercial team. You’ll own the delivery of robust data pipelines, scalable retail data models, and optimised Looker‑ready structures. You must be available within the next 2 weeks and 1-2 Central London office days will be required. Key Responsibilities Integrate and configure multiple retail data sources into GCP. Build and maintain Dataform pipelines across raw, staging, and gold layers. Develop unified sales, inventory, and shipping models in BigQuery. Implement key retail logic: on‑hand vs on‑order, Weeks of Supply, and calendar...

Senior Analytics Engineer - Urgent Contract Role (Looker + BigQuery) Outside IR35 | £525-£550/day | Hybrid in London | Initial 3 months | ASAP start We're supporting a client building a new Retail Reporting solution on GCP, covering ingestion, modelling, and semantic layers. This is a hands-on role leading the technical build across BigQuery, Dataform, and Looker, working with diverse retail datasets and a fast-moving commercial team. You'll own the delivery of robust data pipelines, scalable retail data models, and optimised Looker-ready structures. You must be available within the next 2 weeks and 1-2 Central London office days will be required. Key Responsibilities Integrate and configure multiple retail data sources into GCP. Build and maintain Dataform pipelines across raw, staging, and gold layers. Develop unified sales, inventory, and shipping models in BigQuery. Implement key retail logic: on-hand vs on-order, Weeks of Supply, and calendar alignment. Optimise...

AI Voice Engineer (Contract) Fully Remote £300- £560 Per Day Outside IR35 Immediate Start 3 Months Initially The Company They are a well-established organisation operating within a regulated environment, focused on delivering better outcomes for their customers through technology. As part of a wider AI transformation programme, they have already seen strong success with voice AI solutions internationally and are now expanding these capabilities into the UK. The business is investing heavily in AI, with clear backing from senior leadership and a strong appetite for innovation. You will join a collaborative data and AI function with a focus on practical, scalable solutions. The Role and Deliverables Design, build and optimise AI-powered voice agents for real-world customer interactions Develop and integrate voice pipelines using leading speech and conversational AI technologies Build robust Python-based services to support...

Senior Software Engineer - Outside IR35 - Contract (Insurance) About the role Essential: Self-starter, someone who can pick up context quickly, drive outcomes efficiently, and to a high quality Competent in doing high-level designs, solution management, and scoping Understanding of data modelling best practices Ability to translate technical solutions to non-technical stakeholders and bring them on the journey Experience working in an agile delivery environment Experience working with React, TypeScript, Azure, Microsoft SQL, and Databricks (if they don’t have all of these, that’s workable, but be good to understand any they don’t have experience with) Frontend: React + TypeScript + Vite Material UI with Emotion for styling TanStack React Query 5 for server state React Router 7 React Hook Form+Yup for forms/validation MSAL for Entra ID auth Jest+Testing Library for unit tests; Playwrightfor E2E and visual tests Hosted as an Azure Static...

Senior Voice AI Engineer - Contract (Outside IR35) | £350-500/day | 3-4 months | Remote We 're looking for a hands-on engineer to take an existing voice AI proof-of-concept and turn it into a reliable, production-grade system ready for real users. The prototype works - but it now needs to be made fast, stable, scalable, and cost-efficient. What you 'll be doing: - Productionising a voice AI system from an existing PoC - Working with voice platforms such as ElevenLabs / Deepgram (or similar) - Improving real-time performance and reducing latency - Designing lightweight orchestration (simple, deterministic flows over complex prompt chains) - Integrating customer/internal data using RAG approaches - Optimising cost, reliability, and system efficiency - Building and maintaining API/SDK-based voice pipelines - Supporting secure handling of sensitive/PII data What we 're looking for: - Strong experience building voice AI or real-time speech systems - Hands-on...

Contract Full Stack / Backend Engineer III - Trust & Safety Platforms Duration: 6-Month Contract (with potential for extension) Location: 100% Remote (UK-based) Inside/Outside IR35: Insert IR35 The Opportunity We are looking for a Senior Full Stack / Backend Engineer (Level III) to join the Trust & Safety / Policy Platform team for one of the world's leading, household-name audio streaming platforms. If you are a backend-heavy engineer who enjoys the autonomy of building robust APIs and crafting the internal web tools that power them, this contract is for you. What You'll Do Engineers at Scale: Build and scale the core APIs and services that expose complex policy logic across detection, enforcement, and compliance surfaces. Data & ML Pipelines: Model data for strict auditability, versioning, and efficient querying, feeding structured datasets directly into downstream machine learning models. Empower Internal Teams: Design and implement intuitive,...

Android Developer/Mobile Developer with Kotlin/Jetpack Compose. 90% REMOTE. £450-£500/DAY OUTSIDE IR35 PAY. 3 MONTH CONTRACT INITIALLY. Our Government client seeks a dynamic and technically astute Android Developer with 7 years minimum Mobile (Android Development) experience. THE IDEAL CANDIDATE WILL HAVE THE ABILITY TO BECOME SC CLEARED DUE TO GOVERNMENT SENSITIVE DATA. We are expanding our Mobile Development team and looking for talented Android Developer who are passionate about building high-quality mobile applications. If you enjoy solving complex problems, working with modern technologies, and contributing to a collaborative engineering culture, this is an opportunity to make a real impact. About the Role As a Mobile Developer, you will play a key role in designing, building, and maintaining advanced Android applications used by thousands of users. You'll work closely with product managers, designers, Back End engineers, and QA to deliver features that are...

Cloud Security Engineer (GCP / IAM / Encryption) - Contract Rate: £600 day Outside IR35 Location: London - hybrid (3 days onsite) - Non negotable Duration: 12 month Clearance: Active SC, willingness for DV Overview Join a high-impact programme delivering secure, large-scale cloud infrastructure within a UK government environment. You'll help design and secure a private/distributed cloud platform supporting critical national services. Key Responsibilities Design & implement secure workloads in Google Distributed Cloud (GDC) / GCP (GDC experience not necessarily needed but would be strongly desired) Build and manage IAM architectures (SSO, MFA, privileged access lifecycle) Enforce least privilege via resource hierarchies, policies, and constraints Configure network security controls (firewalls, WAF, service perimeters) Deliver data protection & encryption (KMS, CMEK/EKM, sensitive data handling) Secure CI/CD pipelines with vulnerability scanning and...

Cloud Security Engineer (GCP/IAM/Encryption) - Contract Rate: £600 day Outside IR35 Location: London - hybrid (3 days onsite) - Non negotable Duration: 12 month Clearance: Active SC, willingness for DV Overview Join a high-impact programme delivering secure, large-scale cloud infrastructure within a UK government environment. You'll help design and secure a private/distributed cloud platform supporting critical national services. Key Responsibilities Design & implement secure workloads in Google Distributed Cloud (GDC)/GCP (GDC experience not necessarily needed but would be strongly desired) Build and manage IAM architectures (SSO, MFA, privileged access life cycle) Enforce least privilege via resource hierarchies, policies, and constraints Configure network security controls (Firewalls, WAF, service perimeters) Deliver data protection & encryption (KMS, CMEK/EKM, sensitive data handling) Secure CI/CD pipelines with vulnerability scanning and policy...