35 senior data engineer jobs found in London

Senior Data Engineer - Outside IR35 - Contract (Insurance Client) About the role Softwire is seeking an experienced Data Engineer with a strong knowledge of Python (including PySpark) and SQL, and a good understanding of software engineering best practices (including SDLC, CI/CD, automated testing, DevOps) to join an established small team working on delivering a data & analytics platform in Microsoft Fabric for a speciality insurance provider. This is a senior, hands-on role that will require owning and delivering workstreams independently while supporting a junior team member. Key Responsibilities Building new ingestion pipelines in Microsoft Fabric using Python (PySpark) notebooks Modelling data for consumption in Power BI through a dimensional gold warehouse layer and a semantic model Improving platform performance Working across cross-functional areas such as logging, monitoring (with Azure Log Analytics and Fabric) and data governance (within...

Databricks Platform Buildout Senior Data Engineer Outside IR35 Fully Remote £500 - £575 per day Overview & Objective We are seeking 3x Senior Data Engineers for a Databricks Platform Buildout project which is part of a bigger engagement. The main project focus is to review the group-level Databricks platform foundations to confirm readiness for replication and then rollout across country-level platforms. These Engineers will participate in the rollout and replication phase. Requirements 4+ Years Data Engineering Experience, 5+ years of consulting experience Minimum 2-3 projects delivered with hands-on experience in Databricks Experience in Spark and/or Hadoop, Familiarity with Databricks multi-hop pipeline architecture Technical Stack and Required Capabilities Python, SQL Strong Databricks knowledge (PySpark, SQL, Delta Lake, Unity Catalog) Azure ETL/ELT development and data pipeline orchestration (eg, Databricks Workflows,...

Senior Data Engineer / GCP / Looker / Big Query £500 - 550 per day (Outside IR35) London / Hybrid (1 day a week) This is an opportunity for you to join a rapidly growing ecommerce business who are looking for a Senior Data Engineer. This role is ideal for someone who has built and operated modern data platforms natively within GCP and can take ownership of the full data engineering lifecycle, from ingestion and transformation through to semantic modelling and reporting enablement. You must have experience in designing, building and optimising scalable data pipelines within the GCP ecosystem. You must also have experience working with Looker as this role with be integral between the commercial and BI teams. Key Requirements: Expert experience across the Google Cloud Platform ecosystem Hands-on experience with BigQuery, including optimisation, modelling and performance tuning Proven experience building scalable data pipelines within GCP Strong knowledge of...

Senior Data Engineer/GCP/Looker/Big Query £500 - 550 per day (Outside IR35) London/Hybrid Senior Data Engineer/GCP/Looker/Big Query This is an opportunity for you to join a rapidly growing E-commerce business who are looking for a Senior Data Engineer to build and maintain data pipelines for a new reporting solution within the business. You'll be responsible for the build across ingestion, modelling and creating semantic layers using their GCP stack. Successful applicants will have experience with: Looker BigQuery GCP Gemini Exceptional candidates would have worked with: Retail Data If you're interested in the role please apply to be considered. London/Hybrid £500 - 550 per day (Outside IR35) Senior Data Engineer/GCP/Looker/Big Query

Senior Data Engineer | Hybrid | Outside IR35 | £475 - £525 | London We are looking for a Senior Data Engineer to join a leading organisation on a contract basis. This role will suit someone with strong experience across the Azure data platform , particularly Databricks and PySpark , who can take ownership of data engineering delivery from design through to implementation. This is a hybrid role requiring the candidate to be on site 2 days per month. You will be working on building and enhancing modern data platforms, delivering scalable data pipelines, and supporting high-volume data processing in a cloud environment. Key Responsibilities Design and build scalable data pipelines using Azure technologies Develop and optimise solutions in Databricks using PySpark Work with large and complex datasets, including streaming and batch data Build and maintain data platforms and data warehouses Implement ETL/ELT processes and data...

Senior Data Engineer / GCP / Looker / Big Query £500 - 550 per day (Outside IR35) London / Hybrid Senior Data Engineer / GCP / Looker / Big Query This is an opportunity for you to join a rapidly growing ecommerce business who are looking for a Senior Data Engineer to build and maintain data pipelines for a new reporting solution within the business. You'll be responsible for the build across ingestion, modelling and creating semantic layers using their GCP stack. Successful applicants will have experience with: Looker BigQuery GCP Gemini Exceptional candidates would have worked with: Retail Data If you're interested in the role please apply to be considered. London / Hybrid £500 - 550 per day (Outside IR35) Senior Data Engineer / GCP / Looker / Big Query

Senior Data Engineer Contract Role Outside IR35 | £525-550/day | Milton Keynes | Hybrid | Initial 5 Months We have a new Senior Data Engineer contract opportunity with a global leading client with offices in Milton Keynes. You'll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, requires 1 day per week on-site, and offers an initial 5-month contract with an immediate start and strong potential for extension on a greenfield project. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices. Migrate and transform data into a Databricks Lakehouse architecture. Ensure data quality, reliability, and scalability for analytics and reporting. Collaborate with stakeholders to deliver robust solutions aligned with business needs. Support production environments and...

AI Transformation Lead (Data Centre Engineering) Open day rate - Outside IR35 - negotiable London - Hybrid We’re working with a data center construction business backed by long-term capital, looking to embed AI into the core of how they design, engineer, and deliver projects .This is not experimentation. This is about applying AI to real engineering workflows that already exist at scale. Their teams are some of the strongest engineering profiles in the market, working across CAD, BIM, and GIS environments. The opportunity is to fundamentally change how those teams operate. The role This is a senior, standalone hire reporting directly into the Managing Partner. You will define and lead how AI is introduced into the engineering lifecycle. Embed AI into CAD, BIM, and GIS driven workflows Identify and prioritise practical use cases across design, engineering, and delivery Reduce design time, error rates, and rework across projects Translate AI capability into...

We're partnering with a leading energy trading organisation at the forefront of global commodities markets, currently investing heavily in their ETRM platform. As part of this growth, they're looking for an experienced Java Developer to join a high-performing engineering team delivering scalable, front-to-back trading solutions. This is a standout opportunity for a strong Java engineer with energy trading exposure who is keen to step into the world of Endur ETRM and OpenComponents, gaining highly sought-after domain and platform expertise  The Opportunity You'll work on business-critical systems that support trading, risk, and operations across power, gas, and wider commodities markets. The role blends core Java engineering with the chance to quickly upskill in Endur, supported by a team of experienced SMEs. This is ideal for someone looking to bridge the gap between pure software engineering and specialist ETRM platforms Responsibilities Designing and...

Postgres Data Engineer - Outside IR35/Remote We are looking for 3 to 4 Postgres data engineers from junior to senior level. You will have the following experience: - Good proficiency of SQL - Working experience on PostgreSQL - Experience in data analysis and data transformation - Experience in data remediations and data fix in production environment - Maintain highly scalable PostgreSQL and SQL database solutions. - Build, and Profile and optimize complex SQL queries, views, indexes, and stored procedures - Deliver robust ETL/ELT data pipelines to ingest, transform, and load data This will be on a 3 month contract (outside IR35) and is based remotely. Candidates need to be based in the UK. To be considered please send over your latest CV. LA International is an award-winning partner of choice for many of the world's most influential companies and government organisations. Holding Enhanced Government Security Accreditation, we are recognised as the European market...

Role: AI Engineer - Contract Role Seniority: Consultant - Senior Manager Day rate: Negotiable and outside IR35 Project duration: 4-6 months (3-4 days per week) Location: Hybrid in London We’re supporting a consultancy that specialises in growth and go-to-market transformation, known for fostering strong relationships while designing and delivering large-scale improvements worldwide. You'll have the opportunity build an AI capability from the ground up, designing agentic workflows that embed sales methodology into the tools teams use every day (Salesforce and Microsoft 365). You’ll work closely with GTM leadership and senior stakeholders, gaining exposure to commercial strategy while driving practical behaviour change. We’ve a preference for you to apply directly via the Project Blackbook website as the consultancy will eventually view your profile in our platform. If you are already in the community, feel free to quickly apply here or reach out to your...

AI Engineer | Hybrid | London | Outside IR35 | 6 + Months Cititec are working with a global financial markets organisation on a large scale data and platform transformation. They are looking for a Senior AI Engineer to help accelerate the migration of a complex data estate from Oracle to a Microsoft centric architecture across Azure, Cosmos DB, Microsoft Fabric and Azure Data Factory. The role will focus on applying AI and GenAI to improve developer productivity and engineering throughput, particularly across data migration, code generation and developer tooling. This includes deploying AI agents and AI assisted development tools within the Azure ecosystem. This is a high impact role operating across a large engineering environment, helping scale modern engineering practices and AI enabled development across a significant developer base.

Platform Engineer | Trading Firm Central London | 3 days on site Outside IR35 | Up to £650 per day A trading firm in central London has rolled out a business wide data platform and now needs a senior Platform Engineer to take full control of the platform layer. Kubernetes is the heart of this environment and they need someone who can run it with confidence, precision and zero drama. What they need you to bring Serious Kubernetes depth covering cluster design, workload orchestration, autoscaling strategies, multi cluster operations, network policy, resource tuning and deep debugging across pods, nodes and the control plane Deep Linux fluency with the ability to harden, tune and own production environments from top to bottom Strong SQL engineering skills covering schema design, performance tuning and high throughput optimisation Solid C# background with clean, maintainable service patterns Ability to design, build and refine CI/CD...

Senior Software Engineer - AI-Assisted Legacy Medernisation Outside IR35 - Contract (Insurance Client) About the role Softwire is helping our client modernise a business-critical legacy platform, moving it off Oracle Forms and onto a modern React and .NET stack, with the underlying Oracle database migrating to Azure SQL. We're looking for a strong full-stack contract developer to join the existing team and drive this migration forward. What sets this role apart is that the use of AI tools is the main focus, not a nice-to-have. You'll use tools such as Claude to accelerate the translation of Oracle Forms logic into the new stack and to support the database migration. We want someone who already works this way day to day and can show how AI changes the pace and quality of their delivery. Key Responsibilities Work alongside our team to migrate the legacy product onto a React / .NET architecture, keeping pace with the team's Jira workflow. Use AI tools...

Senior Software Engineer - Outside IR35 - Contract (Energy Client) About the role Softwire is looking for an experienced Software Engineer to join a team delivering the first phase of a major replatforming project. You will work in a collaborative, technically focused environment, helping to modernise a data platform that currently relies on Power Automate, Power BI, and Python scripts. You can work remotely from anywhere in the UK, as client site visits aren't mandatory. Phase one of the project will introduce a SQL database and Azure Function Apps, alongside a migration of data from SharePoint into the new database. This is a hands-on engineering role with real impact from day one. Key Responsibilities Design and build Azure Function Apps to support the replatforming initiative. Develop and maintain SQL database schemas, queries, and data pipelines. Contribute to the migration of data from SharePoint into the new database. Work with existing Power...

Senior Analytics Engineer – Urgent Contract Role (Looker + BigQuery) Outside IR35 | £525–£550/day | Hybrid in London | Initial 3 months | ASAP start We’re supporting a client building a new Retail Reporting solution on GCP, covering ingestion, modelling, and semantic layers. This is a hands‑on role leading the technical build across BigQuery, Dataform, and Looker, working with diverse retail datasets and a fast‑moving commercial team. You’ll own the delivery of robust data pipelines, scalable retail data models, and optimised Looker‑ready structures. You must be available within the next 2 weeks and 1-2 Central London office days will be required. Key Responsibilities Integrate and configure multiple retail data sources into GCP. Build and maintain Dataform pipelines across raw, staging, and gold layers. Develop unified sales, inventory, and shipping models in BigQuery. Implement key retail logic: on‑hand vs on‑order, Weeks of Supply, and calendar...

Senior Analytics Engineer - Urgent Contract Role (Looker + BigQuery) Outside IR35 | £525-£550/day | Hybrid in London | Initial 3 months | ASAP start We're supporting a client building a new Retail Reporting solution on GCP, covering ingestion, modelling, and semantic layers. This is a hands-on role leading the technical build across BigQuery, Dataform, and Looker, working with diverse retail datasets and a fast-moving commercial team. You'll own the delivery of robust data pipelines, scalable retail data models, and optimised Looker-ready structures. You must be available within the next 2 weeks and 1-2 Central London office days will be required. Key Responsibilities Integrate and configure multiple retail data sources into GCP. Build and maintain Dataform pipelines across raw, staging, and gold layers. Develop unified sales, inventory, and shipping models in BigQuery. Implement key retail logic: on-hand vs on-order, Weeks of Supply, and calendar alignment. Optimise...

Senior AI Engineer - Agentic Platforms - AWS/.Net/React - Polyglot £800-900/day | Outside IR35 | Remote (UK) | Initial 6 months Our client are looking build out their next-generation AI capability, focused on developing an autonomous agent platform that will sit at the core of their product offering. They're looking to bring in two Senior AI Engineers to take a hands-on role in designing and delivering production-ready, agentic systems - this is not research or POC work, it's about building scalable, real-world AI solutions that integrate directly into a live platform. The focus of the role is on developing intelligent, self-learning workflows, multi-agent systems, and AI-driven automation that supports real estate professionals in managing leads, workflows, and customer interactions. You'll be working closely with Product, Architecture, and Data teams to define and build the underlying platform, with a strong emphasis on engineering quality, scalability, and commercial...

AI Voice Engineer (Contract) Fully Remote £300- £560 Per Day Outside IR35 Immediate Start 3 Months Initially The Company They are a well-established organisation operating within a regulated environment, focused on delivering better outcomes for their customers through technology. As part of a wider AI transformation programme, they have already seen strong success with voice AI solutions internationally and are now expanding these capabilities into the UK. The business is investing heavily in AI, with clear backing from senior leadership and a strong appetite for innovation. You will join a collaborative data and AI function with a focus on practical, scalable solutions. The Role and Deliverables Design, build and optimise AI-powered voice agents for real-world customer interactions Develop and integrate voice pipelines using leading speech and conversational AI technologies Build robust Python-based services to support...

Senior Software Engineer - Outside IR35 - Contract (Insurance) About the role Essential: Self-starter, someone who can pick up context quickly, drive outcomes efficiently, and to a high quality Competent in doing high-level designs, solution management, and scoping Understanding of data modelling best practices Ability to translate technical solutions to non-technical stakeholders and bring them on the journey Experience working in an agile delivery environment Experience working with React, TypeScript, Azure, Microsoft SQL, and Databricks (if they don’t have all of these, that’s workable, but be good to understand any they don’t have experience with) Frontend: React + TypeScript + Vite Material UI with Emotion for styling TanStack React Query 5 for server state React Router 7 React Hook Form+Yup for forms/validation MSAL for Entra ID auth Jest+Testing Library for unit tests; Playwrightfor E2E and visual tests Hosted as an Azure Static...