36 senior data engineer jobs found in London

Data Engineer - SC Cleared (or Clearable) Location: Remote/London occasional visits to London Rate: £375 Per Day Outside IR35 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You'll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies, collaborate with data architects and scientists, and make a significant impact in a fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and...

Senior Data Engineer - Snowflake & Matillion 3-month contract - potential for extension Immediate Start Outside IR35 £400 - £450pd iO Associates are seeking an experienced Data Engineer to work with one of the best analytics companies in the UK. They have nurtured a fantastic culture, with industry-leading experts in the modern data space and are seeking a Data Engineer. To be considered for this role you need to have extensive experience working as a Data Engineer, particularly with: Matillion Snowflake AWS Python SQL Data Warehousing The role is operating Outside IR35 for an initial 3-month engagement, starting ASAP and paying £400 - £450 per day. As a Senior member of the team, you'll contribute as a thought leader, developing insights and sharing expertise internally and externally while mentoring others and driving innovation across the organisation The client based in the South West of the UK that will require occasional travel to the...

Senior Data Engineer Contract Role Outside IR35 | £500-525/day | Milton Keynes or Manchester | Hybrid | Initial 7 Months We have a new Senior Data Engineer contract opportunity with a global leading client with offices in both Manchester and Milton Keynes. You’ll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, requires 1 day per week on-site, and offers an initial 7-month contract with an immediate start and strong potential for extension on a greenfield project. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices. Migrate and transform data into a Databricks Lakehouse architecture. Ensure data quality, reliability, and scalability for analytics and reporting. Collaborate with stakeholders to deliver robust solutions aligned with...

We're looking for a Senior Security Engineer for our client in the data sector, based in London, on an initial 3 to 6 month contract paying up to £500 per day Outside IR35. This role offers hybrid working with an expectation to attend the office 3 days per week. You will focus on hands-on remediation across Azure and endpoint environments, improving Defender for Cloud findings, closing vulnerabilities, and strengthening security posture. The role is delivery-led and ideal for someone who enjoys fixing issues rather than only advising. The successful Senior Security Engineer will have experience with: Defender for Cloud, Defender for Endpoint and EASM Vulnerability remediation and Secure Score improvement Purview (DLP, sensitivity labels, insider risk) Compliance uplift for ISO 27001, SOC 2, GDPR and NIS2 Configuration hardening, patching and policy deployment Entra ID, Conditional Access, PIM and cloud identity controls...

Contract Description Must speak fluent French Must be available to visit client site in Ivory Coast for 1 week (12th > 16th January ((fully expensed - alongside the Red Badger Team)). Client is a Development Bank 10 week contract   Start date Monday 12th January Discovery / Review website and intranet project - As is > To Be development piece with a roadmap to implementation deliverable Joining a cross functional team of 5 (Engineer / Delivery / Product / UX / Product Design) Immediate interviews Ltd company outside IR35 or Umbrella contract. £Competitive day rate 2 days / week in person working (Old Street / Moorgate)     About Red Badger     Founded in 2010 by Stuart, Cain and David, we help large organisations improve their speed to market whilst focusing on delivering value to their users and customers. We work with our clients to understand their...

Must speak fluent French Must be available to visit client site in Ivory Coast for 1 week (12th > 16th January ((fully expensed - alongside the Red Badger Team)). Client is a Development Bank 10 week contract Start date Monday 12th January Discovery / Review website and intranet project - As is > To Be development piece with a roadmap to implementation deliverable Joining a cross functional team of 5 (Engineer / Delivery / Product / UX / Product Design) Immediate interviews Ltd company outside IR35 or Umbrella contract. £Competitive day rate 2 days / week in person working (Old Street / Moorgate) About Red Badger Founded in 2010 by Stuart, Cain and David, we help large organisations improve their speed to market whilst focusing on delivering value to their users and customers. We work with our clients to understand their problems and validate ideas in order to deliver improved process efficiencies, strategic...

Google Cloud Architect – Contract 6 Months – Outside IR35 £600 per day SC or DV Clearance (UKSV) Required Hybrid: Home + 3 days/week onsite in Central London Are you a Google Cloud specialist with a passion for designing secure, mission-critical systems? We’re looking for a Google Cloud Architect to join a specialist systems integrator delivering into UK Government on a major multi-year transformation programme. This is an opportunity to shape and implement some of the most strategically important government systems in operation today. You’ll architect next-generation platforms that protect national capability — working alongside some of the best engineers in the industry in an environment where innovation, precision and security are paramount. What You’ll Be Doing Designing and delivering secure, scalable and resilient architectures in Google Cloud Platform (GCP) and Google Distributed Cloud (GDC) . Engineering solutions for disconnected...

Platform Engineer | Trading Firm Central London | 3 days on site Outside IR35 | Up to £650 per day A trading firm in central London has rolled out a business wide data platform and now needs a senior Platform Engineer to take full control of the platform layer. Kubernetes is the heart of this environment and they need someone who can run it with confidence, precision and zero drama. What they need you to bring Serious Kubernetes depth covering cluster design, workload orchestration, autoscaling strategies, multi cluster operations, network policy, resource tuning and deep debugging across pods, nodes and the control plane Deep Linux fluency with the ability to harden, tune and own production environments from top to bottom Strong SQL engineering skills covering schema design, performance tuning and high throughput optimisation Solid C# background with clean, maintainable service patterns Ability to design, build and refine CI/CD pipelines that support...

Full job description Must speak fluent French Must be available to visit client site in Ivory Coast for 1 week (12th > 16th January ((fully expensed - alongside the Red Badger Team)). Client is a Development Bank 10 week contract Start date Monday 12th January Discovery / Review website and intranet project - As is > To Be development piece with a roadmap to implementation deliverable Joining a cross functional team of 5 (Engineer / Delivery / Product / UX / Product Design) Immediate interviews Ltd company outside IR35 or Umbrella contract. £Competitive day rate 2 days / week in person working (Old Street / Moorgate)   About Red Badger   Founded in 2010 by Stuart, Cain and David, we help large organisations improve their speed to market whilst focusing on delivering value to their users and customers. We work with our clients to understand their problems and validate...

At Mindera, we craft software with people we love. We’re looking for a Lead backend engineer with a background in Kotlin or Java. Familiarity with Micronaut (or similar frameworks such as Spring Boot). Experience working in Identity teams (authentication, authorisation, SSO/OAuth). Proven track record of leading complex engineering projects. Strong problem-solving and communication skills. Nice to Have: Experience with IAM platforms (Okta, Auth0, Keycloak, ForgeRock). Knowledge of identity/security standards such as OpenID Connect, JWT, SAML, MFA. Cloud platform experience (Azure, AWS, or GCP). Exposure to DevOps practices and CI/CD pipelines. Please note: This is a six month contract that sits outside IR35. You will be required to work in Paddington 3 days a week. What does the role involve? Lead technical deep dives and knowledge sharing in the teams, anticipating challenges and proposing solutions Start influencing product and business decisions...

Business Process Engineer (Customer Journey) Rate - £500 (A day) Duration - 6 months (Initially) Location - London (Hybrid) Ir35 - Outside As a Business Process Engineer, you'll lead the design and optimisation of future-sate processes that underpin the Modernising Redress work. Building on the work of the Business Process Analyst, you'll turn the 'as-is' view into streamlined, efficient, and scalable solutions that deliver better outcomes for customers and colleagues. This is a hands-on role, combining analytical thinking, creativity, creativity and facilitation to shape how we work in the future, ensuring solutions are practical, feasible and culturally aligned so they are successfully adopted and deliver measurable value. what you'll do Analyse the 'as-is' processes and validate where change is genuinely needed, ensuring proposals address root causes and add measurable value. Design and document optimised future-state processes and...

Must speak fluent French Must be available to visit client site in Ivory Coast for 1 week (12th > 16th January ((fully expensed - alongside the Red Badger Team)). Client is a Development Bank 10 week contract Start date Monday 12th January Discovery / Review website and intranet project - As is > To Be development piece with a roadmap to implementation deliverable Joining a cross functional team of 5 (Engineer / Delivery / Product / UX / Product Design) Immediate interviews Ltd company outside IR35 or Umbrella contract. £Competitive day rate 2 days / week in person working (Old Street / Moorgate) About Red Badger Founded in 2010 by Stuart, Cain and David, we help large organisations improve their speed to market whilst focusing on delivering value to their users and customers. We work with our clients to understand their problems and validate ideas in order to deliver improved process efficiencies, strategic...

We’re looking for a Senior Security Engineer for our client in the data sector, based in London, on an initial 3 to 6 month contract paying up to £500 per day Outside IR35. This role offers hybrid working with an expectation to attend the office 3 days per week. You will focus on hands-on remediation across Azure and endpoint environments, improving Defender for Cloud findings, closing vulnerabilities, and strengthening security posture. The role is delivery-led and ideal for someone who enjoys fixing issues rather than only advising. The successful Senior Security Engineer will have experience with: Defender for Cloud, Defender for Endpoint and EASM Vulnerability remediation and Secure Score improvement Purview (DLP, sensitivity labels, insider risk) Compliance uplift for ISO 27001, SOC 2, GDPR and NIS2 Configuration hardening, patching and policy deployment Entra ID, Conditional Access, PIM and cloud identity controls PowerShell and Microsoft Graph for...

We’re looking for a Senior Security Engineer for our client in the data sector, based in London, on an initial 3 to 6 month contract paying up to £500 per day Outside IR35. This role offers hybrid working with an expectation to attend the office 3 days per week. You will focus on hands-on remediation across Azure and endpoint environments, improving Defender for Cloud findings, closing vulnerabilities, and strengthening security posture. The role is delivery-led and ideal for someone who enjoys fixing issues rather than only advising. The successful Senior Security Engineer will have experience with: Defender for Cloud, Defender for Endpoint and EASM Vulnerability remediation and Secure Score improvement Purview (DLP, sensitivity labels, insider risk) Compliance uplift for ISO 27001, SOC 2, GDPR and NIS2 Configuration hardening, patching and policy deployment Entra ID, Conditional Access, PIM and cloud identity controls PowerShell and Microsoft Graph for...

A global investment firm is hiring a Lead Machine Learning Engineer. Hybrid position. Paying up to £1600 per day. Outside IR35 Experience and skills required for the Senior Machine Learning Engineer (AI), Quantization, PEFT, DeepSpeed, ONNX, TensorRT, PyTorch, multi-LoRa, LoRA Exchange, TitanML ️ Strong experience working with inference servers like multi-LoRa, LoRA Exchange, TitanML ️ Experience with HuggingFace Retrieval-augmented generation, embedding pipelines Previous industry exposure to multi-node HPC clusters ️ Experience with Large language models - OpenAI, Mistral, Claude, LLaMA Large language model for GPU usage, scaling, and data movement Quantization, PEFT, DeepSpeed, ONNX, TensorRT Deep Learning with PyTorch Role and responsibilities for the Senior Machine Learning Engineer (AI), Quantization, PEFT, DeepSpeed, ONNX, TensorRT, PyTorch, multi-LoRa, LoRA Exchange, TitanML ️ Build and fine-tune NLP and vision models using frameworks like...

Full job description Data Architects – ADF / Databricks / Data Governance £425–£475 per day (Outside IR35) 6-month contract Hybrid – Bournemouth or Guildford (ideally 3 days onsite/week) Experience: 15+ years We are seeking  two highly experienced Data Architects  to support a major data and AI transformation programme. This role requires deep technical expertise, strong architectural leadership, and the ability to drive high-impact conversations across business and technical teams. The Opportunity You will play a key role in shaping and delivering enterprise-scale data architecture across Azure, working with modern data engineering and AI/ML technologies. This is a hands-on architectural position suited to individuals passionate about designing best-practice data platforms, governance frameworks, and scalable cloud solutions. You will collaborate with multidisciplinary teams—including...

We're looking for an AWS Security Engineer for our client in the data sector, based in London, on an initial 3 to 6 month contract paying up to £500 per day Outside IR35. This role offers hybrid working with an expectation to attend the office 3 days per week. You will focus on hands-on remediation of cloud and application vulnerabilities across AWS environments. The position involves working closely with Developers, Data Engineers and the AWS Security Lead to validate findings, prioritise risk, implement secure fixes, and strengthen AWS security controls. This is a delivery-focused role where you will own issues end to end. The successful AWS Security Engineer will have experience with: Deep, hands-on AWS security across IAM, networking, compute, storage and serverless AWS security controls including IAM least privilege, VPC segmentation, private endpoints, WAF/Shield, KMS, secrets management and logging Operating AWS Security Hub,...

AWS Cloud Engineer | £500 - £600 Outside | 6 months initial | Hybrid London We are working with an up-and-coming Media business to help kickstart their in-house cloud operations, my client is seeking a strong AWS Cloud engineer to come in and build, develop and maintain their existing cloud platform. This role requires 3 days per week onsite in London and offers a daily rate of £500 - £600 per day Outside IR35. Key Requirements: Proven track record delivering AWS Cloud Solutions at Mid-Senior Level Strong skills in AWS, AWS Glue, Lambda, API Gateway Previous experience with SQL, Snowflake, Gitlab Runners. Willingness to travel to London for onsite work up to 3 days per week If this AWS Cloud Engineer role sounds like a good fit, please apply with your most up to date CV. Or reach out to (url removed) AWS Cloud Engineer | £500 - £600 Outside | 6 months initial | Hybrid London

Software Development Team Leads (x2) £650 per day (Outside IR35) | 6-Month Initial Contract | Hybrid - 2x week in London Overview: A global online non-profit organisation that improves the lives of millions worldwide is seeking two outstanding Software Development Team Leads to join its expanding innovation engineering team. These are high-impact leadership roles driving the development of cutting-edge technology that will revolutionise English language learning and assessment. You will lead backend, full-stack, and front-end engineers as part of a growing innovation unit. This role is ideal for a technically strong leader who thrives in complex, fast-moving environments and enjoys solving hard problems. Key Responsibilities: Lead, mentor, and grow a team of software and QA engineers. Provide architectural direction and hands-on technical guidance. Collaborate with Product, Experience Design, QA, and technical leadership. Influence and contribute to...

Data Engineer / Analytics Engineer Contract £400-£450pd (Outside IR35) Remote working About the Role We are looking for a skilled Data Engineer (or Analytics Engineer , depending on experience) to design, build, and maintain the data foundations that power our reporting, analytics, and decision-making. You will work closely with data analysts, engineers, and client teams to create clean, reliable datasets and ensure seamless data flows across our systems.   What You’ll Do Database & Architecture Design and implement relational database schemas. Set up and maintain raw, test, and production database environments. Ensure data integrity, scalability, and performance across systems.   Data Engineering / ETL Build and maintain ETL/ELT pipelines using SQL or Python. Transform and wrangle data from multiple sources into analytics-ready tables. Create reliable methods to read/write user inputs from the front-end into the database.   BI & Reporting...