49 lead data engineer jobs found

Lead Data Platform Engineer - Outside IR35 - 1 day pw London (rest remote) - 3 months Initially We are currently recruiting for a Lead Data Platform Engineer to join a programme focused on data platforms, analytics engineering, and modern Lakehouse solutions. The client is looking for a hands-on engineering professional with strong Microsoft Fabric, Spark, PySpark and SparkSQL expertise, capable of designing, building and supporting enterprise-scale data platforms. Start Date: ASAP Duration: 3 months Initially Pay Rate: Competitive IR35 Status: Outside IR35 Location: London (1 day per week onsite, remainder remote) The Role: The core requirement is strong Lakehouse expertise, particularly Spark, PySpark, and SparkSQL. Hands-on experience in low-code is essential. Data & Analytics Expertise: Particularly relevant to your current Data Platform background: Data architecture (Lakehouse, Medallion, Kimball, 3NF). Data ingestion and processing. Data...

2x Data Engineering Positions - Lead/Senior/Mid Outside IR35: £450 - £525 per day ASAP Start: 6 months initial contract Primarily remote: at maximum once a month travel to London We're supporting a key client in a major CRM migration programme that's looking to share the future of their growing data function. As part of this, we're looking to engage 2x Data Engineers, 1 Lead/Senior and 1 Senior/Mid level. You'll be joining at a genuinely exciting stage: the business is investing heavily in new technology and modernizing its data platform from the ground up. Rather than inheriting years of technical debt, you'll have the opportunity to influence architecture, standards, and ways of working from the beginning. Tech Stack: * Snowflake * dbt * Python * AWS * PowerBI Responsibilities: * Designing, developing, and evolving scalable Data Warehouse and ELT solutions * Driving modern DataOps practices including CI/CD, GitOps, testing, and automation * Implementing robust, observable,...

2x Data Engineering Positions - Lead/Senior/Mid Outside IR35: £450 - £525 per day ASAP Start: 6 months initial contract Primarily remote: at maximum once a month travel to London We're supporting a key client in a major CRM migration programme that's looking to share the future of their growing data function. As part of this, we're looking to engage 2x Data Engineers, 1 Lead/Senior and 1 Senior/Mid level. You'll be joining at a genuinely exciting stage: the business is investing heavily in new technology and modernizing its data platform from the ground up. Rather than inheriting years of technical debt, you'll have the opportunity to influence architecture, standards, and ways of working from the beginning. Tech Stack: * Snowflake * dbt * Python * AWS * PowerBI Responsibilities: * Designing, developing, and evolving scalable Data Warehouse and ELT solutions * Driving modern DataOps practices including CI/CD, GitOps, testing, and automation * Implementing robust,...

Principal Control Engineer Duration: 12-months Rate: £80 - £100 per hour (outside IR35) Location: Remote Our client is a leading engineering and design consultancy who specialise in providing services to the engineering sector. As a Principal Control/SCS/SCADA Engineer you will be working on engineering and construction projects primarily in industrial, transmission/distribution and renewable sectors. You must be able to appreciate complex, practical, regulatory, technical and commercial issues and to work constructively with a broad range of senior stakeholders. Role accountabilities: • Responsible for the design of transmission substation Control/SCS/SCADA systems for voltages up to 400 kV. • Reviewing in-house designs and those produced by external contractors. • Responsible for delivering tender design man-hours estimates, deliverables lists, design programs. • Leading and guiding junior engineers through various Control/SCS/SCADA engineering tasks by...

AI Technical Lead | Generative AI & Machine Learning 12-Month Contract | £500 - £700 per day | Outside IR35 | London 167 Solutions is working with an organisation looking to appoint an experienced AI Technical Lead to lead the design and delivery of production-ready Generative AI and Machine Learning solutions. This is a hands-on technical leadership role for someone who can operate across AI strategy, architecture and engineering , while still being comfortable getting involved in the technology. The Role You will take technical ownership of AI initiatives from initial concept through to production, working with engineering, product and business stakeholders to build scalable AI solutions. Key responsibilities will include: Leading the technical design and delivery of Generative AI and Machine Learning solutions Designing enterprise-grade LLM, RAG and AI agent architectures Building and integrating conversational,...

Lead Python Engineer £525/day Outside IR35 3-Month Contract Hybrid Working Active SC Clearance Required An experienced Lead Python Engineer is required to join a data-focused programme aimed at improving the safe use of production data within development environments. The project is centred on data anonymisation, obfuscation and sanitisation, helping to establish the tooling, governance and technical standards needed to support secure software delivery. This is a hands-on leadership role for an engineer who can combine strong Python development skills with stakeholder engagement, technical governance and architectural influence. Working within a small delivery team, you will play a key role in both technical delivery and the wider adoption of best practices across multiple stakeholders. Responsibilities Lead development and enhancement of Python-based tooling. Remain actively involved in software engineering and delivery. Engage with governance forums and...

Lead Python Engineer £450/day Outside IR35 3-Month Contract Hybrid Working Active SC Clearance Required An experienced Lead Python Engineer is required to join a data-focused programme aimed at improving the safe use of production data within development environments. The project is centred on data anonymisation, obfuscation and sanitisation, helping to establish the tooling, governance and te click apply for full job details

AI Engineer - LLM & Agentic Systems London - Hybrid. Circa £500 - £675 per day (and negotiable DOE) Contract (Outside IR35) Mid-level, Senior & Lead. Agentic AI / Machine Learning. Company: Our client is a globally established data and information services business, operating across multiple high-value industry sectors. They have established data science and machine learning engineering teams already delivering in production, and are now expanding their AI capability significantly across the global organisation. This is a role for people who ship. If you 've built LLM-powered systems and agentic workflows that are live in production - not demos, not prototypes - and you want to do that at genuine scale, this is worth applying for. What you 'll be working on as an AI Engineer - LLM & Agentic Systems: Designing and building AI agents and agentic workflows - combining LLMs, RAG,...

Senior C# Engineer – .NET 9/10, AWS Lambda, SQS, SNS – OUTSIDE IR35 £700–£800 per day • Outside IR35 ? 100% Remote • 11-month rolling contract Takeaway: Contribute to the architecture and build of a major greenfield B2B SaaS platform as a deeply senior, hands-on C# engineer, with heavy emphasis on deep .NET engineering , high-performance distributed systems , and real-world AWS serverless delivery . You’ll also have the opportunity to develop hands-on skills with Claude Code , one of the most advanced AI-assisted development tools in the industry. Role Overview: You’ll operate as the technical spearhead for a greenfield product build, reporting to the Director of Engineering. Expect deep backend engineering, distributed system design, and high-quality serverless delivery, plus the chance to adopt modern AI-assisted development practices as part of your workflow. What You’ll Bring: Senior/Staff-level backend mastery in C# and .NET 9/10 , with...

Senior Software Engineer - Rust & Python - any Ruby OR Java a bonus. 100% remote. £600-£650/day OUTSIDE IR35. 12 MONTH CONTRACT We are seeking an experienced Software Engineer to help build and evolve Back End services. You will also play a key role in modernising our engineering ecosystem by helping decommission Legacy Rails components, migrating data models into modern services, and establishing new sources of truth across CLIENTS platform. KEY SKILLS ARE RUST, PYTHON & ANY RUBY, JAVA & API's A BONUS! This is a hands-on engineering role requiring deep expertise with Rust & Python and have experience to build high-performance, scalable Back End systems. YOU MUST BE AN EXPERT IN RUST & PYTHON. Any API's (REST OR GRAPHGL) & Ruby On Rails OR JAVA a big bonus but not essential. Key Deliverables Build and enhance Back End services that reduce operational costs through automation and process optimisation. Develop scalable Rust & Python-based services...

Principal Data Engineer (AWS) - Contract, Outside IR35 £650 per day | Outside IR35 | 3-Month Contract (13 weeks) | Remote UK - very occasional travel to Leeds Brio Digital is working with a major UK organisation embarking on a strategic data transformation programme to modernise a business-critical operational platform. The project replaces manual, spreadsheet-driven processes with a scalable, cloud-native AWS solution that automates high-volume invoicing and operational workflows used across the business. This is a greenfield MVP with a clear roadmap to expand into a significantly larger programme. What you'll be doing Owning the Low Level Design, data models, data flows, AWS services, security controls, IAM model, encryption and secrets management, observability, DR, integration patterns and CI/CD approach Leading technical delivery of the MVP and setting the engineering standards the build follows Building scalable serverless data pipelines, APIs and...

Senior C# Engineer - .NET 9/10, AWS Lambda, SQS, SNS - OUTSIDE IR35 £700-£800 per day Outside IR35 - 100% Remote 11-month rolling contract Takeaway: Contribute to the architecture and build of a major greenfield B2B SaaS platform as a deeply senior, hands-on C# engineer, with heavy emphasis on deep .NET engineering , high-performance distributed systems , and real-world AWS serverless delivery . You'll also have the opportunity to develop hands-on skills with Claude Code , one of the most advanced AI-assisted development tools in the industry. Role Overview: You'll operate as the technical spearhead for a greenfield product build, reporting to the Director of Engineering. Expect deep Back End engineering, distributed system design, and high-quality serverless delivery, plus the chance to adopt modern AI-assisted development practices as part of your workflow. What You'll Bring: Senior/Staff-level Back End mastery in C# and .NET 9/10 , with the ability...

QA Automation Engineer QA Automation Engineer - End to End Hybrid - 3 Days on-site 400-500 per day (outside of IR35) Technology & Data Shape the future of AI-powered quality engineering. We're working with an organisation that's embracing AI to transform the way software is tested and delivered. As they continue to invest in automation and engineering excellence, they're looking for an experienced QA Automation Engineer to help lead the next generation of test automation. This is more than a traditional QA role. You'll be responsible for building robust, end-to-end automated test coverage across complex applications, data pipelines and reporting layers, while using the latest AI-assisted development tools to improve quality, speed and efficiency. Working closely with software engineers, data teams and product stakeholders, you'll play a key role in embedding quality throughout the development lifecycle and helping shape how AI is used within modern software...

Analytics Engineer l DBT Core l DBT Cloud l Bigquery l Data modelling l data warehouse l SQL l End-to-end l 6-Month Contract £500-£520 per day Outside IR35 l Hybrid London We're working with a fast-moving, product-led business looking for an Analytics Engineer to support their data team on an initial 6-month contract. This is a hands-on role sitting between data engineering and analytics - building clean, reliable data models that power reporting and decision-making across the business with a strong emphasis on DBT You'll be working closely with BI and engineering teams both onshore and offshore, owning dbt models end-to-end and helping improve data quality, performance, and overall usability. What you'll be doing: Owning and resolving pipeline failures Building new data marts for the BI team Improving our existing data layer's performance for BI analysis Migrating existing business semantic logic from Tableau into our dbt project to improve performance and...

Job Title: Project Manager - Network & Security Day Rate: £450 per day - Outside IR35/Limited Company Duration: 6 months initially Location: Central London, near Bank Station - Fully onsite Start Date: ASAP Overview We are assisting a client in their requirement for an experienced Project Manager to lead the delivery of a Cisco network and security transformation programme. As Project Manager, you will take ownership of the end-to-end delivery, coordinating technical resources, stakeholders, third parties and business teams to ensure the migration is delivered successfully with minimal disruption to production services. Key Responsibilities Own and manage the project from initiation through design, build, migration, testing, cutover and handover into BAU. Develop and maintain the overall project plan, milestones, dependencies, RAID log and delivery schedule. Coordinate the deployment of the new Cisco Secure Firewall infrastructure, including FMC HA and...

Role - Search Orchestration Developer - Agentic AI Platform Remote Role/London Rate - Upto £600/Day Outside IR35 Role & Responsibilities: Lead the design, development, and delivery of production-grade Search Orchestration services for Client Group's enterprise Agentic AI platform, leveraging hybrid retrieval, GraphRAG, reranking, and knowledge discovery. Build scalable, secure, and reusable search capabilities using Azure AI Search, Neo4j, Qdrant, BM25, Vector Search, Cross-Encoder Reranking, Python, and Azure AI Foundry. Design and implement cloud-native microservices, REST APIs, CI/CD pipelines, automated testing, monitoring, and Kubernetes-based deployments on Azure. Develop enterprise search solutions integrating Snowflake, SharePoint, Azure services, embeddings, LLMs, and hybrid search architectures to support multiple AI applications. Collaborate closely with Solution Architects, Product Owners, Data Engineers, and the Architecture Review Board to...

Data Architect - Insurance - London Market Location: London, UK Working Pattern: Hybrid - 2-3 days per week onsite Contract: Outside IR35 Rate: £450 per day Duration: Contract The Opportunity We are looking for an experienced Data Architect with strong insurance domain experience to join a major insurance organisation in London. This is a hands-on architecture role focused on designing, modernising and governing enterprise data platforms. You'll need strong SQL/PostgreSQL, data modelling, migration and data governance experience, alongside a solid understanding of insurance data and processes. Key Responsibilities Own end-to-end data architecture across transactional, analytical and reporting platforms. Design logical, conceptual and physical data models, schemas, data flows and integration patterns. Lead data migration, database modernisation and optimisation initiatives. Work closely with business stakeholders, product owners, data engineers...

Analytics Engineer l DBT Core l DBT Cloud l Bigquery l Data modelling l data warehouse l SQL l End-to-end l 6-Month Contract | £500- £520 per day | Outside IR35 l Hybrid London We 're working with a fast-moving, product-led business looking for an Analytics Engineer to support their data team on an initial 6-month contract. This is a hands-on role sitting between data engineering and analytics - building clean, reliable data models that power reporting and decision-making across the business with a strong emphasis on DBT You 'll be working closely with BI and engineering teams both onshore and offshore, owning dbt models end-to-end and helping improve data quality, performance, and overall usability. What you 'll be doing: Owning and resolving pipeline failures Building new data marts for the BI team Improving our existing data layer 's performance for BI analysis Migrating existing business semantic logic from Tableau into our dbt project...

Senior Python Engineer (Agentic AI) | UK | Contract | Outside IR35 Start date: 1st September (7th September at the very latest). Please only apply if you can start by the 7th. A short, high-ownership contract building a production agentic AI product for a name that matters in cyber security. The role You'll help build an AI-powered MCP server for a well-established cyber security organisation. You'll own a self-contained area of the build end to end, working in Python across FastAPI, Django or Flask, integrating LLMs to make the client's frameworks accessible through an agentic interface. The work runs as a prioritised backlog, refined with the client each week, so priorities shift as things progress. You'll pick up your area, run with it, and keep the team in the loop. What's in it for you A genuine agentic AI build headed for production, not a proof of concept Real ownership of your own area. You'll make the technical calls, not close tickets on...

Senior Full Stack Engineer (React / TypeScript) - Contract Start date: early September A short, high-ownership contract for a senior engineer who wants to build across the stack and own their part of it. The role You'll build across the stack in TypeScript with React on the front, owning a self-contained area of the build end to end. You'll make the technical calls on your area, work at pace alongside the wider team, and keep everyone in the loop as things move. What's in it for you Full ownership of your own area, not tickets on someone else's design A modern React and TypeScript stack, front to back A focused engagement with a clear delivery date Remote-first, with office space available when it helps Essential experience You'll need all of these to hit the ground running: Strong commercial TypeScript, front and back Deep React experience on the front end Back-end Node (Express or NestJS) Designing and building...