42 data engineering lead jobs found in London

Date Opened 06/10/2026 Job Type Contract Industry Government & Public Sector Work Experience 5+ years Salary 400-450 outside IR35 About Scrumconnect Consulting Scrumconnect Consulting is a leading UK digital and technology consultancy specialising in delivering impactful, user-centred services for the public sector. We work at the heart of government transformation, partnering with central government departments, agencies and local authorities to design and deliver digital products and services that make a real difference to citizens' lives. With a team of over 125 engineers, architects, delivery professionals and designers, we bring deep Government Digital Service (GDS) expertise, a strong delivery culture and a commitment to delivering high-quality outcomes the right way. We are proud that 42% of our organisation is women, and we continue to build diverse, inclusive teams that reflect the communities we serve. Role Overview We are looking...

Lead Azure DevOps Engineer ( SC eligible/ SC Cleared )    London, United Kingdom | Posted on 06/10/2026   About Scrumconnect Scrumconnect Consulting is a UK-based digital transformation consultancy delivering secure, scalable, and user-centred solutions across government and enterprise organisations. We specialise in agile delivery, cloud platforms, data, and modern engineering practices—helping clients build reliable services that meet high operational and compliance standards. Role Overview As a Lead Azure DevOps Engineer, you will be at the forefront of our infrastructure development, guiding our DevOps strategy and implementation within Azure environments. You will work closely with development teams to ensure efficient deployment and operation of applications, and lead the effort to automate and optimise our processes. This role suits a dynamic, proactive leader who is passionate about using cloud technologies to...

Senior Product Designer Location: UK Remote Contract: 6 months (Good chance to extend) Outside IR35 We're looking for an experienced Product Designer to join a fast-moving, high-traffic digital product team. You'll take ownership of complex customer journeys from initial problem definition through to delivery, working closely with Product, Engineering, Data and other stakeholders. This is a hands-on role for someone who can hit the ground running, make informed design decisions and deliver high-quality work in a complex, regulated environment. What you'll be getting involved in Take the lead on designing digital products and customer experiences from idea through to launch Turn user needs, insight and data into simple, effective design solutions Bring ideas to life through wireframes, prototypes and polished designs Partner closely with Product, Engineering and wider teams to get ideas into production Navigate the usual balance between user experience, business...

Lead Data Architect/Modeller - Fintech £700-750/day outside IR35 London-based Short-term initial engagement - 3-months Working with a Fintech who are looking for a Lead Data Architect/Modeller to ensure the platform's data is structured correctly from the outset and can scale with business demand - this will be for someone to own the long-term data architecture and modelling between the engineering team who are focused on building and the analytics team who are consuming data. Lead Data Architect/Modeller, responsibilities: Define business-led conceptual data model across operational processes Design/shape the operational data architecture Ensure enterprise data models are scalable, consistent and reusable Help define the semantic layer Work closely with business stakeholders to understand how processes operate Challenge requirements Review existing direction and identify architectural or modelling issues Lead Data Architect/Modeller, key...

Technical Delivery Lead Location: London Contract Type: Contract, Outside IR35 Rate: £400 to £450 per day, Outside IR35 Security Clearance: Active SC, SC eligible, Start Date: ASAP About Scrumconnect Consulting Scrumconnect Consulting is a leading UK digital and technology consultancy specialising in delivering impactful, user-centred services for the public sector. We work at the heart of government transformation, partnering with central government departments, agencies and local authorities to design and deliver digital products and services that make a real difference to citizens lives. With a team of over 125 engineers, architects, delivery professionals and designers, we bring deep Government Digital Service (GDS) expertise, a strong delivery culture and a commitment to delivering high-quality outcomes the right way. We are proud that 42% of our organisation is women, and we continue to build diverse, inclusive teams that reflect the communities we serve. Role Overview...

Lead Data Architect / Modeller - Fintech £700-750/day outside IR35 London-based Short-term initial engagement - 3-months Working with a Fintech who are looking for a Lead Data Architect / Modeller to ensure the platform 's data is structured correctly from the outset and can scale with business demand - this will be for someone to own the long-term data architecture and modelling between the engineering team who are focused on building and the analytics team who are consuming data. Lead Data Architect / Modeller, responsibilities: Define business-led conceptual data model across operational processes Design / shape the operational data architecture Ensure enterprise data models are scalable, consistent and reusable Help define the semantic layer Work closely with business stakeholders to understand how processes operate Challenge requirements Review existing direction and identify architectural or...

Technology Lead - AWS Modernisation Programme 6-Month Contract | Outside IR35 | £400- £450 per day | Fully Remote We 're supporting a consultancy delivering a major cloud transformation programme and are looking for an experienced Technology Lead to drive the modernisation of a large-scale enterprise application estate. This is a hands-on leadership role combining solution architecture, software engineering, cloud transformation, DevOps and stakeholder engagement. You 'll lead the transition from legacy Java applications to modern AWS-native services, helping define the target architecture while providing technical leadership across engineering and delivery teams. The Role You 'll be responsible for shaping and delivering a cloud-native modernisation strategy, guiding applications from monolithic architectures to scalable microservices and serverless solutions on AWS. Working closely with technical and business stakeholders, you 'll lead...

Senior Business Analyst (Contract) - Technical / SaaS £500 per day Outside IR35 UK, Remote-first: 2-3 days on-site, per month Project Length: 6 months + Strong SaaS, ERP and MedTech / Pharma experience is preferred! ** Exciting opportunity to travel periodically to customer sites in Europe (France, Poland, Italy, the Nordics) The successful contractor will join a fast-growing AI SaaS business delivering large-scale enterprise transformation programmes across Europe. You'll own requirements, backlog quality, acceptance criteria and stakeholder engagement, ensuring successful delivery of complex data and AI-driven platform deployments. Essential Requirements 10+ years' Business Analysis experience across enterprise software projects. Proven delivery of requirements end-to-end across multiple concurrent enterprise programmes. Strong user story, acceptance criteria and backlog management experience. Experience working with distributed...

Job Information Date Opened 06/10/2026 Job Type Contract Industry Government & Public Sector Work Experience 5+ years Salary 400-450 outside IR35 City London Province Greater London Country United Kingdom Postal Code EC1A Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading UK digital and technology consultancy specialising in delivering impactful, user-centred services for the public sector. We work at the heart of government transformation, partnering with central government departments, agencies and local authorities to design and deliver digital products and services that make a real difference to citizens' lives. With a team of over 125 engineers, architects, delivery professionals and designers, we bring deep Government Digital Service (GDS) expertise, a strong delivery culture and a commitment to delivering high-quality outcomes the right way. We are proud that 42% of...

Senior Python Engineer - AI & Microservices £450 PD to £600 PD (Outside IR35) | 12 month Contract | 2 days onsite in London (Hybrid) | ASAP Start Our trusted technology partner is developing innovative products and is looking for an experienced Senior Python Engineer/Back End Developer to join a fast-moving team. You will develop Python microservices, scalable services, voice chat, and data pipelines, using AI technologies including ASR, TTS, and LLMs. The ideal candidate will have strong Python skills, a pragmatic delivery-focused approach and experience working within either a SaaS, Digital-Rich, Assessment, Subscription or Ed-tech environment. Key Responsibilities: Develop and maintain scalable Python services, microservices, voice chat, and data pipelines. Work with the Tech Lead and wider team on architecture, technical decisions, and solution design. Collaborate with product, data science, QA, design, and subject matter experts to deliver new features....

For our customer a European Financial Services Organisation we are seeking a Test Manager to assist in a key board sponsored project Programme Test Strategy Lead - Mainframe Modernisation Location: Fully remote - Duration: Long-Term Programme Through 2028 Industry: Financial Services The Opportunity We are seeking an experienced Test Strategy Lead to join one of the most significant technology transformation programmes within the organisation. This board-sponsored initiative is focused on the migration of a Legacy Mainframe estate to a modern technology stack and carries substantial business and operational importance as it holds Client Reference and Market Data The programme is entering a critical phase following approval for its next stage, transitioning core business functionality from Legacy platforms into modern relational data models and distributed applications. The transformation is expected to continue through multiple delivery phases before go-live and...

🤖 Senior Android Engineer – Fintech - 6m OUTSIDE contract 💷 Up to £500/day | Outside IR35 📆 6-Month Contract 📍 Central London – 3 days onsite We’re working with a leading fintech scale-up looking for an experienced Senior Android Engineer to join their mobile engineering team on an initial 6-month contract. 📱 This is a highly product-focused role, working on a major Android product build and creating polished, data-rich mobile experiences. You’ll have genuine end-to-end ownership , from initial idea and technical approach through to testing and release. 👨 💻 A senior doer This is an important one: they need someone senior who is still very close to the code. They’re not looking for a hands-off Lead, they want a highly technical, hands-on Senior Android Engineer who can make good architectural decisions but still enjoys getting stuck into the implementation. You’ll also need to be a confident, clear communicator who can articulate your...

Moving enterprise certificate services onto a new platform takes more than a straightforward migration – the integrations, automation and security controls all need to work when they reach live operation. As a PKI Engineer, you’ll take a migration already in motion and help deliver an enterprise PKI as a Service platform built around AppViewX. You’ll work closely with the lead technical specialist, building integrations, automating certificate workflows and solving the practical challenges that emerge as applications move onto the new service. This is hands-on delivery work where you’ll have the opportunity to see what you build progress into live operation during the six-month assignment. What’s in it for you £650–£700 per day, outside IR35 Six-month contract working on an active enterprise PKIaaS migration Hybrid working from Leeds, London or Edinburgh Hands-on involvement with AppViewX and enterprise certificate...

Lead QA Automation Engineer/Hands-On Test Lead Contract: 6 months Rate: Up to £550 per day, Outside IR35, depending on experience Working arrangement: Hybrid - two days in the office, Tuesdays and Thursdays, and three days from home. Flexibility is required to meet business needs. Our client is seeking a technically hands-on QA Automation Lead to take ownership of testing for an integration project, combining practical test delivery with strong supplier and stakeholder management. You will define the testing approach, establish test automation frameworks and carry out testing across interconnected systems. Alongside this, you will liaise with up to 20 third parties and three external contractors, coordinating testing activity, challenging delivery quality and ensuring issues are resolved. The role Define and deliver the test strategy, plans and quality standards across internal and supplier-led delivery. Set up, develop and maintain automated test frameworks,...

You will take ownership of QA across a complex portfolio of digital products, platforms and integrations. This is a hands-on role combining test strategy, automation excellence, supplier governance and team development. You 'll be responsible for ensuring robust, secure and compliant solutions are delivered, whilst embedding modern QA practices and driving continuous improvement across the technology function. Client Details Our client is a large, social housing organisation undergoing an ambitious digital transformation programme. With a significant investment in technology, data and customer-facing services, they are modernising their platforms, applications and integration landscape to deliver better outcomes for the communities they serve. They offer a collaborative culture where innovation, quality and continuous improvement are genuinely valued. Description Define and own the organisation 's QA and testing strategy across both...

Moving enterprise certificate services onto a new platform takes more than a straightforward migration - the integrations, automation and security controls all need to work when they reach live operation. As a PKI Engineer, you'll take a migration already in motion and help deliver an enterprise PKI as a Service platform built around AppViewX. You'll work closely with the lead technical specialist, building integrations, automating certificate workflows and solving the practical challenges that emerge as applications move onto the new service. This is hands-on delivery work where you'll have the opportunity to see what you build progress into live operation during the six-month assignment. What's in it for you £650 - £700 per day, outside IR35 Six-month contract working on an active enterprise PKIaaS migration Hybrid working from Leeds, London or Edinburgh Hands-on involvement with AppViewX and enterprise certificate infrastructure Opportunity to take...

Delivery Manager is required by this niche consultancy to lead a critical, high-profile Government Alpha project . Working within a fast-paced, user-centered Agile environment, the successful candidate will drive the delivery of an Alpha discovery phase, ensuring the team remains focused on solving the right user problems while meeting Government Digital Service (GDS) alignment. Key Responsibilities: Lead delivery of the Alpha phase, managing multi-disciplinary teams (UX, engineering, product) to iterate prototypes rapidly. Facilitate Agile ceremonies, including daily stand-ups, sprint planning, retrospectives, and show-and-tells. Remove blockers and shield the team from external distractions to maintain a sustainable delivery cadence. Manage stakeholders across government departments, clearly communicating progress, risks, and Alpha outcomes. Track team velocity and health, utilizing data to optimize delivery processes and build a collaborative culture....

Finance Automation Engineer Hybrid but mainly remote with some travel to meet with teams Outside IR35 We are looking for an experienced Finance Automation Specialist to lead the re-engineering and automation of finance processes across the organisation. This is a hands-on delivery role for someone who has successfully redesigned and automated finance processes at scale across multiple systems. You will work from a prioritised backlog of opportunities, removing manual effort, improving data quality and creating more efficient, controlled finance operations. Key Responsibilities Review and re-engineer finance processes to eliminate waste, duplication and unnecessary manual intervention. Build and deliver a prioritised backlog of finance automation and process improvement opportunities Develop workflow automation plans Improve data quality and accelerate month-end close and management reporting. Identify and implement AI and machine learning solutions where...

We are currently looking for an experience Principal Engineer to join us on a contract basis. This is a hybrid position and will require 3 days per week on client site in Central London. Requirements Role responsibilities: Define and drive technical strategy, architecture, and engineering standards across the Personalisation domain Design and deliver scalable systems supporting personalisation, search, recommendations, and ML-powered features Partner closely with Product, Data Science, and Design to deliver customer-centric solutions Lead and influence technical decision-making across multiple teams and platforms Mentor and support senior engineers, helping to raise the overall engineering capability Improve engineering quality, reliability, and productivity through best practices, tooling, and platform enhancemen Who You Are An experienced technical leader with a strong background in Java/Python and large-scale production systems Strong...

Location: West London | Hybrid – 2–3 days WFO Design, build & support scalable data models and distributed ETL pipelines Strong Python + Advanced SQL Google BigQuery / GCP and cloud-based data warehousing Strong DBT for data pipelines and transformations Dimensional modelling , data flow and analytics/reporting DataOps, CI/CD, TDD and Agile practices Snowflake, Iceberg & Lakehouse architecture Troubleshoot data incidents and ensure platform reliability Stakeholder collaboration and requirements analysis Lead/mentor engineers and contribute to data architecture/governance Bonus: Customer/Commerce data, third-party integrations, BDD, AI/ML Mandatory: Data Engineering + Advanced SQL + Python + BigQuery/GCP + DBT + Data Modelling + ETL + CI/CD. Senior Data Engineer - Job desc…