58 data engineer jobs found in London

Data Engineer - Contract - Outside IR35 - Wembley Hybrid This position will focus on improving and maturing the existing data platform, developing scalable data structures and pipelines, and supporting the wider business in maximising the value of its data. The environment has been established within Microsoft Fabric for several years, however there remains significant opportunity to improve data warehousing structures, data modelling, governance and reporting capabilities. The successful candidate will work across the full data lifecycle, from ingestion and transformation through to reporting and security, while collaborating closely with Data Analysts and business stakeholders. This is a hands-on role suited to someone who enjoys building practical, maintainable solutions and can balance strong technical capability with a business-focused approach. Key Responsibilities Design, develop and maintain data pipelines within Microsoft Fabric. Build and enhance...

Data Engineer - SQL/Fabric/ADF/PySpark/ETL - Insurance - OUTSIDE IR35 Our client, a leading insurance broker, urgently requires an experienced Data Engineer to join their team to work on a high-profile, time-critical project. This is a hybrid role with 1-2 days a week in the office (London/Manchester). If you don't have insurance/insurance broking experience, please DON'T apply. ESSENTIAL SKILLS & EXPERIENCE: 5+years data engineering experience within insurance/insurance broking; Strong experience in SQL, Fabric, ADF, PySpark and ETL; and Understanding of insurance broking systems eg OpenGI, Applied, Guidewire, Instanda, Acturis. Key skills; Data Engineer, BI Developer, SQL, Fabric, ADF, PySpark, ETL, OpenGI, Applied, Guidewire, Instanda, Acturis, insurance, insurance broking, data, data warehousing.

Senior Data Engineer - Contract (outside IR35) - up to £550 per day We’re hiring a Senior Data Engineer to join a leading global organisation, helping to build and enhance a modern data platform within the insurance sector. NB London Market Insurance experience is essential. If you do not have this experience, you will not be eligible for this role. The role You’ll design and develop data pipelines using ETL/ELT, ensuring strong standards in testing, reconciliation, and documentation. You’ll contribute to data modelling, support data delivery, and build APIs/services for stakeholders. You’ll also collaborate across teams, promote best practices, and mentor junior colleagues in an Agile environment. Key requirements London Market Insurance experience (must-have) Advanced T-SQL, SSIS, Azure Data Factory Power BI/SSRS, MDX/DAX Strong data modelling Experience with Azure & on-prem SQL Azure DevOps, data APIs, solid documentation/testing practices...

Data Engineer | Snowflake | SQL | Python | Dynamics CRM We're looking for an experienced Data Engineer to play a key role in a high-profile data transformation programme. You'll lead the modelling of CRM data into Snowflake, develop scalable data pipelines, and help shape the future of analytics, reporting and insight across the organisation. Working closely with both technical teams and business stakeholders, you'll bridge the gap between data users and IT, ensuring robust, trusted data solutions. Key skills: • Snowflake • SQL & Python • dbt • ETL/Data Warehousing • Dynamics CRM (or similar) • Git This is an opportunity to influence architecture, lead technical delivery, and make a real impact within a complex, evolving environment. The role has been deemed Outside IR35, with onsite requirements driven by project needs rather than a fixed mandate. 6 month initial contract.

Senior Data Engineer - Contract - Outside IR35 Hybrid working, Central London Up to £650 per day FinTech | London We’re partnered with a fast-growing FinTech at the heart of Private Market Investments, looking to scale their Data function. What They’re Looking For Strong grounding in computer science fundamentals and data modelling Commercial experience with more than one programming language (Python, Scala, Java, C++) (and strong SQL skills) Experience with streaming and data processing (e.g. Kafka, Spark, Athena or similar) Hands-on experience with Azure Familiarity with data containerisation, ingestion, and orchestration Clear communicator who can explain technical decisions to non-technical stakeholders Why Join? Work on genuinely difficult engineering problems Exposure to large, complex systems in real production environments A culture built by engineers, for engineers Hybrid working, Central London Up to £650 per day If you’re...

Data Engineer £550-600/day outside IR35 6-month contract Remote working Working with a FTSE 100 client who have a requirement for a hands-on Senior Data Engineer. The role will be involved in designing and delivering data models, integrations, orchestration pipelines, rule engines and contributing to the platform/infrastructure - MUST have Terraform experience. Data Engineer, key skills: MUST have experience using Terraform to build and manage IAC Proven experience with AWS (eg S3, Lambda, Glue etc) Background in building data pipelines, integrations and transformation layers Strong hands-on SQL experience Data modelling Data quality rules and validation frameworks Snowflake is massively desirable Data Engineer, AWS, Terraform, Snowflake Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and...

Data Engineer £550-600/day outside IR35 6-month contract Remote working Working with a FTSE 100 client who have a requirement for a hands-on Senior Data Engineer. The role will be involved in designing and delivering data models, integrations, orchestration pipelines, rule engines and contributing to the platform/infrastructure - MUST have Terraform experience. Data Engineer, key skills: MUST have experience using Terraform to build and manage IAC Proven experience with AWS (E.g S3, Lambda, Glue etc) Background in building data pipelines, integrations and transformation layers Strong hands-on SQL experience Data modelling Data quality rules and validation frameworks Snowflake is massively desirable Data Engineer, AWS, Terraform, Snowflake Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have...

Microsoft Fabric Data Engineer - P &C Insurance - 6-12 months London (1 day per week onsite) £400- £500 per day (Outside IR35) Contract We 're working with a forward-thinking company supporting major insurance clients, who are looking to bring in a Microsoft Fabric Data Engineer to help deliver modern data and analytics solutions across the P &C domain. This is a great opportunity to work at the cutting edge of Microsoft 's data ecosystem, helping insurers unlock value from complex datasets across underwriting, claims, and portfolio performance. The Role You 'll play a key role in designing and building scalable data platforms within Microsoft Fabric, taking ownership from ingestion through to insight delivery. Working closely with technical and business stakeholders, you 'll help shape solutions that drive smarter decision-making across the insurance lifecycle. Key responsibilities will include: Delivering end-to-end data...

Data Engineer - Contract (Outside IR35) | London (Hybrid) I'm working with an innovative fintech business that's building cutting-edge AI-powered solutions within the private markets space They're looking for a Data Engineer with experience with the following: Python, SQL and ETL Pipelines LLMs, Generative AI and Vector Databases Azure Cloud Typescript/React A key requirement is that you are actively using AI tools and technologies in your day-to-day workflows 2-stage process Central London (2-3 days onsite) Up to £650/day Outside IR35 Data Engineer - Contract (Outside IR35) | London (Hybrid)

Senior ML Platform Engineer London 5 Days a Week In Office £550- £700 Per Day, Outside IR35 Immediate Start The Company They are a technically ambitious organisation building advanced machine learning systems tightly integrated with real-world systems. Their platform supports the full lifecycle from data collection through to large-scale training and deployment. Engineering quality, reliability, and thoughtful system design are core to how they operate. The Role and Deliverables Own and evolve the operator-facing platform, including web UIs, backend services, and CLI tooling used for live data collection and dataset workflows. Design and maintain robust recording and orchestration systems that scale across robots, sensors, and lab environments. Collaborate with the ML team on dataset builders, ingestion pipelines, and infrastructure supporting large-scale distributed training. Partner with robotics engineers on ROS2 integration,...

Senior Data / ML Platform Engineer Contract | Outside IR35 | London - Hybrid £600-£700 (negotiable) DW Search is partnering with a rapidly growing organisation undertaking a significant data and machine learning transformation. We're looking for a senior engineer who can help bridge the gap between data engineering, platform engineering, and machine learning operations. This role focuses on building the systems, workflows, and infrastructure that enable machine learning models to move from experimentation into reliable production use. This is not a research or modelling role. Instead, you'll work closely with Data Scientists and engineering teams to productionise machine learning workflows, improve platform capabilities, and build scalable foundations for future AI and ML initiatives. What you'll be doing Build and optimise production-grade data and machine learning pipelines Develop feature engineering workflows that support model training and...

Job Information Date Opened 05/06/2026 Job Type Contract Industry Government & Public Sector Work Experience 5+ years Salary 400-500 Outside IR35 City London Province Greater London Country United Kingdom Postal Code EC1A Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading UK digital and technology consultancy specialising in delivering impactful, user-centred services for the public sector. We work with central government departments, agencies, and local authorities to build digital products and services that improve outcomes for citizens. With a team of engineers, architects, delivery professionals, and designers, we bring deep expertise in digital transformation, cloud technologies, and agile delivery. We are committed to engineering excellence, innovation, and creating an inclusive environment where everyone can thrive. Role Overview We are seeking an experienced Azure...

Data Architect / Principal Data Engineer (GCP) Contract: Initial 3 Months Location: Fully Remote Status: Outside IR35 We are looking for a highly experienced Data Architect / Principal Data Engineer with deep, hands-on GCP expertise to support a major data transformation programme within a regulated financial services environment. This is not an advisory role. We need someone who has personally designed, built and owned enterprise-scale GCP data platforms in production and can lead both architecture and delivery. Key Requirements 7+ years' hands-on experience with Google Cloud Platform (GCP) Proven experience designing and building production-grade data platforms using: BigQuery Dataflow Pub/Sub Python APIs and containerised services Strong data architecture experience, including conceptual, logical and physical data modelling Experience establishing governance frameworks, metadata management, data quality...

Senior Databricks Architect/Lead Databricks Engineer - Salesforce Data Architecture exp is a MUST Remote (UK) £700/day Outside IR35 Initial 12-Month Contract | Long-Term Programme | Poosible Extension We're seeking an exceptional Senior Databricks Architect with a strong hands-on Data Engineering background to join a major long-term transformation programme. This is not a pure architecture role. You'll be a Databricks specialist who remains close to the technology, designing and building enterprise-scale data solutions while driving engineering excellence across critical data platforms. You'll take ownership of delivering robust, scalable, and production-grade data solutions within a modern Databricks ecosystem, ensuring platforms are governed, secure, maintainable, and optimised for long-term growth. Key Responsibilities Architect, build and optimise enterprise-grade data solutions within Databricks Design and...

AI Engineer | Hybrid | London | Outside IR35 | 6+ Months Cititec are working with a global financial markets organisation on a large scale data and platform transformation. They are looking for a Senior AI Engineer to help accelerate the migration of a complex data estate from Oracle to a Microsoft centric architecture across Azure, Cosmos DB, Microsoft Fabric and Azure Data Factory. The role will focus on applying AI and GenAI to improve developer productivity and engineering throughput, particularly across data migration, code generation and developer tooling. This includes deploying AI agents and AI assisted development tools within the Azure ecosystem. This is a high impact role operating across a large engineering environment, helping scale modern engineering practices and AI enabled development across a significant developer base.

Role Summary Wagglyn is looking for an experienced HFT DevOps: infrastructure engineer to work with the existing engineering team on the deployment, operation and production readiness of a low-latency FX trading platform. This is a hands-on contract role for someone who has worked with real production infrastructure, HFT systems, data-centre deployments or high-availability backend platforms. It is not a generic cloud-only DevOps role. Scope The contractor will help prepare, operate and support the infrastructure required to run Wagglyn’s MVP trading stack across our production sites, cloud/UAT environments and interim infrastructure. The role will involve working with the engineering team to document the current environment, define deployment and access processes, support the migration from interim to physical infrastructure, and put in place the monitoring, runbooks and controls needed for production operation. Profile ·     Senior hands-on...

AI Engineer Hybrid London Outside IR35 6+ Months Cititec are working with a global financial markets organisation on a large scale data and platform transformation. They are looking for a Senior AI Engineer to help accelerate the migration of a complex data estate from Oracle to a Microsoft centric architecture across Azure, Cosmos DB, Microsoft Fabric and Azure Data Factory. The role will focus on applying AI and GenAI to improve developer productivity and engineering throughput, particularly across data migration, code generation and developer tooling. This includes deploying AI agents and AI assisted development tools within the Azure ecosystem. This is a high impact role operating across a large engineering environment, helping scale modern engineering practices and AI enabled development across a significant developer base.

AI Engineer - LLM & Agentic Systems London - Hybrid. Circa £500 - £675 per day (and negotiable DOE) Contract (Outside IR35) Mid-level, Senior & Lead. Agentic AI/Machine Learning. Company: Our client is a globally established B2B information and professional services business, operating across multiple high-value industry sectors. They have established data science and machine learning engineering teams already delivering in production, and are now expanding their AI capability significantly across the global organisation. This is a role for people who ship. If you've built LLM-powered systems and agentic workflows that are live in production - not demos, not prototypes - and you want to do that at genuine scale, this is worth applying for. What you'll be working on as an AI Engineer - LLM & Agentic Systems: Designing and building AI agents and agentic workflows - combining LLMs, RAG, reasoning, memory and tool orchestration to solve real,...

SC Cleared DevOps Engineer Location: Remote Contract Type: Contract - Outside IR35 Clearance: Active SC Clearance Required We are seeking a highly skilled and motivated SC Cleared DevOps Engineer. This is an exciting opportunity to play a key role in designing, implementing, and optimising scalable infrastructure and automation solutions across complex hybrid environments. The successful candidate will be instrumental in driving operational efficiency, improving system resilience, and supporting cloud migration and modernisation initiatives. Working closely with architects, engineers, and delivery teams, you will help ensure solutions align with technical roadmaps, governance standards, and industry best practices. Key Responsibilities Develop, maintain, and enhance Ansible playbooks and roles to automate infrastructure provisioning and management. Design and implement robust CI/CD pipelines that support reliable, scalable,...

Job title: Network Engineer / Network Designer (Contract) Duration: 3 months initially, with potential extensions Location: London (Hybrid) Rate: £500 to £550 per day outside IR35 Role Overview A Network Engineer / Network Designer is required to deliver project-based network and security changes within a large, distributed retail organisation. This role focuses solely on project delivery , with no BAU or operational support responsibilities. The contractor will work under general direction, taking responsibility for their own deliverables and ensuring that all design output, configuration artefacts, and documentation updates are accurate, consistent, and aligned with established standards. The work will involve contributing to network designs, implementing planned configuration changes, and updating documentation across hybrid cloud and on?premises environments. Technologies include Cisco ACI , Juniper Mist , Fortinet FortiGate , Palo Alto Networks ,...