53 data engineer jobs found

Data Engineer - NPPV 3 Cleared - Contract - Outside IR35 - Hybrid - Midlands VIQU have partnered with a well-established public-sector organisation in the Midlands, who are seeking a Data Engineer to join a major RMS (Records Management System) replacement programme. The successful Data Engineer will be responsible for designing and building robust data pipelines, supporting large-scale data migration activities, and enabling reporting and analytics capabilities across a complex enterprise environment. Key responsibilities: Design, develop, and optimise scalable ETL/ELT pipelines to support data migration, integration, and reporting requirements. Build data ingestion and transformation solutions across multiple source and target systems. Analyse existing datasets, schemas, and data structures to support mapping and migration activities. Work closely with solution architects and suppliers to implement target data models and integration patterns. Drive data quality...

Lead Fabric Data Engineer Location: Fully Remote (UK-based only) Contract: 4-6 months (Outside IR35) Rate: circa £500 per day Interviews: Next week to start mid-August I'm currently partnering with a brilliant E-commerce client who are right middle of a major migration over to Microsoft Fabric. We are looking for a Lead Fabric Data Engineer to champion our clients transition to Microsoft Fabric. You will actively support our ongoing migration, smoothing out infrastructure bumps and troubleshooting integration challenges. Your expertise will directly shape a scalable, high-performance data estate. Key Responsibilities * Optimise Fabric: Build, refine, and optimize Event Houses, Eventstreams, and Kusto environments. * Enhance Pipelines: Drive Spark notebooks and Lakehouse development for peak efficiency. * Support Migration: Resolve Real Time migration issues from Legacy systems to Fabric. * Bridge Ecosystems: Connect and align existing AWS and SQL Server...

Data Engineer (Fabric, Databricks, Azure) Initial 3 months (chance of extension) -£450-£500 per day (outside IR35) - Fully remote Remote interviews to take place next week. Due to the client's request, this role will be paid monthly rather than weekly. Our Public Sector client have an immediate requirement for 2 x Data Engineer's (Fabric, Databricks, Azure) to join their growing delivery team. The initial contract length is 3 months, however this programme will likely run until the end of March 2027, so an extension is highly likely. Key skills and experience for the Data Engineer (Fabric, Databricks, Azure) Databricks Fabric ETL/ELT Azure Azure Data Warehouse Azure Data Factory

Contract Data Engineer Duration - 6 months Outside IR35 - Competitive Market Rate Fully Remote British Citizenship and SC clearance is required Fruition Group are representing a boutique technology consultancy who are specialist at delivering cutting edge solutions for public and private sector clients. They're known as the "Knights in Shining Armour". Join a high-impact government programme using AI, machine learning and computer vision to solve real-world national challenges. You'll build scalable data pipelines and ML infrastructure alongside a specialist consultancy renowned for delivering mission-critical solutions, working with modern technologies in a secure, cutting-edge environment Key Skills required: - PyTorch - TensorFlow - SciKit - Airflow or Prefect - ML flow (really nice to have) - Python - SQL - Data Modelling This role will require an active SC Clearance and British Citizenship is required due to the secure nature of the project. We are...

Data Engineer £600-700/day outside IR35 3-month initial contract Remote working - ideally once a month onsite Working with a leading financial services client who are looking for a Data Engineering Consultant. Looking for someone who is skilled at understanding organisational objectives, engaging with stakeholders across all levels and translating strategic business needs into scalable, high-value data solutions. Able to work autonomously, balancing immediate requirements with long-term business outcomes to ensure data products deliver measurable value. Data Engineering Consultant, key responsibilities: Take ownership of end-to-end of complex data products Work cross-functionally with non-technical stakeholders to understand data requirements Expert knowledge of SQL to query, analysis and model data Experience with Snowflake Using DBT for data transforms and modelling Data ingestion using Python Build foundations for business functions to...

Data Engineer - AI Data Platform - Outside IR35 - Remote The Data Engineer will be responsible for building the core data infrastructure underpinning next-generation AI products, integrating enterprise and third-party data sources, and developing scalable data services to support AI-driven applications. Data Engineer - AI Data Platform - Key Skills: - Proven experience building scalable enterprise data platforms and data infrastructure. - Must have strong understanding of AI/LLM data architectures and enabling AI agents to retrieve and prioritise enterprise data. - Investment Management background preferred - Strong Azure experience, including Azure Service Bus and cloud-native data services. - Experience developing MCP registries, connectors, and data integration frameworks. - Strong experience integrating third-party data providers (eg S&P or similar external data sources). - Experience designing universal data layers to support AI, analytics, and enterprise data...

Contract Senior Data Engineer 6-week contract | Remote | Outside IR35 | Active SC required | Immediate start I'm supporting a client looking for a hands-on Senior Data Engineer to join a high-impact programme building a secure, AI-ready data platform. You'll design and deliver production-grade data pipelines across batch and Real Time workloads, helping create a trusted knowledge layer that supports AI applications and autonomous agents. What you'll be doing Building scalable distributed data pipelines Developing batch and streaming ingestion processes Creating robust data models for structured and unstructured data Implementing data lineage, provenance and metadata management Supporting knowledge graphs, entity resolution and data fusion Integrating data platforms with AI and agent-based applications Deploying services in secure cloud and containerised environments What they're looking for Strong Python Spark/PySpark Kafka, Flink, Iceberg and Trino Data...

BI/Data Engineer As a BI/Data Engineer, you will provide specialist technical expertise to develop, enhance and support our outbound bordereaux reporting solution. Working closely with the Actuarial, Product, Data & MI teams, you will improve data quality, implement new reporting requirements and automate manual processes to deliver accurate, timely and efficient bordereaux submissions to our capacity providers. You will take ownership of understanding the existing solution, analysing business requirements, developing robust data validation processes and delivering scalable reporting solutions while ensuring knowledge is documented and transferred at the conclusion of the engagement. Essential Experience Proven experience developing bordereaux reporting solutions within the insurance industry. Strong experience as a BI Developer or Data Engineer. Hands-on experience working with the Acturis Back End database. Advanced SQL skills including stored procedures, views,...

Senior Data Engineer / Modeller | London | Outside IR35 | £400 - £500 | Hybrid This is a hands-on role suited to someone who enjoys working across the full data lifecycle — from designing scalable platforms and pipelines to shaping well-structured data models that drive meaningful business insight. You’ll operate in a collaborative, small-team environment, working closely with both technical teams and non-technical stakeholders to turn complex requirements into clear, practical solutions. What You’ll Be Doing Designing and delivering robust data models (conceptual, logical, dimensional) for analytics and reporting Building and optimising data platforms and ETL/ELT pipelines in cloud environments Ingesting and integrating data from various sources (APIs, databases, flat files) Translating business needs into scalable, maintainable data solutions Applying best practices across data governance, quality, and security Working directly with clients, explaining technical concepts...

Senior Data Engineer/Modeller | London | Outside IR35 | £400 - £500 | Hybrid This is a hands-on role suited to someone who enjoys working across the full data life cycle - from designing scalable platforms and pipelines to shaping well-structured data models that drive meaningful business insight. You'll operate in a collaborative, small-team environment, working closely with both technical teams and non-technical stakeholders to turn complex requirements into clear, practical solutions. What You'll Be Doing Designing and delivering robust data models (conceptual, logical, dimensional) for analytics and reporting Building and optimising data platforms and ETL/ELT pipelines in cloud environments Ingesting and integrating data from various sources (APIs, databases, flat files) Translating business needs into scalable, maintainable data solutions Applying best practices across data governance, quality, and security Working directly with clients, explaining technical...

Senior Data Engineer / Modeller | London | Outside IR35 | £400 - £500 | Hybrid This is a hands-on role suited to someone who enjoys working across the full data lifecycle - from designing scalable platforms and pipelines to shaping well-structured data models that drive meaningful business insight. You'll operate in a collaborative, small-team environment, working closely with both technical teams and non-technical stakeholders to turn complex requirements into clear, practical solutions. What You'll Be Doing Designing and delivering robust data models (conceptual, logical, dimensional) for analytics and reporting Building and optimising data platforms and ETL/ELT pipelines in cloud environments Ingesting and integrating data from various sources (APIs, databases, flat files) Translating business needs into scalable, maintainable data solutions Applying best practices across data governance, quality, and security Working directly with...

Lead Databricks Data Engineer £500 - £600 per day Outside IR35 London, hybrid working This freelance opportunity offers the chance to shape the future-state data platform for a large, complex financial services organisation. The focus is on moving from slow, batch-based analytics towards a more modern, streaming-led architecture, with clear ownership over data vision, use cases, and delivery direction. The Company They are a well-established organisation operating at scale within the UK financial services and pensions landscape. Managing significant volumes of legacy and live data, they work with both onshore and offshore delivery partners. The business is at a pivotal point in modernising how data is accessed, governed, and used to drive insight. Clear communication and pragmatic decision-making are highly valued. The Role and Deliverables Define a clear end-to-end data vision, covering current state, target architecture, and practical...

Data Engineer Location: London (1 day per month onsite) Duration: Initial 6-Month Contract Pay Rate: £550-£590 Outside IR35 The Opportunity We're supporting a growing loyalty and rewards organisation that is expanding its data engineering capability as part of a wider investment in its data platform. They are seeking experienced Data Engineers to build and enhance cloud-based data solutions, working alongside senior technical leadership within a modern data environment. Key Responsibilities Develop and maintain data pipelines and data products. Build and optimise data models within the data platform. Support the delivery of scalable and reliable data solutions. Contribute to code reviews and engineering best practices. Collaborate with technical stakeholders to deliver business requirements. Support ongoing platform development and improvement initiatives. Technical Environment AWS Snowflake dbt Required Skills & Experience Strong Data...

Data Engineer Location: London (1 day per month onsite) Duration: Initial 6-Month Contract Pay Rate: £550- £590 Outside IR35 The Opportunity We 're supporting a growing loyalty and rewards organisation that is expanding its data engineering capability as part of a wider investment in its data platform. They are seeking experienced Data Engineers to build and enhance cloud-based data solutions, working alongside senior technical leadership within a modern data environment. Key Responsibilities Develop and maintain data pipelines and data products. Build and optimise data models within the data platform. Support the delivery of scalable and reliable data solutions. Contribute to code reviews and engineering best practices. Collaborate with technical stakeholders to deliver business requirements. Support ongoing platform development and improvement initiatives. Technical...

Contract Data Engineer (Snowflake, AWS, dbt) £500-£600 pd Outside IR35 Initially 6 months (with strong extension potential) Mostly remote, once a month in London Leading Ecommerce business is looking for an experienced Data Engineer to join a high-performing data team delivering modern cloud-based data solutions. You'll play a key role in designing, building, and optimising scalable data pipelines that support analytics, reporting, and business-critical decision-making. Key Responsibilities Design, develop and maintain scalable data pipelines and ETL/ELT processes. Build and optimise data models using dbt . Develop and maintain data solutions within Snowflake . Work with AWS services to support data ingestion, storage and transformation. Ensure data quality, reliability and performance across the data platform. Collaborate with analysts, engineers and business stakeholders to deliver data solutions. Support CI/CD, testing and deployment of data...

Azure Data Engineer £500 per day | Outside IR35 | 6-Month Contract Hybrid Working Immediate Start Available Initial 6-Month Contract with Extension Potential We 're partnering with an end-user organisation undertaking a major data migration and cloud modernisation programme and are looking for an experienced Azure Data Engineer to support the transition to a modern Azure-based data platform. This role will play a key part in migrating legacy data environments, building scalable cloud-native solutions, and enabling the business to maximise the value of its data assets. The Role As an Azure Data Engineer, you will be responsible for designing, developing and optimising data pipelines and data platform capabilities within Azure. Working closely with architects, analysts and business stakeholders, you 'll help deliver a modern, scalable and high-performing data ecosystem. The successful candidate will have strong Azure Data...

Senior & Lead Data Engineers - Outside IR35 - Remote 1x Lead Data Engineer Vacancies - Up to £780 Per Day Outside IR35 3x Senior Data Engineer Vacancies - Up to £635 Per Day Outside IR35 Location: London (1 day per month onsite) Duration: Initial 6-Month Contract The Opportunity We're supporting a a major household brand supporting their loyalty and rewards arm of the organisation. They are expanding its data engineering capability as part of a wider investment in its data platform. They are seeking experienced Data Engineers to build and enhance cloud-based data solutions, working alongside senior technical leadership within a modern data environment. Key Responsibilities Develop and maintain data pipelines and data products. Build and optimise data models within the data platform. Support the delivery of scalable and reliable data solutions. Contribute to code reviews and engineering best practices. Collaborate with technical stakeholders to deliver...

Databricks + MLOps + Recommendation Systems + Entity Matching Role: Data Scientist Rate: £500-545 GBP per day Outside IR35 4 months initial London - Hybrid Role Summary Senior data scientist/ML engineer to design, build, and productionise ML capabilities on a Databricks platform buildout for an international events company. The role covers three interconnected workstreams: MLOps foundation, recommendation engine (exhibitors and sessions for event attendees), and single customer view (identity resolution across sparse conference registration data). The role includes MLOps framework design and implementation, recommendation approach experimentation and delivery, tiered identity resolution (deterministic + fuzzy matching), a human-in-the-loop review workflow via Databricks Apps, plus documentation and knowledge transfer to the internal team. This is a hands-on delivery role: responsible for both defining the ML approach and implementing it end-to-end....

We're looking for an Analytics Engineer or Data Engineer with strong hands-on experience in dbt, complex SQL and data modelling. You'll be responsible for building and refactoring data models and pipelines, helping shape a new data warehouse and supporting the migration from a Legacy data platform. Key Skills & Experience Strong production experience with dbt and complex SQL Hands-on experience with data modelling, including fact and dimension tables, schemas, grain and data warehouse layering Experience building and maintaining data pipelines Experience with an orchestration tool such as Prefect, Airflow or Dagster Strong Python skills for automation, validation and data processing Experience with data warehouse design, ideally including building one from the ground up Experience with data platform or Legacy system migrations is beneficial Knowledge of Git and basic CI/CD Experience in Insurance or InsurTech is desirable Exposure to Azure, AWS or GCP is...

Contract Data Integration Engineers (Datastage & Azure Data Factory) Remote-first with occasional UK office visits £400-500/day Outside IR35 6-12 Months Contract We are supporting a major UK organisation undergoing a significant transformation of its data and integration landscape. As part of a large-scale programme of integration projects and future cloud migration initiatives, we are seeking experienced Data Integration Engineers with expertise in either IBM Datastage or Azure Data Factory (ADF). We currently have five contract opportunities available: 3 x Datastage Engineers 2 x Azure Data Factory (ADF) Engineers These contractors will play a key role in delivering business-critical integration projects, supporting operational systems, and helping modernise the organisation's data platform. Responsibilities You'll be involved in a variety of high-profile integration projects, including: Building and enhancing data integrations between internal and third-party...