28 senior data engineer jobs found

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

Senior Data Engineer - Fabric London Hybrid - Outside IR35 We're hiring on behalf of our business we've partnered with for over 8 years, supporting them in building and scaling high-performing technology and data teams. They are now seeking an experienced Senior Data Engineer with strong Microsoft Fabric and Power BI expertise to play a key role in delivering enterprise-scale data solutions. This position will be instrumental in supporting a major global ERP transformation programme , ensuring high-quality reporting, robust data pipelines and scalable data warehouse architecture are in place to drive accurate stakeholder insight and business decision-making across international operations. Key Responsibilities Implement data migration strategies using Microsoft Fabric for reporting and stakeholder consumption Design and build data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Model data from multiple sources into structured outputs...

Senior Data Engineer - PySpark, GCP We're recruiting for a Senior Data Engineer with strong PySpark skills, to join a growing team in building out a modern Lakehouse platform in GCP. This is a hands-on role for someone who can take ownership, work independently, work iteratively and delivery quickly. Key skills and experience: Strong experience as a Data Engineer in Cloud Environments (ideally GCP but not essentially) Hands on experience with PySpark and SQL Experience building data lake/lakehouse platforms Strong understanding of distributed data processing (Spark) Experience with Airflow or similar orchestration tools Ability to design and deliver pipelines end-to-end, independently Nice to have: Strong GCP experience Terraform/Infrastructure-as-Code Experience with data quality tools (Great Expectations, Soda) Exposure to data catalog/governance tools Experience of working towards/setting up AI, Agentic Workflows etc What you'll be doing:...

Role: Senior Data Engineer Rate: £600 per day (outside IR35) Length: 6 months initially Location: 2-3 days per week in Liverpool Start date: ASAP About the Role We’re looking for a Senior Data Engineer to play a key role in modernising a legacy Business Objects data warehouse, migrating to a modern Azure and Databricks platform. This is an opportunity to take ownership across discovery, build and deployment, helping shape a new cloud-based data environment with real impact across the business. If you enjoy solving complex data challenges, designing robust pipelines and working closely with stakeholders to deliver scalable solutions, this role offers the autonomy and visibility to do just that. Key Responsibilities Lead discovery activities to understand the current Business Objects data warehouse, dependencies, data flows and reporting needs Design and build modern data pipelines and data models on Azure and Databricks to support analytics...

We are working with a leading London-based organisation that is building a modern, enterprise-wide data platform using Microsoft Fabric and is seeking a Senior Data Engineer to play a key role in its development. This is a hands-on role within a greenfield Fabric environment, supporting critical business areas including finance, operations, and strategic decision-making. The successful candidate will design and deliver scalable data solutions across ingestion, modelling, and optimisation, working closely with cross-functional teams to help shape a robust, future-ready data platform. This role requires the Senior Data Engineer to be onsite at the client's London offices three days per week. Skills/Responsibilities Experience of designing and building scalable, production-grade data pipelines and Lakehouse/Warehouse solutions using Microsoft Fabric (OneLake, Dataflows Gen2, Pipelines, Notebooks) Experience of implementing advanced Fabric capabilities such as Shortcuts,...

Contract Data Engineer - Snowflake / DBT / Python / SQL Healthcare/Pharma Industry £550-£600 per day - Outside IR35 London (Hybrid - 2 days onsite) 12 months + extension likely We're supporting a leading organisation building out a modern, cloud-native data platform and looking for multiple Senior Data Engineer with deep Snowflake expertise to join on a long-term contract. What you'll work on Building & optimising scalable Snowflake pipelines Data modelling, quality, lineage & observability Python + dbt engineering in a modern cloud environment Collaborating with architects & product teams Driving best practice across the data platform Tech stack Snowflake, SQL, Python, dbt, AWS (or Azure/GCP), CI/CD, Airflow/Prefect/Dagster, Fivetran/Matillion Ideal profile Strong Snowflake engineering background Comfortable owning end-to-end pipeline delivery Experience in regulated environments (pharma/healthcare a bonus) Clear communicator who can influence...

Contract Data Engineer - Snowflake/DBT/Python/SQL Healthcare/Pharma Industry £550-£600 per day - Outside IR35 London (Hybrid - 2 days onsite) 12 months + extension likely We're supporting a leading organisation building out a modern, cloud-native data platform and looking for multiple Senior Data Engineer with deep Snowflake expertise to join on a long-term contract. What you'll work on Building & optimising scalable Snowflake pipelines Data modelling, quality, lineage & observability Python + dbt engineering in a modern cloud environment Collaborating with architects & product teams Driving best practice across the data platform Tech stack Snowflake, SQL, Python, dbt, AWS (or Azure/GCP), CI/CD, Airflow/Prefect/Dagster, Fivetran/Matillion Ideal profile Strong Snowflake engineering background Comfortable owning end-to-end pipeline delivery Experience in regulated environments (pharma/healthcare a bonus) Clear communicator who can influence...

Contract Data Engineer / MLE (Databricks, GCP) Location: London (hybrid) Contract: Outside IR35 Day Rate: Negotiable ~ £600-£700 DW Search are partnering on a high-impact contract opportunity within a fast-paced, data-driven environment supporting portfolio company initiatives for a major asset management firm. This role sits at the intersection of Data Engineering and Machine Learning Engineering, with a strong focus on building and productionising end-to-end ML pipelines. You will be working on real-world applications of neural networks, enabling scalable feature engineering, model training, and inference in production. Key Responsibilities Build and productionise feature engineering pipelines for ML models Develop and manage training and inference workflows at scale Deploy and monitor machine learning models in production environments Collaborate with data scientists and engineering teams to optimise model performance and reliability Contribute...

Senior Data Centre Network Engineer - Remote - 12 Months - Outside IR35 We are seeking a Senior Data Centre Network Engineer to lead the design, build, and evolution of high-performance, scalable data centre networks. This role is focused on modern spine-leaf architectures, SDN, and automation, supporting large-scale, low-latency environments including cloud platforms, AI workloads, and distributed systems. Key Responsibilities Design and implement spine-leaf data centre network architectures for high availability and scalability Lead the adoption and optimisation of Software-Defined Networking (SDN) solutions Architect low-latency, high-throughput networks to support AI, cloud, and data-intensive workloads Define and enforce network standards, blueprints, and best practices Own Layer 2/Layer 3 design, including routing, switching, and segmentation strategies Design and optimise east-west traffic flows within large-scale DC environments Collaborate with...

Senior Data Centre Network Engineer - Remote - 12 Months - Outside IR35 We are seeking a Senior Data Centre Network Engineer to lead the design, build, and evolution of high-performance, scalable data centre networks. This role is focused on modern spine-leaf architectures, SDN, and automation, supporting large-scale, low-latency environments including cloud platforms, AI workloads, and distributed systems. Key Responsibilities Design and implement spine-leaf data centre network architectures for high availability and scalability Lead the adoption and optimisation of Software-Defined Networking (SDN) solutions Architect low-latency, high-throughput networks to support AI, cloud, and data-intensive workloads Define and enforce network standards, blueprints, and best practices Own Layer 2/Layer 3 design, including routing, switching, and segmentation strategies Design and optimise east-west traffic flows within large-scale DC environments Collaborate with...

Senior Software Developer / Data Engineer - (Contract Outside IR35) In brief We’re looking for well-rounded software developers with experience in data engineering, with a proven ability to tackle complex data challenges, make an excellent impression on clients, and have a high impact on the output of your entire team. We provide a supportive environment with a strong focus on individual career progression, where you will have both the mentorship and project opportunities you need to develop your technical skills. You’ll work in a team alongside other talented developers and data engineers, supported by a Technical Lead. Projects span a range of sizes and multiple sectors and technologies. The role Experience and qualifications You have 4+ years’ experience and a breadth & depth of technical knowledge & expertise, particularly in data engineering, and can solve technical challenges across front-end, back-end, and infrastructure. You have...

Senior Data Engineer — Contract UK Based | £500/day | Remote | Outside IR35 We're hiring a Senior Data Engineer on a 3-month contract to join an AI and Automation team inside a UK unicorn. The work is clearly scoped, the roadmap is planned, and they need someone who can hit the ground running from day one. What you'll do Build and integrate data tables that propagate learner status updates across a live tech stack, with data flowing in real time to an external provider's API Fix a permissions management system currently reliant on manual query execution and resolve API latency issues affecting an internal tool Expand a DataOps API to reduce direct SQL dependency across internal systems Support a data migration and build out additional tables with the right endpoints Improve pipeline performance and connection stability under growing user load Who you are An experienced contractor, active within the last 12 months Strong background in real-time...

Senior Data Engineer - PySpark, GCP We're recruiting for a Senior Data Engineer with strong PySpark skills, to join a growing team in building out a modern Lakehouse platform in GCP. This is a hands-on role for someone who can take ownership, work independently, work iteratively and delivery quickly. Key skills and experience: Strong experience as a Data Engineer in Cloud Environments (ideally GCP but not essentially) Hands on experience with PySpark and SQL Experience building data lake / lakehouse platforms Strong understanding of distributed data processing (Spark) Experience with Airflow or similar orchestration tools Ability to design and deliver pipelines end-to-end, independently Nice to have: Strong GCP experience Terraform / Infrastructure-as-Code Experience with data quality tools (Great Expectations, Soda) Exposure to data catalog / governance tools Experience of working towards / setting up AI, Agentic Workflows etc What you'll...

Job Title: Senior AWS DevOps Engineer (Contract) Location: Remote, must be based in the UK Rate: £500 - £550 per day (Outside IR35) Duration: 6 months A leading organisation within the technology sector is seeking an experienced AWS DevOps Engineer to lead on the delivery of scalable, secure cloud infrastructure. This contract role focuses on building and optimising AWS environments, enabling robust serverless and containerised applications, and supporting data-driven platforms. AWS DevOps Engineer Responsibilities: Deliver Infrastructure as Code using Terraform, including modules, state management, and remote backends Lead on AWS cloud architecture across services such as EC2, S3, RDS, IAM, VPC, ECS, and Lambda Develop and maintain serverless and event-driven architectures Build and optimise CI/CD pipelines using Git-based workflows Ensure AWS security best practices (IAM, least privilege, secrets management) are implemented Drive cost optimisation and...

Job Title: Senior AWS DevOps Engineer (Contract) Location: Remote, must be based in the UK Rate: £500 - £550 per day (Outside IR35) Duration: 6 months A leading organisation within the technology sector is seeking an experienced AWS DevOps Engineer to lead on the delivery of scalable, secure cloud infrastructure. This contract role focuses on building and optimising AWS environments, enabling robust serverless and containerised applications, and supporting data-driven platforms. AWS DevOps Engineer Responsibilities: Deliver Infrastructure as Code using Terraform, including modules, state management, and remote backends Lead on AWS cloud architecture across services such as EC2, S3, RDS, IAM, VPC, ECS, and Lambda Develop and maintain serverless and event-driven architectures Build and optimise CI/CD pipelines using Git-based workflows Ensure AWS security best practices (IAM, least privilege, secrets management) are implemented Drive cost optimisation and...

Senior Platform Engineer - Remote - Outside IR35 - 6 Months As Senior Platform Engineer (Integration) in Squad A, you will be the in-house technical authority for all API and integration work across LightSpeed's critical BSS/OSS ecosystem. You will own the build, maintenance, and evolution of integration flows connecting Salesforce Communications Cloud, NetAdmin, Nokia/Adtran, billing systems, and new services provisioning pipelines - bringing rigour, repeatability, and platform ownership to an environment that has historically relied on external managed services. This is not a back-office development role. You will be a senior contributor to the CI/CD pipeline, a guardian of integration quality across squad boundaries, and a key player in LightSpeed's journey to Engineering Maturity - working closely with the Head of OSS/BSS, the Software Solutions Architect, and cross-squad peers to establish the internal integration capability LightSpeed needs to scale. Experience...

Platform Engineer - Outside IR35 - Remote - 6 Months You will be an integral member of Squad A, working alongside the Senior Platform Engineer to deliver and maintain the integration layer that connects LightSpeed's BSS/OSS systems. LightSpeed is mid-transformation - moving from vendor-managed, outsourced integration to a fully in-house engineering capability - and your contributions will matter from day one. The integrations you build and maintain are what connect Salesforce Communications Cloud to billing systems, provisioning pipelines, the NetAdmin network configuration platform, and ultimately to the customers getting connected across the UK. Must Have Skills Experience Minimum 18 months of hands-on integration or API development experience in a professional delivery environment - working on real platform implementations with production consequence, not solely academic or training exercises Solid REST API fundamentals - HTTP methods, status codes,...

Senior Python Engineer (Microservices/Event-Driven) - Contract £550/day | Outside IR35 4 Months | Watford (HYBRID) We're hiring a Senior Python Engineer with proven time-series experience to work on a Real Time data platform. This is a Back End engineering role focused on event-driven systems and time-series data. It is not a data science or analytics position. What You'll Be Doing Building API-driven Back End services in Python Developing event-driven microservices using Azure Service Bus Working on high-throughput ingestion and processing systems Deploying services via Azure Functions or Docker on AKS Core Requirements (Non-Negotiable) Strong Python Back End engineering experience Demonstrable experience: Designing data models for time-based querying Optimising queries and handling large datasets Working within event-driven architectures Tech Environment Python Azure (Functions, AKS, Storage) Azure Service Bus ADX/Kusto or InfluxDB...

BI Developer London, Hybrid (2 days) Outside IR35 £450-£500pd This contract offers the opportunity to play a key role in shaping analytics for a fast-growing technology business at an important stage of its data journey. You will work closely with multiple teams to turn data into meaningful insight, with clear visibility and impact across the organisation. The Company They are a high-growth SaaS business operating in the technology space, with a well-established product and strong commercial momentum. The Role and Deliverables Partner with product, finance operations, customer success and sales teams to understand reporting and analytics requirements. Build and maintain analytics models using dbt to support a robust gold-layer dataset. Develop clear, well-structured Power BI dashboards focused on performance and operational metrics. Contribute to data pipeline development to ensure reliable and scalable data delivery. Deliver high-quality SQL-based data...

Senior Time-Series Engineer (Python or .NET) - Contract £550/day Hybrid (Watford) 4 Months Outside IR35 We're supporting a technology-led organisation building high-throughput, event-driven systems operating at scale. They are looking for 2 Senior Engineers (1 Python, 1 .NET/C#) to work on a time-series focused platform powering Real Time data ingestion, storage, and analytics. This is not a standard Back End role. If you haven't actually worked hands-on with time-series data in production, this won't be the right fit. What You'll Be Doing Building API-driven Back End services handling high transactional workloads Designing and optimising time-series data pipelines (ingestion storage query) Working with event-driven architectures using Azure Service Bus Modelling time-series datasets for performance and scalability Implementing retention policies, partitioning strategies, and downsampling Optimising query performance across large-scale datasets Deploying...