218 data engineer jobs found

📢 Contract opportunity: Data Engineer (outside IR35) We’re looking for a hands-on Senior Data Engineer to work with a Relentica client on the design and delivery of their first central data warehouse. The assignment will bring together data from Salesforce, ERP and other operational sources, replacing manual extracts and spreadsheet-heavy reporting with automated, reliable data pipelines. The technology stack is: Microsoft Fabric Fabric Data Factory Power BI SQL APIs and file-based integrations You’ll lead the work from discovery and architecture through to build, documentation and handover. This includes developing ingestion pipelines, data models, monitoring and security, while working closely with the client’s existing Power BI resource. We need someone who can combine strong technical design with hands-on engineering. Experience integrating Salesforce, ERP and operational platforms is essential. 📅 Six-month contract 💷 £450-£600 per day 📍...

🚨 Data Engineer | Contract | Outside IR35 | London OB are currently partnered with a stealth-mode AI company that’s building some really interesting infrastructure around the next generation of AI. They’re looking for a Data Engineer to come in on a contract basis and work on large-scale data ingestion, processing and infrastructure, with plenty of scope to solve complex technical problems. Looking for: • Strong Python + SQL • Data engineering in production environments • Large-scale / distributed data processing • Data ingestion and pipeline development • Experience working with complex, unstructured or semi-structured data 📍 London, 2-3 days onsite 💰 Outside IR35 📄 Contract

🚨 Contract Data Engineer | Outside IR35 | London Oliver Bernard are currently partnered with a stealth-mode AI company building infrastructure for the next generation of AI. They’re looking for a Data Engineer to join the team on a contract basis, working on some genuinely interesting challenges around large-scale data acquisition, ingestion, processing and infrastructure . You’ll be working across complex datasets and distributed systems, helping build the foundations that power cutting-edge AI applications. What they’re looking for: • Strong Data Engineering background • Python + SQL • Experience with large-scale data processing / distributed systems • Data ingestion and pipeline development • Experience with unstructured or semi-structured data • Strong production engineering mindset 📍 London, 2-3 days onsite 💰 Outside IR35 - Competitive day rate 📄 Contract

Azure Databricks Data Engineer | Outside IR35 | £450 - £500 | Hybrid | Nottingham We're looking for an experienced Data Engineer with strong Azure Databricks expertise to support the design, development, and optimisation of modern data platforms. You'll be responsible for building scalable data pipelines, managing large datasets, and delivering high-quality data solutions within an Azure environment. Key Skills & Experience Required Strong hands-on experience with Python, PySpark, and SQL/Spark SQL for building production-grade ETL/ELT pipelines Solid knowledge of Apache Spark, including DataFrames, joins, aggregations, partitioning, caching, and performance optimisation Experience working within Azure Databricks, including clusters, job clusters, notebooks, repositories, jobs, and Databricks Runtime Proven experience implementing Lakehouse architectures, including Bronze, Silver, and Gold data layers on Azure Data Lake Storage Gen2 Familiarity...

Join a major data and analytics initiative for a global brand and help build the future of their modern data platform. Salary: £500 - 550 per day Fabric Data Engineer | 6 months | Outside IR35 We are supporting a major data and analytics initiative for a global client and are looking for an experienced Fabric Data Engineer to play a key role in building a modern data platform. You'll be responsible for developing the core data structures, integrations, engineering and modelling solutions that bring together data from multiple systems, creating a trusted foundation for reporting and analytics for a key commercial area of the organisation. This is a hands-on delivery role that will see you working alongside business stakeholders and technology teams to design and implement scalable, production-grade data solutions. The role: Design and develop robust data models to support key commercial reporting and operational decision-making Build and maintain...

Join a major data and analytics initiative for a global brand and help build the future of their modern data platform. Salary: £500 - 550 per day Fabric Data Engineer | 6 months | Outside IR35 We are supporting a major data and analytics initiative for a global client and are looking for an experienced Fabric Data Engineer to play a key role in building a modern data platform. You'll be responsible for developing the core data structures, integrations, engineering and modelling solutions that bring together data from multiple systems, creating a trusted foundation for reporting and analytics for a key commercial area of the organisation. This is a hands-on delivery role that will see you working alongside business stakeholders and technology teams to design and implement scalable, production-grade data solutions. The role: Design and develop robust data models to support key commercial reporting and operational decision-making Build and maintain automated data...

Azure Databricks Data Engineer | Outside IR35 | £450 - £500 | Hybrid | Nottingham We're looking for an experienced Data Engineer with strong Azure Databricks expertise to support the design, development, and optimisation of modern data platforms. You'll be responsible for building scalable data pipelines, managing large datasets, and delivering high-quality data solutions within an Azure environment. Key Skills & Experience Required Strong hands-on experience with Python, PySpark , and SQL/Spark SQL for building production-grade ETL/ELT pipelines Solid knowledge of Apache Spark , including DataFrames, joins, aggregations, partitioning, caching, and performance optimisation Experience working within Azure Databricks , including clusters, job clusters, notebooks, repositories, jobs, and Databricks Runtime Proven experience implementing Lakehouse architectures , including Bronze, Silver, and Gold data layers on Azure Data Lake Storage Gen2 Familiarity with...

Fabric Data Engineer | 6 months | Outside IR35 We are supporting a major data and analytics initiative for a global client who and are looking for an experienced Fabric Data Engineer to play a key role in building a modern data platform. You'll be responsible for developing the core data structures, integrations, engineering and modelling solutions that brings together data from multiple systems, creating a trusted foundation for reporting, analytics for a key commercial area of the organization. This is a hands-on delivery role that will see you working alongside business stakeholders and technology teams to design and implement scalable, production-grade data solutions. The role: Design and develop robust data models to support key commercial reporting and operational decision-making. Build and maintain automated data pipelines within Microsoft Fabric Connect and ingest data from a variety of internal applications and external providers using APIs Implement monitoring,...

Azure Databricks Data Engineer | Outside IR35 | £450 - £500 | Hybrid | Nottingham We 're looking for an experienced Data Engineer with strong Azure Databricks expertise to support the design, development, and optimisation of modern data platforms. You 'll be responsible for building scalable data pipelines, managing large datasets, and delivering high-quality data solutions within an Azure environment. Key Skills & Experience Required Strong hands-on experience with Python, PySpark , and SQL/Spark SQL for building production-grade ETL/ELT pipelines Solid knowledge of Apache Spark , including DataFrames, joins, aggregations, partitioning, caching, and performance optimisation Experience working within Azure Databricks , including clusters, job clusters, notebooks, repositories, jobs, and Databricks Runtime Proven experience implementing Lakehouse architectures , including Bronze, Silver, and Gold data layers on Azure Data Lake...

We are seeking 3 experienced SC Cleared Data Engineers with strong expertise in AWS Glue to work for our client in the defence sector. You will support the design, development, and optimisation of cloud-based data integration and analytics solutions. You will play a key role in building scalable ETL pipelines, data lakes, and data processing frameworks within AWS, enabling the organisation to deliver high-quality data products and insights. We are looking for people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. You will also need experience with several of the following: Amazon Redshift, AWS Lambda, Amazon Athena, Amazon RDS, Amazon EMR, Amazon EventBridge, Amazon Kinesis, AWS Step Functions, Amazon SQS/SNS and AWS CloudWatch. These roles are outside IR35 and...

Data Engineer | London Market Insurance | Data Transformation Programme | Databricks Our sister company, Stellarmann, is partnering with a leading London Market insurer to recruit an experienced Data Engineer. This is an exciting opportunity to join a significant enterprise-wide data transformation programme, helping to deliver a modern data platform that will replace multiple Legacy data warehouse and reporting solutions with a cutting-edge Azure and Databricks architecture. Working as part of a high-profile transformation team, you will play a key role in designing, building and optimising enterprise-scale data solutions that support the organisation's long-term data strategy. Experience required: Strong Data Engineering experience within Azure environments Hands on experience designing and building enterprise data platforms Azure Databricks Experience implementing and working within Medallion Architecture Advanced SQL Strong Python/PySpark development experience...

Remote (UK based candidates only) Initial 6-Month Contract Outside IR35 Possibility for extension We're working with a consulting client who's partnering with a leading financial services organisation looking to hire an AWS Data Engineer to help build and enhance their cloud-based data platform. Key Skills Required Strong AWS data engineering experience Hands-on expertise with DBT and PySpark Proven Python development skills Experience with Apache Airflow for orchestration Strong knowledge of Amazon Redshift Experience with Apache Iceberg and modern data lake architectures Familiarity with OpenSearch for search and analytics solutions Exposure to Knowledge Graph technologies and semantic data modelling CI/CD experience using CircleCI Responsibilities Design and develop scalable data pipelines and ETL processes Build and optimise cloud-native data solutions on AWS Develop data models and transformations using DBT and PySpark...

Data Engineer £600 per day Outside IR35 6 Month Contract - Fully Remote We're supporting a leading financial services organisation undergoing a large-scale enterprise data transformation and are looking for an experienced Data Engineer to join the team. You'll play a key role in building and enhancing a modern cloud data platform, developing scalable data pipelines and delivering data transformation solutions that support business-critical reporting and analytics Skills & Experience Strong experience with Snowflake. Strong Data Engineering experience with advanced SQL and data modelling skills Proven ability to build data ingestion and processing pipelines using Python. Excellent DBT experience Experience working within large-scale enterprise environments. Strong understanding of data warehousing and ELT principles. Excellent stakeholder management and communication skills Strong understanding of data quality, testing and engineering best practices...

AWS Data Engineer - Migration We're seeking a strong & hands-on AWS Data Engineering contractor, ASAP start, for an urgent replacement contract Rate: Up to £500-525 per day, Outside IR35 Working Patterns: Remote-first, London (up to 1 day p/w on-site). Contract: 3-6 months (likley extension) Sector: Financial Services About: We're supporting a major cloud transformation programme focused on migrating a large-scale Legacy ETL estate consiting of several thousand batch jobs from Ab Initio to a modern, serverless AWS data platform. This is a hands-on Senior Data Engineer role where you'll play a key part in defining migration patterns and delivering production-ready AWS Glue solutions. Person Requirments: Strong AWS Data Engineer - ideally AWS Certified. Idelaly, you'll bring proven experience delivering Ab Initio AWS Glue (PySpark) migration programmes Strong hands-on AWS Data Engineering expertise, particularly AWS Glue , S3 , Athena and...

Data Engineer £600 per day Outside IR35 6 Month Contract - Fully Remote We're supporting a leading financial services organisation undergoing a large-scale enterprise data transformation and are looking for an experienced Data Engineer to join the team. You'll play a key role in building and enhancing a modern cloud data platform, developing scalable data pipelines and delivering data transformation solutions that support business-critical reporting and analytics Skills & Experience Strong experience with Snowflake. Strong Data Engineering experience with advanced SQL and data modelling skills Proven ability to build data ingestion and processing pipelines using Python. Excellent DBT experience Experience working within large-scale enterprise environments. Strong understanding of data warehousing and ELT principles. Excellent stakeholder management and communication skills Strong understanding of data quality, testing and engineering best practices...

Data Engineer £600 per day Outside IR35 6 Month Contract - Fully Remote We 're supporting a leading financial services organisation undergoing a large-scale enterprise data transformation and are looking for an experienced Data Engineer to join the team. You 'll play a key role in building and enhancing a modern cloud data platform, developing scalable data pipelines and delivering data transformation solutions that support business-critical reporting and analytics Skills & Experience Strong experience with Snowflake. Strong Data Engineering experience with advanced SQL and data modelling skills Proven ability to build data ingestion and processing pipelines using Python. Excellent DBT experience Experience working within large-scale enterprise environments. Strong understanding of data warehousing and ELT principles. Excellent stakeholder management and communication skills Strong understanding of data quality,...

I'm working with a client who is scaling their Databricks platform to support AI and GenAI use cases, and they need people who can make sure it's governed properly from the start. This is about hands-on Databricks delivery, not just certifications. This is a remote first contract but you must be based in the UK. This is outside IR35. What they're building Unity Catalog as the single governance layer across data, ML models and AI assets Governed GenAI and agent workloads using Mosaic AI and Agent Bricks Secure, auditable AI pipelines from ingestion to model serving, all within the Databricks platform Databricks project experience we're looking for Unity Catalog implementations or migrations from Hive metastore, including metastore design, catalog and schema structure, and workspace and environment separation Fine-grained access control in Unity Catalog: row filters, column masks, and attribute-based access control (ABAC) with governed tags Unity Catalog lineage...

AWS Data Engineer Contract: 6 Months Rate: £400 per day IR35 Status: Outside IR35 Location: Remote/Hybrid Overview We are seeking an experienced AWS Data Engineer to join a growing consultancy on an initial 6-month contract. You'll be responsible for designing, building, and optimising modern data platforms and pipelines, enabling analytics, reporting, and AI-driven initiatives across the business. This role is ideal for someone with strong AWS experience and a background working with modern data tooling including dbt, PySpark, Airflow, Redshift, Iceberg, OpenSearch, Knowledge Graphs, Python, and CircleCI . Key Responsibilities Design and develop scalable ETL/ELT data pipelines using Python and PySpark Build and maintain data transformation frameworks using dbt Develop and orchestrate workflows using Apache Airflow Deliver high-performance data warehouse solutions within Amazon Redshift Support the implementation and optimisation of...

I'm working with a client who is scaling their Databricks platform to support AI and GenAI use cases, and they need people who can make sure it's governed properly from the start. This is about hands-on Databricks delivery, not just certifications. This is a remote first contract but you must be based in the UK. This is outside IR35 click apply for full job details

I'm working with a client who is scaling their Databricks platform to support AI and GenAI use cases, and they need people who can make sure it's governed properly from the start. This is about hands-on Databricks delivery, not just certifications. This is a remote first contract but you must be based in the UK. This is outside IR35. What they're building Unity Catalog as the single governance layer across data, ML models and AI assets Governed GenAI and agent workloads using Mosaic AI and Agent Bricks Secure, auditable AI pipelines from ingestion to model serving, all within the Databricks platform Databricks project experience we're looking for Unity Catalog implementations or migrations from Hive metastore, including metastore design, catalog and schema structure, and workspace and environment separation Fine-grained access control in Unity Catalog: row filters, column masks, and attribute-based access control (ABAC) with governed tags Unity Catalog lineage...