8 azure databricks data engineer jobs found

Role: Junior Azure Data Engineer Length: 6 Month Contract (Scope to Extend) Location: 3 Days per Week Onsite Rate: £350 - £370 p/d Outside IR35 A data-driven Specialty Insurer is seeking a hands-on Junior Azure Data Engineer to join their established cloud-native data team on an initial 6-month contract, with strong scope for extension. The organisation has invested significantly in building out a modern Databricks-based data platform over recent years. The focus now shifts to driving value from that investment, enhancing, optimising and further developing the platform to support advanced analytics and business insight. You will have demonstrated experience building & optimizing pipelines using ADF, with strong Python & SQL coding ability and demonstratable experience working on Databricks platform. Responsibilities: Enhance and develop an existing Azure Databricks data platform to improve performance, scalability and usability Design, build...

Role: Data Engineer (Python, PySpark, SQL) Day rate: £400pd-£440pd (Outside IR35) Contract: 6 months initial We are seeking a highly skilled Data Engineer to support a Material Spend Project. You will play a crucial role in extracting, transforming, and analysing large data sets from multiple sources, including API integrations and ServiceNow, to drive actionable insights and support strategic decision-making. Skills and experience required: Strong experience developing ETL/ELT pipelines using PySpark and Python Hands-on experience with Microsoft Fabric lakehouse or similar cloud data platforms (Azure Synapse Analytics, Databricks) Proficiency in working with Jupyter/Fabric Notebooks for data engineering workflows Solid understanding of data lakehouse architecture patterns and medallion architecture API Integration experience Experience working with Delta Lake or similar lakehouse storage formats Strong SQL skills for data manipulation, transformation, and quality...

Role: Data Engineer (Python, PySpark, SQL) Day rate: £400pd-£440pd (Outside IR35) Contract: 6 months initial We are seeking a highly skilled Data Engineer to support a Material Spend Project. You will play a crucial role in extracting, transforming, and analysing large data sets from multiple sources, including API integrations and ServiceNow, to drive actionable insights and support strategic decision-making. Skills and experience required: Strong experience developing ETL/ELT pipelines using PySpark and Python Hands-on experience with Microsoft Fabric lakehouse or similar cloud data platforms (Azure Synapse Analytics, Databricks) Proficiency in working with Jupyter/Fabric Notebooks for data engineering workflows Solid understanding of data lakehouse architecture patterns and medallion architecture API Integration experience Experience working with Delta Lake or similar lakehouse storage formats Strong SQL skills for data manipulation, transformation, and quality...

Data Engineer | Outside IR35 | £400 - £500 | 6 months | Hybrid Nottingham We’re looking for a highly skilled Data Engineer to join a growing data team supporting a large-scale modern data platform project. Working 3 days a week onsite on the outskirts of Nottingham, you'll be a key contributor in evolving the organisation’s data capability, focusing on best‑practice engineering, clean architecture, and high‑value BI delivery.Key Responsibilities Design, build and optimise ETL/ELT pipelines using Azure Data Factory and Databricks. Develop scalable data models and transformations using SQL and Python. Work hands‑on with Databricks (Lakehouse, Delta tables, notebooks, workflows). Deliver high-quality dashboards and reporting solutions using Power BI. Implement best practices for data quality, governance, lineage and automation. Collaborate with cross‑functional teams including analysts, product owners and business stakeholders. Support performance tuning, cost optimisation and...

Data Engineer | Outside IR35 | £400 - £500 | 6 months | Hybrid Nottingham We're looking for a highly skilled Data Engineer to join a growing data team supporting a large-scale modern data platform project. Working 3 days a week onsite on the outskirts of Nottingham, you'll be a key contributor in evolving the organisation's data capability, focusing on best practice engineering, clean architecture, and high value BI delivery. Key Responsibilities Design, build and optimise ETL/ELT pipelines using Azure Data Factory and Databricks. Develop scalable data models and transformations using SQL and Python . Work hands on with Databricks (Lakehouse, Delta tables, notebooks, workflows). Deliver high-quality dashboards and reporting solutions using Power BI . Implement best practices for data quality, governance, lineage and automation. Collaborate with cross functional teams including analysts, product owners and business stakeholders. Support performance tuning,...

We're supporting a major financial-systems transformation programme and are looking for a Senior Databricks Engineer to help build and enhance a scalable data-engineering framework used across critical reporting processes. You'll operate as the senior hands-on engineer, shaping reusable libraries, optimising PySpark pipelines, and guiding offshore developers to deliver high-quality, production-ready code. You'll work across ingestion, validation, transformation, and mapping layers within a Databricks-on-Azure environment, helping to establish consistent engineering patterns and ensuring all deliveries meet high standards of performance, traceability, and maintainability. What you'd be doing: Building and extending reusable Databricks/PySpark libraries (ingestion, validation, transformation, mapping). Developing scalable, optimised PySpark pipelines aligned to metadata-driven or hybrid data models. Implementing robust validation and control logic suitable for...

We're supporting a major financial-systems transformation programme and are looking for a Senior Databricks Engineer to help build and enhance a scalable data-engineering framework used across critical reporting processes. You'll operate as the senior hands-on engineer, shaping reusable libraries, optimising PySpark pipelines, and guiding offshore developers to deliver high-quality, production-ready code. You'll work across ingestion, validation, transformation, and mapping layers within a Databricks-on-Azure environment, helping to establish consistent engineering patterns and ensuring all deliveries meet high standards of performance, traceability, and maintainability. What you'd be doing: Building and extending reusable Databricks/PySpark libraries (ingestion, validation, transformation, mapping). Developing scalable, optimised PySpark pipelines aligned to metadata-driven or hybrid data models. Implementing robust validation and control logic suitable for...

Power BI & Databricks Developer- Outside IR35 - Hybrid Job Summary We are seeking a skilled and detail-oriented Power BI Developer with strong expertise in Databricks, SQL, Data Modeling, DAX, and Python. The ideal candidate will be responsible for designing, developing, and maintaining scalable BI solutions that transform complex data into actionable business insights. You will work closely with stakeholders, data engineers, and analytics teams to deliver high-quality reporting and analytics solutions. Key Responsibilities Design, develop, and maintain interactive dashboards and reports using Power BI Develop optimized data models (star schema, snowflake schema) to support business reporting needs Write advanced DAX calculations, measures, and KPIs Build and maintain ETL/ELT pipelines using Azure Databricks Develop and optimize SQL queries, stored procedures, and views Use Python for data transformation, automation, and advanced analytics tasks...