8 azure databricks data engineer jobs found in London

London - 1 or 2 days per week onsite - City of London 6 months contract £570 per day - Outside IR35 Senior Application Developer London - Hybrid working (1 - 2 day per week office visit required) 6 months contract - £570 per day - Outside IR35 About the Role We are looking for a Senior Application Developer to design and build a robust PostgreSQL-based data platform that will underpin our investment reporting, risk analytics, regulatory disclosures and performance measurement. This is a genuinely high-impact, greenfield opportunity. You will have real ownership of the platform design and lead the migration away from Databricks and Excel-driven processes - leaving a lasting mark on infrastructure that sits at the heart of our investment operations. What You'll Be Doing You will lead the design and build of a scalable, secure PostgreSQL data platform to support: Portfolio holdings and valuations Performance and attribution reporting Risk analytics...

Sibling is seeking a Freelance Data Engineer to architect a green-energy analytics platform. This is a hands-on, high-scale role focused on processing global telemetry data. Bio Architect & Code: Build robust, scalable ETL pipelines using PySpark and Databricks. Optimize: Refactor existing Spark jobs for maximum performance and cost-efficiency. Integrate: Deploy production-grade solutions within Azure (Unity Catalog, Delta Lake). Collaborate: Act as the technical bridge between Data Science and Business stakeholders. Expertise: Deep, recent experience in PySpark and large-scale Databricks environments. Cloud: Strong Azure experience (ADF, ADLS Gen2). DevOps: Proven track record with CI/CD, Git, and data engineering best practices. Compliance: Must have the Right to Work in the UK (No sponsorship available). Contract Details: Rate: Competitive Market Day Rate. Timeline: Kick-off in April, running through year-end. Assessment: Confirmed Outside...

Senior Power BI Consultant - Outside IR35 Location: Central London (2-3 days on-site) Contract: 6-12 months, Outside IR35 Industry: Oil & Gas/Commodity Trading Role Summary A leading energy & commodity trading business is looking for a Senior Power BI Consultant to support ongoing analytics and data-modelling work. The role blends hands-on BI development with business engagement. Key Responsibilities * Build and optimise Power BI dashboards, semantic models, and data flows. * Lead data modelling across complex trading datasets. * Translate business requirements into technical specifications for offshore developers. * Ensure best practice in DAX, SQL, and BI design. * Work within the organisation's Databricks environment (platform familiarity expected). * Provide leadership, guidance, and clear communication to both business and technical teams. Required Skills * Expert-level Power BI, DAX, and data modelling. * Strong SQL and experience with large datasets. *...

Role: Junior Azure Data Engineer Length: 6 Month Contract (Scope to Extend) Location: 3 Days per Week Onsite Rate: £350 - £370 p/d Outside IR35 A data-driven Specialty Insurer is seeking a hands-on Junior Azure Data Engineer to join their established cloud-native data team on an initial 6-month contract, with strong scope for extension. The organisation has invested significantly in building out a modern Databricks-based data platform over recent years. The focus now shifts to driving value from that investment, enhancing, optimising and further developing the platform to support advanced analytics and business insight. You will have demonstrated experience building & optimizing pipelines using ADF, with strong Python & SQL coding ability and demonstratable experience working on Databricks platform. Responsibilities: Enhance and develop an existing Azure Databricks data platform to improve performance, scalability and usability Design, build...

Data Engineer l Informatica l Data governance l SQL Database l Databricks l Stakeholder management l integration l Financial Services I £500- £525 per day | Outside IR35 | 3-6-month initial | Hybrid Remote - London One of my consulting partners is kicking off a major data governance and integration programme for a leading insurance client, and we 're looking for three strong Data Engineers with deep experience implementing and optimising Informatica solutions end-to-end from both on prem and cloud systems. Core Skills Required Extensive Informatica experience (IICS / PowerCenter / IDMC) across design, build, integration, and deployment Strong background in Data Governance , including: Enterprise metadata management Data lineage setup and optimisation Data quality rules, profiling, and stewardship workflows Policy framework implementation Governance operating model support Experience working with Informatica...

Role Overview We are seeking a skilled Data Engineer with strong expertise in Microsoft Azure and Databricks to design, build, and optimize scalable data pipelines and analytics solutions. You will play a key role in building modern data platforms that support business intelligence, advanced analytics, and machine learning initiatives. This role requires hands-on experience with cloud-native data architectures, distributed processing, and best practices in data engineering. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and related Azure services Build and optimize data workflows using Apache Spark within Databricks Develop and maintain data lakes and lakehouse architectures using Azure Data Lake Storage Implement data modeling solutions for analytics and reporting Ensure data quality, governance, and security best practices Collaborate with data analysts, data scientists, and business...

Platform Engineer - Outside IR35 - Remote About the Role We are seeking a highly skilled Platform Engineer with strong expertise in Microsoft Azure and Azure Databricks to design, build, and maintain scalable, secure, and high-performing data platforms. You will play a critical role in enabling data engineering, analytics, and AI workloads by developing robust cloud-native infrastructure and data services. This role sits at the intersection of cloud infrastructure, DevOps, and data engineering, ensuring platform reliability, performance, and governance across the organization. Key Responsibilities Design, implement, and maintain cloud-native platform solutions in Microsoft Azure Build, optimize, and manage data platforms using Azure Databricks Develop Infrastructure as Code (IaC) using tools such as Terraform, Bicep, or ARM templates Implement CI/CD pipelines for data and platform deployments Ensure high availability, scalability, security, and cost...

Power BI & Databricks Developer- Outside IR35 - Hybrid Job Summary We are seeking a skilled and detail-oriented Power BI Developer with strong expertise in Databricks, SQL, Data Modeling, DAX, and Python. The ideal candidate will be responsible for designing, developing, and maintaining scalable BI solutions that transform complex data into actionable business insights. You will work closely with stakeholders, data engineers, and analytics teams to deliver high-quality reporting and analytics solutions. Key Responsibilities Design, develop, and maintain interactive dashboards and reports using Power BI Develop optimized data models (star schema, snowflake schema) to support business reporting needs Write advanced DAX calculations, measures, and KPIs Build and maintain ETL/ELT pipelines using Azure Databricks Develop and optimize SQL queries, stored procedures, and views Use Python for data transformation, automation, and advanced analytics tasks...