7 azure databricks engineer jobs found

Job Ref :- 843 | Senior Data Engineer (GCP) ( Hybrid | GCP Hybrid | Outside IR35) Apply via LinkedIn or Email your CV to:- HR@AGITCONSULTANCY.CO.UK About the Role We are looking for an experienced Senior Data Engineer to lead the design, development, and optimisation of our cloud-based data infrastructure. This role will take technical ownership of key data engineering initiatives, mentor junior team members, and ensure the security, scalability, and reliability of our data platform. Working closely with engineering, analytics, and security stakeholders, you will play a critical role in enabling data-driven decision-making across the business. Key Duties, Responsibilities & Accountabilities Data Architecture & Engineering Leadership Lead the design and implementation of robust, secure, and scalable data pipelines using ELT/ETL patterns. Develop and promote best practices around modular pipeline design, orchestration, and data transformations....

London - 1 or 2 days per week onsite - City of London 6 months contract £570 per day - Outside IR35 Senior Application Developer London - Hybrid working (1 - 2 day per week office visit required) 6 months contract - £570 per day - Outside IR35 About the Role We are looking for a Senior Application Developer to design and build a robust PostgreSQL-based data platform that will underpin our investment reporting, risk analytics, regulatory disclosures and performance measurement. This is a genuinely high-impact, greenfield opportunity. You will have real ownership of the platform design and lead the migration away from Databricks and Excel-driven processes - leaving a lasting mark on infrastructure that sits at the heart of our investment operations. What You'll Be Doing You will lead the design and build of a scalable, secure PostgreSQL data platform to support: Portfolio holdings and valuations Performance and attribution reporting Risk analytics...

Sibling is seeking a Freelance Data Engineer to architect a green-energy analytics platform. This is a hands-on, high-scale role focused on processing global telemetry data. Bio Architect & Code: Build robust, scalable ETL pipelines using PySpark and Databricks. Optimize: Refactor existing Spark jobs for maximum performance and cost-efficiency. Integrate: Deploy production-grade solutions within Azure (Unity Catalog, Delta Lake). Collaborate: Act as the technical bridge between Data Science and Business stakeholders. Expertise: Deep, recent experience in PySpark and large-scale Databricks environments. Cloud: Strong Azure experience (ADF, ADLS Gen2). DevOps: Proven track record with CI/CD, Git, and data engineering best practices. Compliance: Must have the Right to Work in the UK (No sponsorship available). Contract Details: Rate: Competitive Market Day Rate. Timeline: Kick-off in April, running through year-end. Assessment: Confirmed Outside...

Our sister company Stellarmann is seeking an experienced Data Engineer to support a London Market Insurance client in building a modern Azure data environment. The Data Engineer will work alongside the wider team in building a modern Data Lakehouse with three tiers. We're seeking someone with: Proven experience as a Data Engineer Strong hands on experience with Azure Databricks and Azure Data Factory Experience in the Lloyd's/London Market (specialty insurance) Proficiency in Python Experience with SQL Server Exposure to DevOps automation and deployment pipelines (YAML) Experience working with Medallion architecture/tiered medallion Lakehouse Strong understanding of Delta Lakes and Delta Tables Experience using Databricks Notebooks for data pipelines The initial engagement will run until early September 2026 and the role is paying a competitive day rate outside IR35, offering hybrid working in the London office (2 days per week). If this...

Senior Power BI Consultant - Outside IR35 Location: Central London (2-3 days on-site) Contract: 6-12 months, Outside IR35 Industry: Oil & Gas/Commodity Trading Role Summary A leading energy & commodity trading business is looking for a Senior Power BI Consultant to support ongoing analytics and data-modelling work. The role blends hands-on BI development with business engagement. Key Responsibilities * Build and optimise Power BI dashboards, semantic models, and data flows. * Lead data modelling across complex trading datasets. * Translate business requirements into technical specifications for offshore developers. * Ensure best practice in DAX, SQL, and BI design. * Work within the organisation's Databricks environment (platform familiarity expected). * Provide leadership, guidance, and clear communication to both business and technical teams. Required Skills * Expert-level Power BI, DAX, and data modelling. * Strong SQL and experience with large datasets. *...

Databricks Architect/Consultant 3-Month Contract - Discovery Engagement - £750 per day Outside IR35 A leading international organisation within the building materials and distribution sector is undertaking a strategic modernisation of its data platform and is introducing Databricks as a core capability within its future data architecture. To support this initiative, we are seeking an experienced Databricks Architect/Consultant to deliver a 3-month discovery and architecture engagement working closely with internal Data Engineering teams. The purpose of this engagement is to assess the current data landscape and design the target-state Databricks architecture, alongside a clear and pragmatic migration roadmap. The existing data environment includes Azure Synapse, Informatica, and FOCUS, and the consultant will play a key role in determining how these capabilities evolve as the organisation transitions to a modern lakehouse architecture. This role is discovery and...

Power BI & Databricks Developer- Outside IR35 - Hybrid Job Summary We are seeking a skilled and detail-oriented Power BI Developer with strong expertise in Databricks, SQL, Data Modeling, DAX, and Python. The ideal candidate will be responsible for designing, developing, and maintaining scalable BI solutions that transform complex data into actionable business insights. You will work closely with stakeholders, data engineers, and analytics teams to deliver high-quality reporting and analytics solutions. Key Responsibilities Design, develop, and maintain interactive dashboards and reports using Power BI Develop optimized data models (star schema, snowflake schema) to support business reporting needs Write advanced DAX calculations, measures, and KPIs Build and maintain ETL/ELT pipelines using Azure Databricks Develop and optimize SQL queries, stored procedures, and views Use Python for data transformation, automation, and advanced analytics tasks...