Azure Databricks Data Engineer - OUTSIDE IR35 at 83Zero, City of London, £450-£550 per day

£450 - £550 per day
Duration not stated Information Technology

Contract Description

Databricks Data Engineer - Contract

Day Rate: £450 - £550 P/ day
Location: Hybrid (Remote / 2 Days a week in London)
Start: Immediate Start
Note: Capital Markets, or at least Banking experience is a MUST!

Key expertise and experience we're looking for:

  1. Data Engineering in Databricks -
  • Spark programming with Scala, Python, SQL
  • Ideally experience with Delta Lake
  • Databricks workflows, jobs, etc.
  1. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks
  2. Data Governance experience - Metadata, Data Quality, Lineage, Data Access Models
  3. Good understanding of Data Modelling concepts, Data Products and Data Domains
  4. Unity Catalog experience is a key differentiator - if not then experience with a similar Catalog/Data Governance Management component
  5. MS Purview (Metadata and Data Quality tool) experience is a bonus - experience in similar tools is valuable (Collibra, Informatica Data Quality/MDM/Axon etc.)
  6. Data Architecture experience is a bonus
  7. Python, Scala, Databricks Spark and Pyspark with Data Engineering skills
  1. Ownership and ability to drive implementation / solution design