£450 - £500 per day
Outside Spy
Nottingham, UK
Azure Databricks Data Engineer | Outside IR35 | £450 - £500 | Hybrid | Nottingham We're looking for an experienced Data Engineer with strong Azure Databricks expertise to support the design, development, and optimisation of modern data platforms. You'll be responsible for building scalable data pipelines, managing large datasets, and delivering high-quality data solutions within an Azure environment. Key Skills & Experience Required
Strong hands-on experience with Python, PySpark, and SQL/Spark SQL for building production-grade ETL/ELT pipelines
Solid knowledge of Apache Spark, including DataFrames, joins, aggregations, partitioning, caching, and performance optimisation
Experience working within Azure Databricks, including clusters, job clusters, notebooks, repositories, jobs, and Databricks Runtime
Proven experience implementing Lakehouse architectures, including Bronze, Silver, and Gold data layers on Azure Data Lake Storage Gen2
Familiarity...