£500 - £600 per day
Outside Spy
Newcastle upon Tyne, UK
SC Cleared Databricks Data Engineer - Hybrid - Outside IR35 We are seeking a skilled Databricks Data Engineer to design, build, and optimize scalable data pipelines and analytics platforms. In this role, you will work closely with data scientists, analysts, and product teams to deliver reliable, high-performance data solutions using Databricks and modern cloud technologies. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake Build and optimize ETL/ELT workflows for batch and streaming data Develop data models to support analytics, reporting, and machine learning use cases Ensure data quality, reliability, and performance across data platforms Integrate data from multiple sources including APIs, databases, and cloud storage Collaborate with data scientists and analysts to enable advanced analytics and ML workloads Implement monitoring, logging, and cost-optimization best practices...