Lead Data Engineer (Databricks) at Dunbar Brown Group, London Area, £Contract Rate

Dunbar Brown Group is currently supporting a customer to engage with a day rate contractor on an initial 6 month piece of work. Due to the sensitive nature of the work, the consultant is required to be on-site in London 5 days per week. The role has been scoped as outside IR35.

Key Responsibilities

• Design, develop and deploy production-grade data engineering solutions using Databricks and dbt.
• Take hands-on responsibility for coding, implementation and deployment within the relevant platforms.
• Suggest improvements to engineering practices covering CI/CD, testing, version control and deployment processes.
• Design and implement effective metadata management, monitoring, alerting and operational controls.
• Contribute to the architecture and development of scalable enterprise data solutions.
• Support the evolution of engineering standards, technical processes and operational practices.
• Identify potential architectural and delivery challenges, applying lessons learned from previous implementations.
• Advise engineers, architects and business stakeholders to translate requirements into effective technical solutions.
• Support ways for the permanent team to establish a culture of engineering quality, maintainability and continuous improvement.

Required Skills

• 5+ years of professional experience in data engineering or a closely related technical discipline.
• Strong hands-on experience developing and deploying solutions using Databricks.
• Hold the certification of Databricks Certified Data Engineer Professional
• Proven practical experience with dbt, including coding and deployment
• Strong AWS experience - essential.
• Solid understanding of data engineering principles, including CI/CD, testing, metadata management, monitoring and alerting.
• Experience designing and implementing data engineering solutions within complex technical environments.
• Experience establishing or improving engineering standards and operational practices.
• Ability to provide technical guidance while remaining actively involved in delivery.
• Excellent communication skills, with the ability to articulate technical decisions and influence stakeholders.