Databricks Data Engineer – Data Ingestion
6 months - £550 a day (outside IR35)
Location: UK – Hybrid/Remote
We are looking for an experienced Azure Databricks Data Engineer / Data Ingestion Engineer to join a large, global organisation.
The role is focused on data ingestion and engineering, connecting data from multiple sources and building robust pipelines within a modern Azure/Databricks environment.
Key Responsibilities
- Build and maintain data ingestion pipelines using Databricks.
- Connect to multiple data sources including SQL databases, APIs and Azure services.
- Develop pipelines using Azure Data Factory and Databricks Lakeflow.
- Implement appropriate ingestion strategies including incremental and batch loads.
- Develop ETL/ELT processes using Databricks Medallion Architecture.
- Write and maintain Python data engineering code.
- Use dbt for data transformation and modelling.
- Ensure pipelines are scalable, reliable and maintainable.
Key Essential Skills
- Strong commercial Databricks experience.
- Proven data ingestion experience.
- Azure Data Factory.
- Databricks Lakeflow.
- SQL and API integration.
- Medallion Architecture.
- Strong Python.
- dbt.
- Experience with incremental/batch data ingestion.
We’re looking for this person to be Immediate availability or able to start within 1-2 weeks.