Data Engineer/Data Engineering/Azure/Databricks/Ingestion/Pipelines/Financial Services (Insurance, Banking etc) - 2-3 month contract/Outside IR35/Fully remote/£350 - 500 per day.
One of our leading clients is looking to recruit a Data Engineer.
Location - fully remote/home based
Duration - 2-3 months plus possible extension
Day Rate - £350-500 per day Outside IR35
Role/Responsibilities:
- Define and build a data lake architecture on Azure (ADLS + Databricks)
- Implement layered data model (bronze/silver/gold) for ingestion, processing, and reporting
- Develop ingestion patterns from API sources (batch and streaming)
- Establish data governance, metadata, and access controls
- Define storage structures, naming conventions, and schema design
- Develop API connectors and ingestion pipelines using Python
- Implement integration services feeding into the Databricks environment
- Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation)
- Configure monitoring, logging, and alerting
- Execute unit and integration testing across pipelines
Experience:
- Azure
- Databricks
- Python
- Financial Services sector experience - Insurance or Banking etc