Data Engineer - Azure Databricks - Remote at MYO Talent, Remote, 3 Months, £Contract Rate

Data Engineer/Data Engineering/Azure/Databricks/Ingestion/Pipelines/API/Azure API Management (APIM)/Python/3-month contract/Outside IR35/Fully remote/£400 - 500 per day.

One of our leading clients is looking to recruit a Data Engineer.

Location - fully remote/home based

Duration - Initial 3 month

Day Rate - £400-500 per day Outside IR35

Role/Responsibilities:

• Define and build a data lake architecture on Azure (ADLS + Databricks)
• Layered data model (bronze/silver/gold) for ingestion, processing, and reporting
• Develop ingestion patterns from API sources (batch and streaming)
• Establish data governance, metadata, and access controls
• Define storage structures, naming conventions, and schema design
• Develop API connectors and ingestion pipelines using Python
• Implement integration services feeding into the Databricks environment
• Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation)
• Configure monitoring, logging, and alerting
• Execute unit and integration testing across pipelines

Core Skills:

• Azure
• Databricks
• Python

Desirable:

• Any exposure to Financial Services, Insurance or Bank/Banking would be beneficial but not essential