Outside Spy
London Area, United Kingdom
Hiring! Databricks Consultant Role Title: Databricks Consultant Location: London, Hybrid Duration: Initial 3 months Rate: Market Related Engagement: Outside IR35 We are seeking a seasoned Databricks Consultant with deep expertise in Energy & Commodities Trading to design, accelerate, and optimize our trading data platform. Acting as the bridge between trading desks, quants, and engineering teams, you will leverage the Databricks Lakehouse to deliver scalable, real-time pipelines powering trading decisions, risk management, and market analytics. Key Responsibilities Data Architecture: Build and optimize ETL/ELT pipelines using Databricks, Spark (PySpark/Scala), and Delta Lake for structured/unstructured energy market data. Trading Analytics: Partner with Quants, Risk Managers, and Traders to implement models, curve generation, position tracking, and risk metrics (e.g., VaR). Performance Optimization: Tune clusters and SQL warehouses for...