Contract - Big Data Engineer (Python) - Oil Trading - Outside IR35 at Olive Delta, London, 12 Months, £600-£650 per day

£600 - £650 per day
  • Outside Spy
  • London, UK
  • Jul 14, 2021
6 Months or more

Contract Description

Contract - Big Data Engineer (Python) - Oil Trading - Outside IR35

Large global Oil Trading company has just initiated a multi-year Digitalisation Program, to transform how data is managed and utilised within the business. The vision is to build the next generation of big data infrastructure. With the support of a big data platform, the successful candidate will develop a range of data-driven, highly automated AI/ML models to facilitate and enhance the trading business, as well as optimisation of physical assets.

You will be joining this ambitious program from Stage One as part of the Data Team working on the Digitalisation Program. Working together with the rest of the Data Team, you will be developing the next generation of Data Infrastructure, on which you will use your knowledge of data cleansing, blending, analysis, and machine learning methods to help automate and optimise the business processes. You will be creating tools to support Data Science projects for the rest of the company following the company\'s deployment processes.

The role:

  • Develop, construct, test and maintain data architectures.
  • Develop data driven analytical tools
  • Develop automated cleansing, pre-processing and delivery of data for prescriptive and predictive modelling
  • Develop data visualisation and Business Intelligence toolsets
  • Working with Data Scientists to build out scalable AI and ML models
  • Liaise with the Technology team in terms of hardware resource requirements and support
  • As part of the Digitalisation project team, build and support robust, scalable, cloud based data solutions
  • Take ownership of the assigned projects, including understanding and gathering requirements, designing the solutions, building and maintaining completed industrialised solutions.
  • Good understanding of SDLC and how to apply this to manage the code from creation to deployment to production in a controlled auditable manner
  • Experience of CI/CD tools such as Git, Jenkins, JIRA, Octopus etc.

Your background:

  • Significant demonstrable experience in Big Data Platform Hive/Hadoop/Kafka/Spark
  • Significant demonstrable experience in commercial software development
  • Expertise in Python
  • IAC (Infrastructure As code) Tools such as Terraform, Ansible
  • Experience with Data Warehousing
  • Experience with relation SQL and NoSQL databases
  • Experience with cloud services (AWS/Azure)
  • Working knowledge of message queueing, stream processing and highly scalable big data\' data stores
  • ETL
  • Linux + Bash Scripting Experience
  • Experience in developing and supporting analytical models/tools
  • Strong analytical skills related to working with unstructured datasets
  • Knowledge of commodity markets is preferred
  • Project management experience is preferred but not essential