Sr. Data Engineer with Data Bricks

Job description:

Responsibilities:

1. 7 years or more relevant software development experience with a fairly "Full Stack" profile
2. Experience of delivery within a trading environment.
3. Experience working in fast-paced project delivery using AGILE methods.
4. Strong software development skills, knowledge of best practices (SOLID, CI/CD, etc.)
5. Python 3
6. Creating applications and packages.
7. Writing reliable unit and end-to-end tests with PyTest.
8. Data manipulation with Pandas.
9. Web development with Python.
10. MS Azure: virtual networks, key vaults and storage, security.
11. MS DevOps pipelines.
12. Kubernetes containers.
13. ReactJS front end development experience.
14. MS SQL backend development experience.
15. Experience in developing APIs in Python using FastAPI .
16. Hands on in ADF and Azure Databricks.

Desirable:

1. Knowledge of physical commodities trading markets and organisations (esp. Client/gas/oil).
2. Useful to have Data Engineering experience blended along with core software engineering experience.
3. Experience of working directly with traders on trader models.
4. Python: Bokeh visualization, Tornado web framework, asyncio programming, Azure Python API.
5. Hashicorp Terraforms (azurerm).
6. Kafka Confluent.
7. Conda package management.
8. Basic knowledge in numerical calculus, such as multi-dimensional function interpolation, numerical differentiation.
9. Basic understanding of the WebSockets protocol.
10. Knowledge of the OAuth2 and web security.
11. Basic knowledge of modern JavaScript, TypeScript, Node.js.

Personal Attributes:

1. A determined focus on the user and user experience when problem-solving.
2. Team player and able to collaborate, proactively communicates and shares understanding and experience within a team.
3. Clear communicator and able to work in a multicultural/lingual environment.
4. Uses initiative and owns their deliverables end-to-end.
5. Brings ideas to the table, is inquisitive and excited by new technology.
6. Used to working in a flexible, independent manner on a mixture of small unstructured and large structured items.
7. Provides regular, considered feedback and regularly strives to improve their own ways of working.