Having recently been bought out, our Finance Client were undergoing a change program in order to maximise profits and minimise resource utilisation. We were instructed to help assist the automation of various systems including accounting and actuary processes.
To build pipelines linking the newly built Enterprise Data Analytics Platform to various accounting tools, including the client’s managed Financial Accounting Hub, Blackline and Anaplan.
To work closely with Finance stakeholders to convert business requirements into code. To use pyspark to pipe the data from source to sink and perform various transformations, such as allocating monetary attributes correctly across coverages. Within this change programme, there was a replatforming exercise of which we have been pioneering the processes including writing the CI/CD steps. It was also necessary for us to create a custom build of Spark in order to comply with the security vulnerability monitoring purposes.
Python
Spark
Airflow
Jenkins
DataBricks
AWS
Docker
Kubernetes
Trino
Oracle
SQL Server
