(1728) Data Engineer - BSTD

Brief description

The main purpose of this position is to design, develop and maintain data pipelines to collect, store, transform and deliver organisational data to enable data domains and business domains within the South African Reserve Bank (SARB).

Detailed description

The successful candidate will be responsible for the following key performance areas:

• Design and develop data engineering standards, processes and frameworks to ensure optimised solutions and adherence to best practice .

• Develop, construct, test and maintain data pipeline architectures.

• Ensure interoperability of systems by designing and maintaining integration patterns (e.g. application programming interfaces), data exchange formats and integration protocols.

• Design and build data pipelines that are robust, modular, scalable, deployable, reproducible and versioned for data domains and business domains.

• Quality-assure data pipeline implementations to ensure adherence to data engineering frameworks and standards.

• Recommend ways to improve data reliability, efficiency and quality.

• Monitor and optimise domain-specific data pipelines to ensure reliable data availability and sustained performance over time.

• Develop and manage stakeholder relationships to promote data management across the organisation and support reliable decision-making and appropriate data usage.

• Maintain documentation for data pipelines, integration processes and interoperability standards.

• Manage data growth patterns to plan infrastructure needs, ensure compliance with retention frameworks and support responsible data-sharing.

• Enable and support the technical implementation of data management capabilities, including data governance, data quality, metadata management, master and reference data management, data architecture and data modelling, data security and privacy, data life cycle and retention management, data cataloguing and lineage, and analytics enablement.