AWS Data Engineer - #336545

Deka Minas Pty Ltd T/A Deka Minas


Date: 2 weeks ago
City: Johannesburg, Gauteng
Contract type: Full time

Introduction

Company Description:

Our client is considered to be one of the most prominent and successful FinTech and Financial Services companies in South Africa.

About Us:

Deka Minas is the world's first subscription based professional services company. Our main lines of business are Human Capital Advisory and Recruitment Services in Sub-Saharan Arica, The Middle East and Southeast Asia.

Description

As an AWS Data Engineer within our clients Global Markets division, you will play a pivotal role in designing, developing, and maintaining data infrastructure and pipelines to support their global markets business. Collaborating closely with traders, quantitative analysts, and data scientists, you will leverage your expertise in AWS services, data engineering, and programming to create scalable and efficient data solutions.

Key Responsibilities:
- Develop data models for extracting information from diverse sources and storing it in a usable format.
- Lead the design, implementation, and successful delivery of large-scale data solutions involving significant data volumes.
- Utilize strong SQL skills and expertise in ETL processes and data modeling.
- Ingest data into AWS S3, perform ETL into RDS or Redshift, and use AWS Lambda (C# or Python) for event-driven data transformations.
- Design and implement security measures to safeguard data against unauthorized access or misuse.
- Maintain data integrity through the implementation of backup and recovery procedures.
- Automate migration processes in AWS from development to production environments.
- Deliver actionable data content to support business decision-making.
- Collaborate on all aspects of data engineering, including planning, estimation, analysis, architecture design, and implementation.
- Design complex data solutions spanning batch, streaming, and event-driven architectures across cloud, on-premises, and hybrid environments.
- Optimize cloud workloads for cost, scalability, availability, governance, and compliance.

Requirements:
- 5+ years of Python/C# development experience.
- 3+ years of AWS data engineering experience.
- Global Markets experience preferred.
- Proficiency in creating data products and conducting data analysis.
- Experience with AWS Glue Jobs using PySpark or AWS Glue Spark.
- Strong SQL skills and proficiency in C# or Python programming.
- Expert knowledge of data engineering packages and libraries.
- AWS technical certifications preferred.
- Experience with microservices development using serverless AWS services.
- Familiarity with SQL Server, MySQL, and scripting/automation tools.
- Ability to troubleshoot data issues effectively and efficiently.
- Experience in SDLC delivery methodologies, including waterfall, hybrid, and Agile.
- Demonstrated experience delivering data solutions and pipelines on the AWS Cloud Platform.
- Understanding of data modeling, data structures, databases, and ETL processes.
- Experience delivering CI/CD and DevOps capabilities in a data environment.

Benefits:
- Opportunity to work with cutting-edge technology in the financial sector.
- Dynamic and collaborative work environment with opportunities for professional growth and development.
- Exposure to global markets and leading financial institutions.
- Work-life balance initiatives and flexible work arrangements.

Application Process:
If you possess the skills and experience required for this exciting opportunity and are passionate about driving innovation in the financial sector, please submit your resume and cover letter detailing your relevant experience and qualifications. 

 

Please note that by submitting your personal information to Deka Minas you free-willingly issue the business consent to make use of such data for the specific purpose of securing you either permanent or temporary employment. Our business makes use of a POPIA compliant database and you have the right to access, right to correction and right to deletion of your personal information.



How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a CV

Similar Jobs

Product Development Technologist

iStaff Recruitment, Johannesburg, Gauteng
2 hours ago
Reference: CPT000257-GW-4We are looking for a Product Development Technologist in the flavour, ingredient and colour industry. It is essential that you have experience in flavour formulations within the sweet division. Requirements: Diploma/Degree – Food Technology/Food Science 2-5 years’ experience with product development Deadline driven  Strong verbal and written communication  Know how to put flavour/seasoning formulations together  Duties: Formulate new flavours ...

Actuarial Analyst

Network Finance., Johannesburg, Gauteng
4 hours ago
Reference: NFP013960-SHb-1Are you a talented and ambitious actuarial professional looking for an exciting new challenge? Look no further! We are looking for a dynamic Actuarial Analyst to join a leading Short-Term insurer in Cape Town. You will be responsible for providing support across all actuarial disciplines within the short-term insurance sector, with a focus on underwriting risk management, pricing, segmentation,...

Senior Finance Manager: Internal Reporting

Network Finance, Johannesburg, Gauteng
4 hours ago
Reference: NFR003262-BM-1My client, one of the most diversified JSE listed organizations, is seeking a Group Senior Finance Manager: Internal Reporting to join their amazing team. The successful candidate will be responsible for the operational implementation of the group and function strategy through implementing the defined, integrated response to the external environment and strategy and managing corporate finance functions of statutory...