Senior Data Engineer: Pretoria

Arid Talent Solutions CC

Senior Data Engineer: Pretoria: FTC: 3x Year Project

Essential Skills Requirements

  • Hands-on experience with Kafka and event streaming platforms for real-time data movement
  • Proven experience with API integration patterns, webhooks and event/webhook ingestion
  • Strong proficiency in Python for data engineering, ingestion pipelines and automation
  • Strong proficiency in Java for stream processing or connector development
  • Solid competence with enterprise databases and query languages, including performance tuning and query optimisation for OLTP/operational workloads
  • Experience with NoSQL/document stores such as Amazon DynamoDB, MongoDB.
  • Experience in data modelling to design schemas and standardised data representations
  • Experience with schema registries and contract-first designs (Avro, Protobuf) to manage producer/consumer compatibility
  • Strong understanding and practice of data quality techniques and tooling to ensure trusted data
  • Knowledge of metadata management and cataloguing to support discoverability and lineage
  • Familiarity with ETL/ELT patterns and best practices for performant, reliable data pipelines
  • Observability for streaming: experience with metrics, tracing and logging on AWS (CloudWatch, OpenTelemetry, Prometheus/Grafana)

Qualifications / Experience

  • Extensive hands-on experience (typically 6+ years) in data engineering, integration or streaming roles with demonstrable production experience
  • Proven track record building and operating streaming platforms (Kafka/MSK) and API-based integrations, with strong Python and Java skills and experience with enterprise databases and query languages
  • Strong analytical thinking, curiosity about data, attention to detail, structured problem solving and ownership: able to drive topics to completion

Preferred certifications: Confluent Certified Developer for Apache Kafka, Microsoft streaming event hubs, AWS Certified Data Engineer

Qualifications/Experience

  • Extensive hands-on experience (typically 6+ years) in data engineering, integration or streaming roles with demonstrable production experience
  • Proven track record building and operating streaming platforms (Kafka/MSK) and API-based integrations, with strong Python and Java skills and experience with enterprise databases and query languages
  • Strong analytical thinking, curiosity about data, attention to detail, structured problem solving and ownership: able to drive topics to completion
  • Preferred certifications: Confluent Certified Developer for Apache Kafka, Microsoft streaming eventhubs, AWS
  • Certified Data Engineer

Please email a copy of your updated CV

***email_hidden***