Senior Data Engineer (Spark & Python Specialist)

Tumaini Consulting

Our client is seeking an experienced Senior Data Engineer to play a critical role in advancing a modern cloud-based data platform. This opportunity is ideal for a highly skilled engineer with deep Spark and Python expertise who enjoys solving complex data challenges, modernising legacy systems, and contributing to scalable, high-performance data solutions within a collaborative engineering environment.

Requirements:

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field
  • 6+ years of experience working with Spark and PySpark in production environments
  • Strong Python development experience, including reusable library development and testing
  • Solid T-SQL skills and experience translating complex business logic into scalable solutions
  • Experience with Azure Synapse Analytics, Dedicated SQL Pools, and Azure Data Factory
  • Hands-on experience with Delta Lake and Parquet within high-volume environments
  • Strong understanding of Spark internals, performance tuning, partitioning, and optimization
  • Experience with Docker and cloud-agnostic development practices
  • Strong communication, collaboration, and leadership abilities

Should you meet the requirements for this position, please email your updated CV attached to ***email_hidden***, alternatively contact 031 350 4018 or visit our website, www.tumaini.co. Correspondence will only be conducted with short listed candidates. Should you not hear from us within 3 days, please consider your application unsuccessful.