Technical Lead - Data Engineer

AES Global

Technical Lead - Data Engineer

Location Cape Town, South Africa
Employment Type Full Time
Seniority Level Senior
Experience 5 to 20 years
Remuneration R900 000 to R1 000 000
Remuneration Type Cost to company
Remuneration Frequency Monthly
Benefits Medical Aid Contribution; Provident Fund Contribution; Performance Bonuses; Flexi Hours
14/04/2020 Reference Number: AES1322349816


  • Apache Hadoop
  • AWS
  • Big Data
  • Cloud Architecture
  • Python
  • SQL

Job Description

We are proudly supporting the leading FMCG company in southern Africa right now, on a really exciting search for a Technical Lead within Data Engineering. This is an incredible opportunity to work at the forefront of the industry, with incredible minds and leading talent.

Working as a core member of an Agile team, you will hold responsibility for building and supporting data pipelines. You must be experienced in handling raw data, from a broad range of sources and integrate them seamlessly.

You will enable solutions, using emerging technologies across the big data and cloud spaces.



  • Talend
  • AWS: EMR, EC2, S3
  • Python
  • PySpark or Spark
  • Business Intelligence Data modelling
  • SQL


Key responsibilities:

- Responsible for data solution software and hardware required.

- Strategic thinker, understanding the commercial requirements and translates them into system requirements.

- You must have experience of building DA frameworks; you will architect next-generation analytics framework. This will be developed on the Group’s range of core technology.

- Build a strong working relationship with developers, you will be responsible for making sure data solutions are integrated.

- You will Build automation tools, ensuring that all automated processes preserve integrated data.

- You will liaise with key stakeholders across the business, Interpreting data results for business customers.

- You will work with the business to maintain a fully adaptable technical solution.

- This role is responsible for communication across third parties and product managers (tech/non-tech) on solution design.

Candidate Requirements:

- Bachelor's in computer science, computer engineering

- AWS Certification – this must be from Associate +

- Data engineering or software engineering experience 5+ yrs

- Experience of leading a team of engineers 3+ yrs

- Big Data, ETL, Could AWS

- Agile or similar/ Scrum

- Experienced coding and testing pattern

- Creating data channels from on-site to AWS Cloud 2 + yrs

- Talend or similar

- Data manipulation using python and pyspark

- Hadoop paradigm for processing data

- Experienced in devops across Big Data and BI, including automated testing and deployment


Company Description

A market pioneer, leading the way in the FMCG industry and thriving even in these uncertain times. An incredible opportunity to be part of one of the highly regarded Groups in the African continent. You will have the opportunity to thrive professionally and work in a dynamic and forward thinking team. 

Apply Now
Report this job
If you want to apply for the advertised job, please contact the company at the top of the page. Don't contact Ditto Jobs.