Senior Data Engineer

Job Title: Senior Data Engineer Job Type: Contract – Remote Location: South Africa Department: Data & Analytics Reports To: [Head of Data Science / Director of Analytics / CTO} Key Responsibilities: Lead the design, development, and maintenance of scalable data pipelines and systems. Implement and oversee data integration solutions to consolidate data from various sources. Optimize data architecture and data flow for performance, reliability, and scalability. Collaborate with data analysts, scientists, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing, validation, and monitoring. Develop and maintain ETL processes to extract, transform, and load data. Monitor, troubleshoot, and improve data systems to ensure smooth operation. Stay updated with the latest industry trends and technologies to continuously enhance data infrastructure. Mentor and guide junior data engineers and other team members. Qualifications: Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or a related field. Extensive experience as a Data Engineer or in a similar role, with a proven track record of building and maintaining data infrastructure. Proficiency in advanced data engineering tools and technologies (e.g., SQL, (Python – AI/ML libraries), Hadoop, Apache Spark, Git and Github, Google Colab, AutoML platforms) Strong understanding of database management systems, data warehousing, and big data technologies. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) is highly desirable. Excellent problem-solving skills and attention to detail. Skills: Ability to design and implement complex data systems. Proficiency in programming languages such as Python, Java, or Scala. Experience with big data technologies and frameworks. Knowledge of data modelling and database design. Ability to work independently and lead a team. Strong analytical and troubleshooting skills. Leadership and mentoring abilities. Benefits: Competitive salary. Opportunities for professional development and growth. Remote working hours Leadership opportunities within the data engineering team