Data Engineer

About

Description

As a Data Engineer at Senior Associate 2 level within the Data Enablement Competency, you will build and maintain reliable data pipelines and contribute to DataOps practices that support high-quality, scalable data solutions. You will be hands-on in developing ingestion, transformation, and orchestration components; implementing testing and deployment processes; and supporting operational stability. You will collaborate closely with managers, architects, and analysts, mentor junior team members, and contribute to Agile delivery across sprints.

Responsibilities

• Design, develop, and maintain data ingestion, transformation, and loading pipelines across cloud (AWS/Azure) and hybrid environments
• • Implement data quality checks and automated tests (unit, integration, and data validation) to ensure reliability and accuracy
• • Contribute to DevOps/DataOps practices: Git-based version control, CI/CD pipelines, environment management, and Infrastructure as code (IaC)
• • Participate in Agile delivery: refine requirements, estimate work, deliver user stories, and provide regular progress updates
• • Monitor, troubleshoot, and optimise data pipelines for performance, cost, and scalability; support SLAs and participate in on-call/rotation as needed
• • Work with data architects and platform engineers to align implementations with solution designs, standards, and best practices
• • Create and maintain technical documentation, runbooks, and deployment guides; present demos and knowledge shares
• • Participate in code reviews and uphold coding, security, and governance standards (including handling of sensitive/PII data)
• • Assist with releases and change management across environments (dev/test/prod)
• • Provide guidance to Associates/Interns on tooling, coding standards, and development practices

Qualifications

• Bachelor’s degree or Diploma in Computer Science, Information Systems, Engineering, or related field; relevant certifications advantageous (e
• g
• , Azure Data Engineer, AWS Data Analytics, Databricks, Snowflake, Terraform)
• • 2+ years of hands-on experience delivering production-grade data engineering solutions
• • Proficiency in SQL and Python; solid understanding of ETL/ELT patterns and data warehousing concepts (e
• g
• , star/snowflake schemas)
• • Experience with one or more data platforms/tools, such as: – Azure: Data Factory, Synapse, Databricks – AWS: Glue, EMR, Redshift, Lambda – Other: Spark, Snowflake, Airflow, Kafka/Event Hubs, dbt • Familiarity with CI/CD and version control (e
• g
• , Azure DevOps, GitHub/GitLab, Jenkins) and IaC (Terraform, CloudFormation, etc
• )
• • Experience implementing data quality and testing frameworks (e
• g
• , pytest, Great Expectations, Deequ) and using logging/monitoring tools (e
• g
• , CloudWatch, Azure Monitor)
• • Working knowledge of Agile methodologies and delivery within sprints
• • Strong problem-solving, collaboration, and communication skills; attention to detail; ability to manage multiple tasks
• • Awareness of data governance, security, and privacy best practices (RBAC, encryption, POPIA/GDPR) is advantageous

Application instructions:

• Apply Urgently!