Technology

Data Engineer

Huzzle.com·South Africa, south-africa·Full Time·Remote
TechnologyMid levelFull TimeRemote
-
About Huzzle

At Huzzle, we connect exceptional talent with exciting opportunities at leading companies across the UK, US, Canada, Europe, and Australia. We work with a diverse range of clients, including startups, digital agencies, and technology-driven businesses across industries such as SaaS, MarTech, FinTech, and AI.

Unlike traditional outsourcing agencies, we place you directly with our clients, where you become an integral, in-house member of their team.

Job Type: Full-time

Location: Remote

Job Summary

As a Data Engineer, you will play a key role in designing, developing, and maintaining scalable data pipelines and infrastructure. You will collaborate with data analysts, data scientists, software engineers, and business stakeholders to ensure data is reliable, accessible, and of high quality across the organisation.

This is a great opportunity for professionals who enjoy tackling complex data challenges and building robust systems that power business intelligence, analytics, and machine learning initiatives.

Key Responsibilities

  • Design, build, and maintain scalable ETL and ELT data pipelines
  • Develop and optimize data architectures, databases, and data warehouses
  • Integrate data from various sources, APIs, and third-party platforms
  • Maintain data quality, accuracy, consistency, reliability, and security
  • Monitor, troubleshoot, and improve data pipelines and workflows
  • Work closely with analytics, engineering, and business teams to identify and meet data requirements
  • Establish data governance standards and best practices for data management
  • Improve data storage, processing speeds, and query performance
  • Support business intelligence, reporting, and analytics projects
  • Maintain documentation of data models, workflows, and technical processes

Requirements

  • 2+ years of experience in data engineering, data warehousing, or a similar field
  • Strong SQL skills and a solid understanding of database management
  • Proficiency in Python, Java, Scala, or other relevant programming languages
  • Practical experience with ETL/ELT tools and building data pipelines
  • Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform
  • Hands-on experience with modern data warehouse solutions such as Snowflake, Redshift, BigQuery, or Databricks
  • Knowledge of workflow orchestration tools such as Airflow or Prefect
  • Understanding of data modelling, governance, and data quality best practices
  • Experience handling large datasets and working with distributed systems is an advantage
  • Strong analytical thinking, problem-solving, and communication abilities
  • Comfortable working independently while collaborating with a remote team

Benefits

💰 Competitive compensation: Tailored to your experience, technical skills, and location.

🌎 Fully remote work: Enjoy the flexibility to work from anywhere.

🚀 Career development: Join innovative companies and contribute to meaningful, high-impact projects.

📈 Long-term potential: Grow your career alongside ambitious, expanding global organisations.

🧠 Ongoing learning: Gain exposure to emerging data technologies, cloud platforms, and large-scale data environments.

🤝 Collaborative environment: Work with skilled engineers, analysts, and business stakeholders.

⚙️ Modern tech stack: Work with cutting-edge data tools, technologies, and cloud-based solutions.

At a glance

Company

Huzzle.com

Location

South Africa, south-africa

Employment

Full Time

Experience

Mid level

Valid until

Not specified

Created

November 6, 2026

More opportunities

Similar roles you might like

Business Analyst

Boardroom Appointments

Remote, south-africa

Full Time

Minimum requirements: Bachelor's degree in a relevant field (e.g., Business, Computer Science, Data Science). Proven experience as a Business Analyst, with a track record of successful projects. Strong SQL skills and experience in working with databases. Familiarity with reporting tools (e.g., Tableau, Power BI) and dashboard creation. Understanding of artificial intelligence, analytics, and their applications. Knowledge of data warehousing and virtual warehouses. Proficiency in data integration principles. Agile experience or certification is a plus. Responsibilities: Data Analysis and Management Utilize data analysis techniques to extract insights and support informed decision-making. Work with structured and unstructured data to identify trends, patterns, and anomalies. Collaborate with data engineers and scientists to ensure data quality and accuracy. SQL Expertise Proficiently write and optimize SQL queries to retrieve and manipulate data from databases. Reporting and Dashboarding Develop and maintain reporting solutions using reporting tools and dashboards. Create user-friendly, interactive dashboards to communicate insights to stakeholders. AI and Analytics Understand the fundamentals of artificial intelligence and analytics, contributing to data-driven strategies and projects. Data Warehousing and Virtual Warehouses Have knowledge of data warehousing concepts and the use of virtual warehouses for scalable data storage and retrieval. Data Integration Collaborate with IT teams to ensure smooth data integration, bridging gaps between systems and sources. Identify and implement data integration solutions to consolidate and streamline data resources. Agile Methodology Work in an Agile environment, participating in sprint planning, backlog grooming, and other Agile practices. Originally posted on Himalayas

16 hours ago

Head Of Data Analytics

Mindworx Consulting

Johannesburg, Gauteng, south-africa

FULL_TIME

The Tech Stack Deep-Dive Technical Landscape & Qualifications Architecture & Modelling: Medallion Architecture, Kimball Dimensional Modelling, Master Data Management (MDM), Conceptual/Logical/Physical Data Modelling, Semantic Layer Design Cloud & Platform: Microsoft Azure, Databricks, scalable ETL/ELT data pipelines Analytics, BI & AI: Advanced Power BI/BI semantic models, KPI frameworks, Predictive Analytics, Machine Learning & Generative AI readiness foundations Governance & Quality: Enterprise data catalogs, lineage tracing, data quality automation, metadata management Must-Haves: Proven track record leading modern data engineering and analytics capabilities (up to 12 years of progressive experience). Solid hands-on background with Azure , Databricks , Medallion architecture , and Kimball modelling . Deep expertise in enterprise data governance, MDM, and chairing data governance councils/committees. Bachelors Honours Degree / NQF Level 8 (Management Sciences, Business Process Management, or Computer Science). Certified Data Management Professional ( CDMP ) credential. Prior advisory, consulting, or leadership experience within a professional services or legal firm environment. Nice-to-Haves: Direct experience operationalizing LLMs, Generative AI, and machine learning pipelines on governed enterprise data. Hands-on expertise with cloud cost optimization and FinOps for Azure/Databricks environments. Key Responsibilities Architect the Modern Data Platform: Own and scale the Azure and Databricks data platform using medallion design patterns, ensuring robust data lineage, ingestion reliability, and cost-effective cloud performance. Lead Enterprise Data Governance: Chair the Data Governance Committee, establishing enterprise-wide stewardship, unified business glossaries, authoritative single-source-of-truth definitions, and automated data quality controls. Deliver Governed BI & AI Readiness: Build governed semantic models and self-service analytics to reduce operational reporting dependencies while structuring data foundations for production-grade AI and machine learning initiatives. Why Join Us Direct Strategic Impact: Lead a high-visibility practice with significant executive backing, shaping decisions that impact firm-wide strategy for years to come. Modern Stack & High Autonomy: Freedom to architect enterprise systems using modern cloud patterns (Databricks, Medallion) without being weighed down by legacy operational sprawl. Hybrid & Dynamic Work Environment: Enjoy a flexible balance of virtual and office-based collaboration within an elite, high-performance professional services firm.

a day ago

Senior Python Developer Ai & Machine Learning

Psybergate (Pty) LTD

Johannesburg, Gauteng, south-africa

FULL_TIME

What you will be doing: Design, develop, and maintain high-performance Python applications supporting AI and machine learning use cases. Develop scalable, maintainable and production-ready software using sound software engineering principles. Design and implement APIs, services, integrations and backend components as required. Participate in peer code reviews and promote coding standards, clean code and best practices. Build and maintain data processing and ETL/ELT pipelines in distributed environments. Contribute to the deployment, monitoring and ongoing optimisation of AI/ML applications and services. Implement automated monitoring, logging, alerting and reliability mechanisms for production systems. Work with DevOps, Data Engineering, Data Science and other technical teams to deliver robust solutions. Troubleshoot and resolve complex technical and production issues. Mentor junior developers and contribute to the continuous improvement of development practices. Collaborate with stakeholders to translate business and analytical requirements into effective technical solutions. Contribute to improving system performance, scalability, reliability and operational resilience. What we are looking for: BSc in Computer Science, Software Engineering or a related field. Transcripts required. 5+ years of professional experience developing applications using Python. Strong software engineering fundamentals and experience building production-grade systems . Strong understanding of software design principles, including SOLID principles and clean architecture. Experience developing APIs, services and/or distributed applications. Experience with Git, CI/CD and automated testing. Strong debugging and problem-solving capabilities. Experience working with cloud platforms such as AWS, Azure or GCP. Experience working with databases, data processing or ETL/ELT pipelines. Understanding of application performance, scalability, monitoring and reliability. Strong communication and collaboration skills, with the ability to work across software engineering, data and business teams. An ownership mindset with a focus on quality, reliability and continuous improvement. AI / ML & MLOps Experience Advantageous: Experience developing or supporting applications within AI/ML environments. Exposure to ML lifecycle management and productionisation of machine learning models. Experience with MLOps platforms or tools such as MLflow, Kubeflow or similar. Experience with distributed processing frameworks such as Spark, Ray or similar. Exposure to cloud AI/ML services such as Vertex AI or equivalent. Experience with technologies such as BigQuery, Cloud Composer or similar data/ML platforms. Experience working in large-scale data environments and distributed systems. Please note that if you do not hear from us within 3 weeks, consider your application unsuccessful. Please note that most of our positions are remote; however, candidates should reside within travelling distance of the client site, as the working arrangements may change depending on business requirements. Follow for the Latest Vacancies Join Psybergate Careers Channel here:

a day ago

Developer Ii | Retail It | Bi

Allan Gray Proprietary Limited

Western Cape, south-africa

full-time

Job Summary Join the Retail IT Data Platform and Warehousing Development team in modernising and evolving both our Microsoft SQL Server-based data warehouse and Snowflake-based analytical platform. The role contributes to the development, support, and evolution of data products and operational processes across both environments, while helping establish modern DataOps practices. Job Responsibilities Design, develop, and maintain data pipelines and data products using Snowflake, Microsoft SQL Server and MSSQL Data tools (SSIS, SSRS, SSAS), Python, and Dagster. Develop and optimize ELT workloads, stored procedures, data models, and transformation logic to support analytical and operational reporting requirements. Build and maintain Dagster assets, schedules, sensors, and orchestration workflows to ensure reliable and observable data processing. Design and implement data models for both operational and analytical use cases, applying appropriate warehousing and dimensional modelling techniques. Troubleshoot and resolve data quality, pipeline, orchestration, and platform issues across Snowflake and SQL Server environments. Analyze and optimize query performance, pipeline execution, warehouse utilization, and storage strategies. Develop automated testing, reconciliation, and data validation mechanisms to improve platform reliability and data quality. Contribute to CI/CD pipelines, deployment automation, source control standards, and engineering best practices. Implement monitoring, alerting, observability, and operational controls to improve platform availability and supportability. Collaborate with architects and senior engineers to modernize legacy ETL processes and evolve the team's data platform architecture. Conduct code reviews and contribute to technical design discussions, ensuring solutions align with team standards, security requirements, and architectural principles. Create and maintain technical documentation, platform runbooks, operational procedures, and support artefacts. Investigate emerging technologies and contribute to technical spikes and proof-of-concepts that improve platform capabilities. Provide production support for critical data platforms, participating in incident diagnosis, root-cause analysis, and resolution activities Requirements 3-5 years' experience in data engineering, data warehousing, BI development, or a related field. Strong SQL skills with experience developing and troubleshooting complex queries. Experience building and supporting ETL/ELT pipelines. Understanding of dimensional modelling and data warehousing concepts. Experience working with large datasets and data integration processes. Exposure to cloud platforms such as AWS or Snowflake. Experience with Git-based source control and development workflows. Understanding of CI/CD concepts and deployment automation. Familiarity with Infrastructure-as-Code concepts. Experience supporting production data platforms and resolving operational issues. Understanding of monitoring, logging, and observability principles. Exposure to automated testing and data quality practices. Strong troubleshooting and analytical skills. Experience with Python, SQL, MSSQL or similar data engineering technologies. Understanding of software development lifecycle practices. Familiarity with Agile delivery methodologies. Skills and Competencies Attention to detail and quality of work. Ability to take initiative and responsibility. Strong analytical skills. Good communication Provide accurate estimates Present solutions clearly Ability to work well under pressure and meet deadlines without sacrificing quality. Education Degree or diploma in information science or related technical discipline Knowledge of financial concepts and terms and interested in attending courses to improve business knowledge Financial Services industry experience would be an advantage Deadline:10th November,2026

a day ago

Senior Developer: Sql And Reporting (western Cape)

BDO South Africa

Western Cape, south-africa

full-time

Primary Purpose of the Job We are hiring a meticulous data professional to fulfil a hybrid role that combines SQL development, report creation, and data engineering. This role is accountable for designing and managing robust data pipelines, developing and tuning SQL queries, and building and maintaining the enterprise data warehouse. The candidate will also produce highquality reports and dashboards, translating data into clear, actionable insights that enable informed business decisions across the organization. Main Duties and Responsibilities Design, develop, and optimize complex SQL queries, stored procedures, functions, and scripts. Ensure that all database systems are maintained and enhanced to meet the organisation's requirements for data integrity, security, and availability. Create and restore databases Monitor database performance, implement changes, apply new patches and versions when required Create Server agent jobs Build, manage and support data warehousing solution and contribute to the development of data models. Ability to establish ODBC connections between different types of databases and platforms Create linked servers. Create data integrations with various servers and datasets. Develop and maintain operational, financial, and ad-hoc reports using SQL-based reporting tools (e.g., SSRS, Power BI) Ensure data accuracy and consistency in all reports and dashboards. Design and implement data pipelines and ETL processes for integrating data from various sources. Work with large datasets, ensuring data reliability, consistency, and scalability. Create and maintain documentation on database design, ETL processes, and report development. Work closely with the developers on projects to assistance with the database structure and relationships Requirements Qualifications Grade 12 Degree or Diploma in Computer Science or related field Work Experience Minimum 3- 5 years' relevant experience Proven experience in developing reports and databases Knowledge Advanced in MS SQL Server BI Stack tools and technologies (SSRS, SSIS, TSQL, Power Query, Power Bi, Dax) Strong knowledge of Python. Strong Microsoft Excel skills including Macros Familiarity with cloud platforms (e.g., Azure) Competencies: Technical & Behavioural Technical Competencies Excellent knowledge of data backup, recovery, security, integrity, and SQL. Experience in Crystal reports or similar business intelligence tools Solid understanding of ETL processes, data warehousing concepts, and data modelling. Behavioural Competencies Ability to work independently and as part of a team Proactive, self-starter with initiative to find ways to improve solutions, systems and processes Excellent analytical and problem-solving skills Ability to learn new software and technologies quickly. Ability to follow instructions Strong attention to detail Excellent communication and documentation abilities. BDO Core Competencies Relationships and Collaboration Exceptional Client Service Business Growth Engaging people Leadership Quality, Risk management and Operational performance

a day ago

It Data Architect

GoldenRule

Johannesburg, south-africa

Default

Our client is seeking an experienced Data Architect with strong expertise in modern cloud data platforms including Azure Databricks, AWS, Snowflake, Azure Synapse, and Azure Data Factory (ADF). The ideal candidate will have a solid background in presales, solutioning, POC (Proof of Concept) development, and direct client interaction.This role requires a blend of technical depth, architectural thinking, communication skills, and customer-facing experience to support both delivery and business development initiatives. Key ResponsibilitiesData Architecture Engineering Design and implement enterprise-grade data architectures across Azure, AWS, and hybrid environments. Develop scalable data pipelines and ETL/ELT solutions using Azure Databricks, ADF, Synapse, and Snowflake. Define data models, data flow diagrams, and reference architectures. Ensure best practices for data governance, data quality, and metadata management. Architect end-to-end data solutions on Azure (Synapse, ADF, Databricks), AWS (Redshift, Glue, S3, Lambda), and Snowflake. Optimise data storage, compute, and cost across cloud platforms. Evaluate cloud-native tools and recommend fit-for-purpose solutions. Work closely with sales teams to support presales activities, including solutioning, estimation, and proposal building. Conduct technical workshops, discovery sessions, and requirement analysis with prospective clients. Prepare and deliver compelling technical presentations, architecture diagrams, and solution roadmaps. Lead and execute Proof of Concepts (POCs) to demonstrate solution feasibility. Build prototypes using Databricks, Snowflake, Synapse, or AWS components to validate business use cases. Stay updated with new features and innovations across cloud platforms. Engage directly with clients to understand business needs and translate them into technical architectures. Act as a trusted advisor to customers on data strategy, cloud adoption, and platform modernisation. Collaborate with cross-functional teams including delivery, product, business analysts, and leadership. 10+ years of experience in data engineering, data architecture, or cloud data platforms. Hands-on expertise in: Azure Databricks (Python/Spark/Delta Lake) Azure Synapse Analytics Azure Data Factory (ADF) Snowflake (SQL, Snowpipe, Streams Tasks) AWS Data Stack (S3, Redshift, Glue, Lambda, EMR) Strong understanding of data warehousing, data lakes, lakehouse architecture, and ETL/ELT methodologies. Excellent SQL, Spark, and Python skills. Experience in presales, RFP responses, client workshops, and technical solutioning. Strong communication and presentation skills. Certifications in Azure / AWS / Snowflake. Experience leading large-scale cloud migration or modernisation projects. Knowledge of data governance tools (e.g., Purview, Collibra) is a plus. Desired Skills: Systems Analysis Complex Problem Solving Programming/configuration Critical Thinking Time Management

a day ago