About the RoleWe are seeking a highly experienced Senior Data Engineer to design, build, and optimise scalable cloud-native data platforms and near-real-time data pipelines on Google Cloud Platform (GCP). The ideal candidate has deep expertise in highly parallelised distributed processing solutions. Key Responsibilities
Design scalable GCP data pipelines.
Build near-real-time and batch processing solutions.
Develop highly parallelised distributed pipelines.
Implement Cloud Run and GKE workloads.
Design streaming architectures using Pub/Sub and Dataflow.
Optimise performance, scalability and cost.
Relevant degree. Google Cloud Professional Data Engineer certification advantageous.
8+ years data engineering experience. Expertise in BigQuery, Cloud Storage, Dataflow, Cloud Composer, Cloud Run, GKE, Dataproc, Pub/Sub, dbt, Python and SQL. Strong experience with distributed processing, event-driven architectures and near-real-time pipelines.
Azure, AWS, Power BI, Looker, Apache Spark, Terraform, microservices and event-driven architectures.
Desired Skills:
Systems Analysis
Complex Problem Solving
Programming/configuration
Critical Thinking
Time Management