GCP Data Engineer / Technical Lead - #2167030

Role Overview

We are looking for an experienced GCP Data Engineer / Technical Lead to drive engineering delivery for a scalable, multi-tenant data integration platform. The role focuses on building production-grade ETL pipelines, orchestrating workflows using Apache Airflow, improving CI/CD automation, and implementing end-to-end data lineage.

Must-Have Skills

• Google Cloud Platform (GCP)

• Apache Airflow – DAG Development & ETL Orchestration

• Python

• ETL/ELT Pipelines & Data Integration

• GCP Data Services – BigQuery, Cloud Storage, Pub/Sub, Dataflow

• CI/CD Pipelines & Release Automation

• Infrastructure as Code – Terraform

• REST APIs & Configuration Management

• Data Quality, Validation & Reconciliation

• Pipeline Monitoring, Logging & Performance Tuning

• Reliability Engineering – Retries, Idempotency & Error Handling

• Technical Leadership & Agile Delivery

Key Responsibilities

• Lead technical design and delivery of GCP-based data integration solutions

• Build and maintain reliable Airflow DAGs and ETL/ELT pipelines

• Develop scalable, multi-tenant platform architecture

• Automate build, testing, deployment and release processes

• Implement end-to-end data lineage and metadata tracking

• Improve pipeline reliability, observability and incident recovery

• Collaborate with vendors, architects, product owners and data teams

• Mentor engineers and establish coding, testing and documentation standards

Good to Have

• OpenLineage, DataHub or data catalog tools

• Multi-tenant architecture and metadata-driven pipelines

• Data governance, auditability and access controls

• GKE / Cloud Run

• External vendor system integrations