Senior Cloud Data Engineer

AM - Cloud Data Engineer

Cloud Engineering – Consulting 

The Consulting business at KPMG Global Services (KGS) is a diverse team of more than 6400 professionals. We work with KPMG Firms worldwide to transform the businesses of clients across industries through the latest technology and innovation. Our technology professionals combine deep industry knowledge with strong technical experience to navigate through complex challenges and deliver real value for our clients. 

 

The Role 

We are looking for a highly skilled Senior Data & Cloud Engineer to design, build, and optimize next-generation data platforms for our clients. The ideal candidate is a master of core data engineering principles such as distributed computing and advanced data modelling and possesses deep, hands-on expertise in at least one major cloud ecosystem (Azure or GCP). You will be responsible for the entire data lifecycle, from real-time ingestion to providing analytics-ready datasets for our Machine Learning and Business Intelligence teams.

Your key responsibilities will include - 

• Architect Pipelines: Design and build scalable ETL/ELT pipelines to ingest high-velocity telemetry and log data into our cloud warehouse.
• Model Implementation: Partner with Data Scientists to build and maintain Feature Stores and automated ML training pipelines.
• Infrastructure as Code: Utilize Docker, Kubernetes, and Terraform to deploy and manage containerized data services.
• Optimization: Continuously monitor and optimize query performance, sharding strategies, and cloud costs across the data stack.
• Data Governance: Ensure high data quality, integrity, and security standards are met across all production environments.

 

Mandatory Skills

• Programming: Expert-level Python and Advanced SQL (Window functions, CTEs, and performance tuning).
• Data Modeling: Proven experience with Star/Snowflake Schemas and managing Slowly Changing Dimensions (SCD Type 1, 2, & 3).
• Distributed Computing: Hands-on experience with Apache Spark (PySpark/Scala) for processing multi-terabyte datasets.
• Orchestration & Transformation: Proficiency with Apache Airflow for workflow management and dbt for modular data modeling.
• Streaming: Experience with Apache Kafka or similar message brokers for event-driven architectures.
• Key tech stacks – Cloud Expertise (either Azure or GCP)

Feature

Azure 

GCP

Data Warehouse

Azure Synapse Analytics

Google BigQuery

Storage / Lake

Azure Data Lake (ADLS Gen2)

Google Cloud Storage

Serverless ETL

Azure Data Factory (ADF)

Google Cloud Dataflow

Managed Spark

Azure Databricks

Google Cloud Dataproc

Streaming/Pub-Sub

Azure Event Hubs

Google Cloud Pub/Sub

Compute / NoSQL

Azure Functions / Cosmos D

Cloud Functions / Bigtable

Governance & Lineage

Data Catalog/ Microsoft Purview

Lake Formation/ Google Dataplex

 

The person 

• Outstanding interpersonal skills with the ability to inspire teams and develop excellent client relationships 

• Previous experience in consulting and working on complex solutions to business executives 

   

• Embraces a growth mindset for business development, with an ability to influence senior stakeholders 
• Excellent communication (written and oral) skills capable of discussing complex ideas with various groups, ranging from a board room to business unit leads. 
• Good team player with strong commitment to professional and client service excellence. 

• Minimum Bachelor's degree in Computer Science, Information Technology or MCA.
• Google Professional Data Engineer or Microsoft Azure Data Engineer Associate
• Experience with Microsoft Fabric will be preferred.
• Experience with Snowflake or Databricks as a centralized data platform.

Experience Level

Senior Level