Data Engineer

GCP + Databrick + SQL | 3 to 5 Years | IST Time| Bangalore | Onsite

Job Description:

Role:GCP+DataBricks+ SQL

Key Responsibilities:

· Design and implement scalable data pipelines using Databricks, ensuring optimal data processing and storage.

· Develop complex SQL stored procedures, views, and scripts for efficient data manipulation and retrieval.

· Conduct performance tuning of SQL queries and database systems to ensure high performance and responsiveness.

· Utilize Delta Lake for reliable data storage and management, ensuring data consistency and integrity.

· Work with Google Big Query for large-scale data analytics, optimizing queries for performance and cost-efficiency.

· Collaborate with the reporting team to provide tailored views and tables that support their reporting and analytics requirements.

· Monitor and optimize the performance of data pipelines and infrastructure, ensuring high availability and scalability.

· Implement data governance and security best practices to protect sensitive information and ensure compliance with regulations.

· Stay up to date with emerging technologies and industry trends in data engineering, and recommend improvements to our data architecture and processes.

Experience Level

Senior Level