Data Engineer

Indium Software India

Hyderabad

Not disclosed

Work from Office

Full Time

Min. 2 years

Job Details

Job Description

Data Engineer

Job Title: Data Engineer

Job Description: • Design, build, and maintain scalable data pipelines using PySpark and Python • Develop and optimize complex SQL queries for data processing • Implement and manage ETL/ELT workflows ensuring data quality and reliability • Collaborate with business and product teams to translate requirements into data solutions • Build and maintain data warehouse systems • Handle large-scale data processing using Hadoop and Big Data technologies • Perform performance tuning and optimization of data pipelines Required Skills: • Strong hands-on experience with PySpark and Python • Advanced proficiency in SQL • Solid experience in ETL processes and data warehousing • Familiarity with Hadoop ecosystem and Big Data technologies • Experience working with large datasets in distributed environments • Good communication skills and business understanding Good to Have: • Experience with Apache Airflow • Exposure to cloud platforms (AWS, GCP, Azure) • Knowledge of data lakes and modern data architectures • Experience with streaming tools (Kafka, Spark Streaming)

Experience Level

Mid Level

Job role

Work location

Hyderabad, India

Department

Data Science & Analytics

Role / Category

DBA / Data warehousing

Employment type

Full Time

Shift

Day Shift

Job requirements

Experience

Min. 2 years

About company

Name

Indium Software India

Job posted by Indium Software India

Apply on company website