Data Engineer

Pradeepit Global Consulting Private Limited

Bengaluru/Bangalore

Not disclosed

Work from Office

Full Time

Min. 2 years

Job Details

Job Description

Data Engineer 1 FTE

Job Description:

Skill Sets

  • Develop, Enhance SQL, Pyspark
  • Create, Enhance SQL Store Procedures
  • Design and propose technical solution
  • Design criteria and test cases for unit testing;
  • perform unit testing and document results.
  • Provide technical support to functional consultants.
  • Develop technical design, follow defined process for timely completion of high-quality deliverables
  • Understand & support requirements and estimate for assigned work

Knowhow on tools

  • Azure Cloud Azure ADLS MS SQL Server Azure Databricks MS SQL Management studio

Knowhow on methodologies

  • DevOps Agile way of working

Expected deliverables

  • Must be aware of interaction of ETL in Azure and Databricks / Spark
  • Designing and developing complex data transformations using Pyspark
  • Designing and developing moderately complex database entities Demonstrated intermediate level of competency with Azure SQL Database, Azure SQL Managed Instance and SQL scripting.
  • Demonstrated experience with Azure: Data Lake Gen 2, Key Vault and Dev Test Labs
  • Aware of DevOps CICD pipelines for Spark /Databricks

    Experience Level

    Mid Level

    Job role

    Work location

    Bengaluru, KA, India

    Department

    Data Science & Analytics

    Role / Category

    Data Science & Machine Learning

    Employment type

    Full Time

    Shift

    Day Shift

    Job requirements

    Experience

    Min. 2 years

    About company

    Name

    Pradeepit Global Consulting Private Limited

    Job posted by Pradeepit Global Consulting Private Limited

    Apply on company website