Artificial Intelligence Quality Assurance Engineer
Birlasoft Limited
Apply on company website
Artificial Intelligence Quality Assurance Engineer
Birlasoft Limited
Bengaluru/Bangalore
Not disclosed
Work from Office
Full Time
Min. 5 years
Job Details
Job Description
Contractor
Area(s) of responsibility
AI QA Engineer – Agentic AI / GenAI
Role Overview
QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with strong Python expertise.
Key Responsibilities
- Develop Python-based automation frameworks (Pytest)
- Test LLM outputs (accuracy, hallucination, relevance)
- Validate multi-agent workflows and pipelines
- Build evaluation metrics (F1, precision, recall)
- Perform API and integration testing
- Ensure high test coverage and CI/CD integration
Required Skills
- Strong Python programming
- Automation frameworks (Pytest/unittest)
- Understanding of GenAI/LLMs
- API testing and debugging
- CI/CD and version control
Experience Level
Senior LevelJob role
Work location
INDIA - BENGALURU - HP, IN
Department
Quality Assurance
Role / Category
Software Quality Assurance and Testing
Employment type
Full Time
Shift
Day Shift
Job requirements
Experience
Min. 5 years
About company
Name
Birlasoft Limited
Job posted by Birlasoft Limited
Apply on company website