QA Engineer with 4+ years in Generative AI & Automation Testing
AI is analyzing your overall score…
Identifying your key strengths…
Evaluating your skill match against the job requirements…
Assessing your cultural and operational fit
QA Engineer with 4+ years of experience in manual and automation testing, specializing in Generative AI (LLM, RAG, and AI agents). Experienced in testing healthcare AI workflows, prompt validation, and model evaluation using RagaAI Catalyst. Skilled in API testing, Selenium (Python), and Agile QA processes to deliver reliable and high-quality solutions.
Babasaheb Bhimrao Ambedkar University
BCA
September 1, 2017 – July 1, 2020
Observance Solution Pvt. Ltd. Deployed At Client RagaAi Inc
QA Engineer
May 1, 2024 – Present
Lucknow, Uttar Pradesh, India
GYL Digital Solution Pvt. Ltd.
Software Test Engineer
March 1, 2022 – May 1, 2024
Pune, Maharashtra, India
Healthcare AI Testing – DeepHealth Platform
May 1, 2024 – June 1, 2026
Tested AI-driven healthcare workflows, including Rule Processing Agent and Auto Assignment Agent using prompt-based validation techniques. Performed prompt engineering and LLM response evaluation to ensure consistent and reliable outputs. Identified edge cases, inconsistencies, and failure patterns, enhancing system reliability. Collaborated with cross-functional teams to improve AI agent behavior in a healthcare domain.
LLM Evaluation & Testing using RagaAI Catalyst
May 1, 2024 – June 1, 2026
Tested LLM-based applications, including RAG pipelines and agentic systems. Conducted hallucination detection, trace analysis, and prompt validation. Evaluated model responses using automated metrics and human feedback loops.
Banking Domain Web Application Testing
March 1, 2022 – May 1, 2024
Tested modules including Account Types, Notifications, Users, Currency, and Security features. Ensured functional accuracy, data integrity, and seamless workflows.
Cultural Fit Analysis
The candidate's project diversity, spanning healthcare AI, LLM evaluation, and banking web applications, indicates adaptability and a broad interest in different domains. The current role involves deployment at a client site (RagaAI Inc), suggesting an ability to integrate into various team structures. The focus on cutting-edge AI testing aligns well with innovative and forward-thinking team environments.
Soft Skills & Operational Fit
The candidate's experience descriptions suggest a collaborative approach, working with cross-functional teams to improve AI agent behavior. The ability to identify edge cases and inconsistencies points to strong analytical and problem-solving skills. The use of JIRA for defect tracking indicates familiarity with standard agile QA processes.