Leads QA strategy and builds automation frameworks for AI-powered applications. Owns functional, non-functional, API, integration, acceptance, system, regression, and end-to-end testing across distributed systems. Tests LLM behaviors including hallucinations, factual accuracy, prompt consistency, and RAG flows. Mentors junior QA engineers, collaborates with developers and data teams, and integrates testing into CI/CD pipelines.
Job Title: SDET (Software Development Engineer in Testing) – Senior Automation QA & Manual Testing
Experience: 8+ Years
Employment Type: Full-Time
Dept: FSD
Designation: Senior Specialist – FSD QA
Location: Hybrid
About Us
At InxiteOut Pvt. Ltd., we specialize in building next-generation AI-powered applications that solve real-world business problems. We are expanding our QA team to ensure our AI systems are robust, secure, and aligned with user expectations.
Key Responsibilities
· Strong knowledge of Python.
· Configure and test AI/ML product/system.
· Lead the quality assurance strategy and establish automation frameworks from scratch.
· Manage and mentor junior QA engineers and guide them in test automation and AI system validation.
· Own functional and non-functional testing across complex distributed systems.
· Own API, integration, acceptance, system, and end-to-end (E2E) testing.
· Lead test planning, test case design, and execution for web, API, and AI-based systems.
· Design and maintain regression test suites and ensure full coverage.
· Collaborate with Full Stack Developers, Data Scientists, and AI Engineers to define test strategies for LLM-based features.
· Own testing of AI-specific behaviors including:
o Hallucination and factual accuracy
o Consistency in prompt-response pairs
o Retrieval-Augmented Generation (RAG) flows
· Collaborate with developers, product owners, and other QA engineers in Agile teams.
Must-Have Skills
· Deep experience in Functional Testing:
o Advanced REST API Testing (Postman, REST Assured, etc.)
o Integration, Acceptance, E2E, Smoke, Sanity, System Testing
· Strong foundation in Non-Functional Testing:
o Performance and Load Testing
o Stress and Security Testing
· Proficiency in Testing Methods:
o Black-box, White-box, Grey-box Testing
· Regression Testing lifecycle ownership
· Expertise in automation frameworks (e.g., Selenium, Playwright, Cypress, TestNG)
· Strong scripting/coding skills in Python (preferable) / Java / JavaScript
· Familiarity with containerized environments (Docker, Kubernetes)
Good-to-Have (AI Testing Focus)
· Exposure to testing AI/ML products/systems.
· Experience of integrating tests into CI/CD pipelines (GitHub Actions, GitLab, Azure DevOps etc.).
· Hands-on experience with AI testing tools or custom frameworks.
· Familiarity with evaluating LLM (large language model) outputs.
· Experience of validating RAG-based architecture.
· Understanding of hallucination detection metrics and prompt tuning.
· Exposure to safety audits for AI applications.
· Collaboration experience with Full Stack, Data Science, Data Engineering & DevOps teams.
Qualifications
· Bachelor’s or master’s in computer science, Engineering, or related field.
· Certifications in testing or security are a plus (e.g., ISTQB, OWASP).
Inxite Out Kolkata, West Bengal, IND Office
Kolkata, India
Similar Jobs
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Supports Pfizer CentreOne’s inside sales and marketing activities by reviewing and routing marketing-qualified leads, executing outreach sequences, documenting activity in Salesforce, and assisting with campaigns, content, meetings, reporting, and marketing projects. The role develops commercial expertise across marketing, inside sales, and business development while progressing leads toward initial meetings and BD handoff.
Top Skills:
HubspotExcelMicrosoft OutlookMicrosoft PowerpointMicrosoft SharepointMicrosoft TeamsMicrosoft WordSalesforce
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Design and deliver end-to-end packet core and 5G core solutions, optimize network performance, collaborate with product, R&D and customer teams, lead transformations, perform protocol and data analysis, and support deployment and knowledge transfer.
Top Skills:
3GppAiopsAmfCloud-NativeCnfDnsEdge ComputingExcelImsIntent-Based NetworkingMachine LearningMicroservicesMmeMulti-CloudMySQLNetwork SlicingNfvNumpyPacket CorePandasParquetPgwPythonQuicRoutingSgwSmfSwitchingTableauTcpUpfVirtualizationWiresharkZero Trust
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Lead Agile and DevOps transformation across a global organization, developing team capabilities, managing stakeholders, coordinating dependencies and risks, and driving organizational change. The role oversees competence and talent development, creates presentations, proposals, dashboards, and progress reports, improves program management processes, and supports enterprise platform and automation tool development and lifecycle management.
Top Skills:
5GAnsibleCi/CdConfluenceDevOpsDockerGitlabJIRA
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
