Conduct quality monitoring of AI chatbot responses, resolve issues, optimize models, analyze data, and improve quality-control processes.
Responsibilities
- Quality Monitoring: Conduct daily quality assurance on AI Chatbot responses through manual sampling and user feedback to assess accuracy, relevance, and naturalness.
- Issue Resolution: Detect response-quality issues promptly; document root causes, propose actionable improvements, and follow through to closure.
- Model Tuning: Collaborate with engineering teams to optimize AI models by participating in data annotation, parameter adjustment, and other enhancement tasks to boost performance and answer quality.
- Data Analysis: Collect and analyze user-conversation data to uncover user needs and pain points, providing data-driven insights for optimization.
- Process Improvement: Refine quality-control workflows to increase efficiency and ensure standardization of QA and tuning processes.
Requirements
1. Technical Skills
- Solid understanding of AI Chatbot mechanisms and quality-evaluation criteria.
- Basic data-analysis skills; proficient in SQL, Excel, and related tools.
- Foundational knowledge of Natural Language Processing (NLP) and Machine Learning.
2. Experience
- 2+ years of relevant experience; prior optimization experience with AI or conversational products is preferred.
- Experience with industry-leading AI Chatbot products is a strong plus.
3. Soft Skills
- Strong communication and collaboration abilities.
- Meticulous, patient, and adept at identifying and solving problems.
- Thrives in a fast-paced environment and demonstrates a strong learning aptitude.
Top Skills
Excel
Machine Learning
Natural Language Processing
SQL
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Senior Principal Platform Architect guides customers in establishing a robust technical foundation on the ServiceNow Platform, focusing on design, governance, and best practices. Responsibilities include translating business goals into outcomes, managing technical health, and interfacing with executives during implementations.
Top Skills:
AICloud Application TechnologiesServicenow Platform
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Design, develop, and maintain automated test scripts, implement software with an emphasis on quality, and contribute to team discussions while continuously learning about new tools and technologies.
Top Skills:
.NetApigeeC#CypressDatadogDockerEnvoyGitlabGoHelmIstioJavaScriptJIRAKubernetesPostgresReactRestsharpSQLTerraformTypescript
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
The Sales Operations Manager will enhance sales efficiency and growth through strategic partnerships, data analysis, and pipeline management, while collaborating with various business teams.
Top Skills:
Salesforce
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.