DevSavant Logo

DevSavant

Senior IVA QA Automation Engineer (6 months project)

Posted 5 Days Ago
Be an Early Applicant
Remote
12 Locations
Mid level
Remote
12 Locations
Mid level
The Senior IVA QA Automation Engineer will engage stakeholders, design testing frameworks, evaluate tools, automate tests, and implement reporting for AI-driven voice applications.
The summary above was generated by AI
About DevSavant

DevSavant is a boutique staff augmentation firm serving B2B Tech & AI companies in the US. We specialize in integrating top-tier LATAM professionals into client teams with speed, precision, and cultural alignment. Our mission is to be an extension of our clients' organizations, building sustainable, high-performance teams that scale fast and deliver results.

Responsibilities:

  1. Stakeholder Engagement & Requirements Gathering

    • Coordinate with product, development, and QA Director

    • Define business and technical requirements for voice testing

  2. Current State Analysis

    • Document existing manual test cases and tools

    • Analyze conversation flows and performance metrics

  3. Scope Definition & Prioritization

    • Identify high-priority intents and modules

    • Define automation boundaries and test coverage goals

  4. Tool Evaluation & Selection

    • Assess and choose tools for STT, TTS, test automation, and CI/CD

  5. Framework Design & Environment Setup

    • Architect the voice testing framework

    • Set up environments, SDKs, APIs, and version control

    • Establish CI/CD pipelines

  6. Test Development & Automation

    • Build reusable components and utilities

    • Automate high-priority test cases (intent, flow, entity, fallback)

    • Expand to multi-turn and regression scenarios

  7. CI/CD Integration

    • Integrate voice tests into nightly runs and PR triggers

    • Validate deployments and enable parallel execution

  8. Test Data & Reporting

    • Manage test data setup, teardown, and utterance variations

    • Implement reporting, playback, and performance metrics

  9. Stabilization & Coverage Expansion

    • Fix flaky tests and improve reliability

    • Expand coverage to 70–80% of regression suite

    • Add multi-language, accent, and device testing

  10. Non-Functional Testing

    • Implement performance, load, latency, and security testing

  11. Optimization & Documentation

    • Optimize execution time and resource usage

    • Finalize documentation, best practices, and usage guides

  12. Training & Handover

    • Train QA and developers on framework usage and maintenance

    • Conduct retrospectives and plan for continuous improvement

Requirements:

Technical Skills:

  • Programming: Expert in Python for in-house tool development and test scripting..

  • IVA Testing: Proficiency in testing AI-driven voice applications (e.g., NLP, ASR) using tools like Twilio Autopilot, Cyara, or Dialogflow.

  • Tools: Experience with Postman, Cyara, Twilio.

  • CI/CD: Expertise in building pipelines from scratch (Jenkins, GitHub Actions, GitLab CI) and integrating voice testing environments.

  • Telephony: Knowledge of SIP and cloud telephony platforms (e.g., Twilio, AWS Connect) for voice-to-voice IVA automation.

Soft Skills:

  • Analytical mindset to debug complex IVA failures.

  • Strong collaboration with developers and stakeholders for framework design and defect resolution.

  • Clear documentation and KPI reporting for transparency.

Experience:

  • 3+ years in QA automation, with 1+ years in IVA systems.

  • Proven experience building QA frameworks and CI/CD pipelines from scratch.

  • Hands-on expertise in voice-to-voice call automation and AI-driven IVA testing.

Top Skills

Cyara
Dialogflow
Github Actions
Gitlab Ci
Jenkins
Postman
Python
Twilio

Similar Jobs

16 Hours Ago
Remote
15 Locations
Entry level
Entry level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Rubrik is looking for passionate engineers who can contribute to building innovative and effective products. The role involves collaboration with product teams and cultivating an empowering workplace culture.
16 Hours Ago
Remote
15 Locations
Entry level
Entry level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Join Rubrik's talent community to stay connected and be considered for future job opportunities focused on data security and inclusion.
3 Days Ago
Remote or Hybrid
12 Locations
Senior level
Senior level
Marketing Tech • Real Estate • Software • PropTech • SEO
Design, build, and deploy a cloud-native platform and microservices, optimizing for performance while mentoring junior engineers and collaborating with teams.
Top Skills: ApolloAWSDynamoDBElasticsearchKubernetesLambdaNode.jsPostgresPythonReactStyledcomponentsTypescript

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account