Senior Test Engineer

1 Minute ago • 4-7 Years • Testing

Job Summary

Job Description

We are seeking a skilled and passionate Test Engineer with 4 to 7 years of experience to join our agile development team. This role is focused on ensuring the quality of SaaS-based enterprise applications, particularly those involving billing systems and Generative AI model behaviors. The ideal candidate will bring a deep understanding of testing practices, AI platforms, and business-critical processes. You will work closely with developers, product owners, and business analysts to validate product functionality and customer scenarios.
Must have:
  • Participate as a scrum team member in product development ceremonies.
  • Design and execute test cases and exploratory testing for SaaS and cloud-based applications, focusing on critical flows like invoicing, subscription lifecycle, usage metering, and AI-generated actions or insights.
  • Responsible for validating the accuracy, reliability, safety, and user experience of AI-powered features, particularly focusing on model behavior, prompt evaluation, output validation, and integration within SaaS applications or enterprise systems.
  • Collaborate with product managers and developers to understand user stories, requirements, and business goals, especially in the areas of billing workflows and GenAI capabilities, as model behavior outputs, prompt response behavior and user-facing AI features.
  • Validate data pipelines and integrations between components, especially involving billing logic and AI-based decisioning.
  • Conduct Product Risk Assessments for new features or updates.
  • Support testing for customer issues, patches, and hotfixes.
  • Participate in regression test planning and execution prior to feature releases.
  • Maintain accurate documentation related to test cases, test results, and product quality.
  • Work with cross-functional teams to ensure alignment on release readiness.
  • Interface with R&D and support teams to triage and resolve customer-reported issues.
  • Stay up to date with trends and developments in SaaS testing, AI quality validation, and billing platforms.
Good to have:
  • validating billing engines
  • subscription lifecycle management
  • ERP/CRM integrations
  • GenAI behavior testing
  • prompt response validation
  • model guardrails
  • AI accuracy/fairness
  • Scripting experience in PowerShell or Bash for test environment setup and monitoring
  • monitoring tools
  • observability platforms
  • performance testing concepts
  • load testing concepts
  • JMeter
  • containerized environments
  • Kubernetes
  • Docker
  • communication platforms
  • Microsoft Teams
  • Zoom
Perks:
  • chance to learn and grow
  • endless internal career opportunities across multiple roles, disciplines, domains, and locations
  • NiCE-FLEX hybrid model
  • 2 days working from the office and 3 days of remote work, each week

Job Details

What’s the role all about?

We are seeking a skilled and passionate Test Engineer with 4 to 7 years of experience to join our agile development team. This role is focused on ensuring the quality of SaaS-based enterprise applications, particularly those involving billing systems and Generative AI model behaviors. The ideal candidate will bring a deep understanding of testing practices, AI platforms, and business-critical processes. You will work closely with developers, product owners, and business analysts to validate product functionality and customer scenarios.

How will you make an impact?

  • Participate as a scrum team member in product development ceremonies.
  • Design and execute test cases and exploratory testing for SaaS and cloud-based applications, focusing on critical flows like invoicing, subscription lifecycle, usage metering, and AI-generated actions or insights.
  • Responsible for validating the accuracy, reliability, safety, and user experience of AI-powered features, particularly focusing on model behavior, prompt evaluation, output validation, and integration within SaaS applications or enterprise systems.
  • Collaborate with product managers and developers to understand user stories, requirements, and business goals, especially in the areas of billing workflows and GenAI capabilities, as model behavior outputs, prompt response behavior and user-facing AI features.
  • Validate data pipelines and integrations between components, especially involving billing logic and AI-based decisioning.
  • Conduct Product Risk Assessments for new features or updates.
  • Support testing for customer issues, patches, and hotfixes.
  • Participate in regression test planning and execution prior to feature releases.
  • Maintain accurate documentation related to test cases, test results, and product quality.
  • Work with cross-functional teams to ensure alignment on release readiness.
  • Interface with R&D and support teams to triage and resolve customer-reported issues.
  • Stay up to date with trends and developments in SaaS testing, AI quality validation, and billing platforms.

Have you got what it takes?

  • Degree in Computer Science, Engineering, or a related field.
  • 4-7 years of experience in software testing, preferably in SaaS environments.
  • Solid understanding of billing platforms, subscription models, usage tracking, and revenue systems.
  • Familiarity with Generative AI feature testing— prompt-response behavior, outputs and model behavior, user facing AI features and adaptive system behavior.
  • Strong experience in API testing using tools such as Postman (required) or RestAssured.
  • Exposure to SQL and database verification, especially for financial and usage data validation.
  • Experience in creating and executing test plans and test cases for business-critical applications.
  • Familiarity with tools like TestLink, Jira, X-Ray, and Confluence.
  • Excellent troubleshooting and problem-solving skills.
  • Strong communication skills and a collaborative mindset.
  • Experience working in Agile/SCRUM environments.
  • Ability to contribute in a global, cross-functional team setting.

Preferred Qualifications:

  • Background in validating billing engines, subscription lifecycle management, or ERP/CRM integrations.
  • Understanding of GenAI behavior testing (prompt response validation, model guardrails, AI accuracy/fairness).
  • Scripting experience in PowerShell or Bash for test environment setup and monitoring.
  • Experience with monitoring tools or observability platforms.
  • Familiarity with performance or load testing concepts (tools like JMeter are a plus).
  • Experience with containerized environments (Kubernetes, Docker) is a plus.
  • Knowledge of communication platforms such as Microsoft Teams or Zoom is a bonus.

What’s in it for you?

Join an ever-growing, market disrupting, global company where the teams – comprised of the best of the best – work in a fast-paced, collaborative, and creative environment! As the market leader, every day at NiCE is a chance to learn and grow, and there are endless internal career opportunities across multiple roles, disciplines, domains, and locations. If you are passionate, innovative, and excited to constantly raise the bar, you may just be our next NiCEr!

Enjoy NiCE-FLEX!

At NiCE, we work according to the NiCE-FLEX hybrid model, which enables maximum flexibility: 2 days working from the office and 3 days of remote work, each week. Naturally, office days focus on face-to-face meetings, where teamwork and collaborative thinking generate innovation, new ideas, and a vibrant, interactive atmosphere.

Requisition ID: 8163

Reporting into: Tech Manager

Role Type: Individual Contributor

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Pune, Maharashtra, India

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Testing Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Atlanta, Georgia, United States (Hybrid)

Sandy, Utah, United States (Hybrid)

Pune, Maharashtra, India (Hybrid)

Hoboken, New Jersey, United States (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Ra'anana, Center District, Israel (Hybrid)

View All Jobs

Get notified when new jobs are added by Nice

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug