Skip to main content

Configure Smart Tags

This page explains how you can configure and use smart tags to quickly gain insights on automated/manual test runs in TestOps.

requirements
  • Only Project Admins can configure Smart Tag settings, including Time Window, Minimum Executions, and thresholds for Flaky and Slow tags.
  • Once it is configured, all project members can view Smart Tags.

Overview​

Smart tags are how TestOps flag troubling test cases based on their past run data. Smart tags include:

  • Flaky
  • New Failure
  • Always Fail
  • Slow

All Smart Tags are automatically labeled on executed test cases, once they fit criteria for each. You can also customize configurations for Smart Tags, such as Time Windows, Minimum Executions, Flaky tag, and Slow tag.

testops smart tags

Available configurations:

  • Time windows: Days used in calculations for Always Fail, New Failure, and Slow tags. Learn about their calculations at Test quality metrics.
  • Minimum executions: Lower execution threshold to start calculation for New Failure and Slow tags.
  • Flaky tag: Show Flaky for both Potentially flaky vs Highly flaky, or just for Highly flaky tests. For more details on calculations for the PFS, see Probabilistic Flakiness Score
  • Slow tag: Show Slow for tests whose most recent run has a duration that falls above 99th or 95th percentile, compared to durations of all executions in the Time Window.
Was this page helpful?