The overview indicators in the Issues Report guide you on how well your issue processes and resolution are performing over time. Knowing how to unlock these indicators helps you stay up-to-date on processes, balance priorities, and confidently drive improvements.
Indicator | What It Tracks | What Signals It Might Bring |
Identified Issues | The total number of new issues identified within the period, including those not approved by Testlio. Automatically compares with how many new issues were identified during the prior period, showing changes in issue identification rates. |
It’s recommended to review the scope and see if there is more to add to the scope or process of testing. |
Issues per Hour | The average rate of issues identified per manual testing hour during the period. | This metric provides insight into the frequency of issue discovery across the app testing process.
|
Issues per Run | The average number of issues identified per test run. | This metric helps identify the efficiency of each run by showing how many problems are surfaced in each execution. This allows the team to dig in to see if an increase in issues is due to a specific release, feature, or environmental area. |
Issues per Hour | A visual representation of the rate of issue identification over time. | This chart gives you a deeper dive into the issues per hour signal, providing insight into quality levels and stability.
|
Issue Severity Review
Go deeper into the overview by reviewing a breakdown of issues by severity, allowing you to better understand their impact.
These Indicators allow you to filter by date range or workspace, giving you a clear view of where the most critical issues are emerging. By focusing on severity, you can ensure that priorities are aligned and attention is given to the issues that matter most, keeping your testing efforts sharp and impactful.
Indicator | What It Tracks | What Signals It Might Bring |
High-Severity Issues | The total number of high-severity approved issues within the period. Automatically compares with how many high-severity issues were identified during the prior period. | This metric provides insight into the stability of high-priority functionalities.
|
Breakdown by Severity | The percentages of approved issues across severity levels (high, medium, low). | This indicator helps you prioritize responses based on the impact level of each issue and assess overall quality trends within the period.
|
Medium-Severity Issues | Indicates the total number of approved medium-severity issues in the period. | It is good to compare this number with the issues by feature map. By diving into which areas have the most medium-severity issues, you can manage scope and focus on your needs. |
Issues by Severity vs. Testers | A visual representation of approved issues categorized by severity (high, medium, low) over time alongside the number of testers involved. | This metric helps you track the balance between issues found and tester allocation, ensuring that resources align with testing demands. The chart help the team determine if they are assigning the right amount of resources to a task.
|
Issues by Run
Indicator | What It Tracks | What Signals It Might Bring |
Issues by Run | The number of approved issues per test run categorized by severity (high, medium, low). Each bar represents a single test run, with color-coded segments indicating the severity level of the issues discovered during that run. | This visualization helps track the frequency and criticality of issues across individual test executions, providing insight into both the consistency and quality of testing efforts over time.
|
Issues by Feature and Severity
Indicator | What It Tracks | What Signals It Might Bring |
Issues by Feature and Severity | A visual breakdown of approved issues by feature categorized by severity. Each block represents a feature with its size indicating the number of issues identified within that feature and its color intensity showing the severity level. | This chart helps you quickly pinpoint which features are experiencing the most critical issues. This layout aids in prioritizing efforts for issue resolution by highlighting areas with a higher volume of high-severity issues.
|