Skip to main content

Get Approval Insights

Aaron Collier avatar
Written by Aaron Collier
Updated this week

This section of the Issues report highlights how issues are approved and resolved, providing insights into project momentum. Metrics such as approved issues and approval rate show how effectively issues are being handled, while the busiest day and the related heat map reveal patterns in approval activity to aid in resource planning.

By tracking addressable issues and the addressal rate, you can measure how consistently issues are being resolved. Together, these indicators help you spot trends, manage backlogs, and ensure a smooth and efficient resolution process.

Approved Issues

Indicators for approved issues in the Testlio platform with example data.

Indicator

What It Tracks

What Signals It Might Bring

Approved Issues

The total number of issues approved during the period. Automatically compares with how many issues were approved during the prior period.

  • Many approved issues indicates strong throughput. Ensure resources are balanced to maintain consistency in reviews.

  • Few approved issues signals potential bottlenecks. Investigate delays in reviews or refine criteria for faster approvals. It’s recommended to also review tests with rejected issues to ensure they align with the success criteria.

Approval Rate

Shows the percentage of issues that were approved. Automatically compares with the approval rate during the prior period.

  • An increasing rate suggests alignment with reporting criteria. Maintain consistency in issue identification and approval processes.

  • A decreasing rate highlights potential misalignment. Review addressed issue processes and test alignment.

Busiest Day

The day of the week with the highest issue approval activity.

This indicator aids in understanding when the majority of approval actions are taken, which can support workload planning. Allows the team to understand their allocation and be able to schedule tests and assign resources as needed in advance.

Busiest Day (Heat Map)

A visual representation of issue approvals over time, with darker colors indicating more approvals.

This map helps identify patterns in approval activity over time.

  • High-intensity periods reveal concentrated approval activity. Plan resources to handle peak times effectively.

  • Low-intensity periods signal opportunities to streamline processes during lighter workloads or optimize team utilization.

Approval Rate Trend

The approval rate over time.

This chart provides insight into fluctuations in issue approval rates.

  • Consistent trends reflect stability in issue identification and approval processes. Use this as a benchmark for ongoing workflows.

  • Fluctuations indicate periods of backlog or increased scrutiny, allowing the team to dedicate time for reviews based on their capacity.

Addressed Issues

Addressed issues are issues that were raised that have since been fixed. Tracking addressed issues helps you see how testing efforts are increasing the quality of your releases.

Example addressed issue indicators in the Testlio platform.
Example addressal rate by issue severity in the Testlio platform.

Indicator

What It Tracks

What Signals It Might Bring

Addressable Issues

Displays the total number of issues identified as addressable within the period. Automatically compares with how many issues were addressable during the prior period.

An addressable issue is an issue that has been identified and approved by Testlio with at least 30 days since it was identified.

  • Many addressable issues indicates a significant number of issues awaiting resolution. Prioritize addressing critical items to prevent backlog growth. It’s recommended to review the addressed issue process and look at optimizing follow-up steps.

  • Few addressable issues suggests improved stability or fewer issues being approved. Ensure critical areas are still being effectively tested. It may be time to check the scope and see if it should expand. It’s also a good time to start looking at automation for the areas currently tested.

Addressed Issues

Shows the number of issues that were successfully addressed and resolved in the selected period. Automatically compares with how many issues were addressed during the prior period.

  • Many addressed issues reflects strong progress in resolving issues. Communicate successes to stakeholders and maintain efficiency.

  • Few addressed issues signals potential delays or bottlenecks in resolution. It's a great time to review the addressed issue process and ensure all parties are aligned on expectations.

Addressal Rate

The percentage of addressable issues that were actually resolved. Automatically compares with the addressal rate during the prior period.

  • A high rate indicates effective resolution efforts. Maintain consistent workflows to sustain performance.

  • A low rate highlights a backlog or inefficiencies. It's a great time to review the addressed issue process and ensure all parties are aligned on expectations.

Addressed Issues vs. Addressal Rate

A visual representation of the number of issues addressed over time alongside the addressal rate.

This chart enables easy identification of periods with higher or lower resolution rates. It offers insights into how consistently addressable issues are being resolved and helps identify any backlog or bottlenecks in the resolution process.

  1. Periods with many addressed issues but a low addressal rate suggest ongoing backlog clearance but room for improved consistency. Refine focus to ensure steady progress.

  2. Periods with few addressed issues and a low addressal rate signal bottlenecks in resolution. Identify the root causes and adjust resources to improve throughput.

Addressal Rate with Benchmarks

A visual representation of the addressal rate percentage over time. The chart includes benchmarks from all Testlio testing, with lines for the 25th, 50th (median), and 75th percentiles.

This chart helps you track where you stand with addressing issues as compared to other companies testing with Testlio.

Addressal Rate by Issue Severity

The addressal rate for issues by the severity of the issues (low, medium, or high).

This chart helps you see how many issues are addressed for all kinds of issues. This way you can see how both critical bugs and long-tail quality issues are being resolved.

Escaped Issues

Escaped issues are any suspicions of issues that might have escaped the initial testing process. Track all escaped issues in one place.

Escaped issues report in the Testlio platform with 1 escaped issue and its ID and title.

Indicator

What It Tracks

What Signals It Might Bring

Escaped Issues

The total number of escaped issues during the period.

  • Many escaped issues signals gaps in the testing process or missed scenarios. Review and enhance test coverage, particularly for high-risk features.

  • Few escaped issues reflects effective testing but requires ongoing review to ensure critical scenarios are consistently covered.

Issues List

Specific information about each escaped issue, including the ID and title.

This list helps in tracing the source of escaped issues, facilitating targeted improvements in testing protocols for those features.

  • Frequent patterns in escaped issues identifies recurring problem areas or features. Refine test cases for those features to improve detection in future cycles.

  • A broad distribution of escaped issues suggests general testing inefficiencies. Reassess the overall strategy to better target high-risk areas.

Did this answer your question?