Skip to main content

Escaped Issues

Doris Sooläte avatar
Written by Doris Sooläte
Updated over a week ago

Escaped Issues represent a crucial challenge in the feedback loops of testing. In the Testlio platform, these issues are identified when they bypass our standard testing procedures. As a result, we empower both our clients and service delivery coordinators to highlight these overlooked problems. It's essential to note that the process for addressing Escaped Issues in the Testlio platform is distinct from that of routine issues reported by freelancers or clients during their testing efforts. In our system, Escaped Issues are documented, monitored, and managed separately.

Why Report Escaped Issues

Once Testlio knows about any Escaped Issues, the team works hard to identify the

root cause and resolve it before it repeats. This helps keep issues with a similar

cause from entering your future critical releases. The sooner Testlio knows about

an issue that has escaped established processes, the sooner the processes can be fixed.

Software always contains issues that stay undiscovered throughout testing. It is

important to catch issues that matter before they pass a critical gate. That is where you can help by reporting any escaped issues you identify.

Report an Escaped Issue

If you have a Jira integration set up, the easiest way to report an Escaped Issue is to add the label testlio-escaped-issue to an issue in your issue management system. This automatically syncs the issue to the Testlio platform as an Escaped Issue.

Note that this only works if your integration syncs labels from your Jira instance into Testlio. It does not work for issues originally created by Testlio. To ensure your configuration is working, check with your Engagement Manager.

Report Escaped Issues in the Testlio Platform

In the Testlio platform, click Issues and then click New Escaped Issue.

The New Escaped Issue button in the Testlio platform.

You are offered fields with key information to fill in.

The New Escaped Issue form includes the title, description, found date, reported date, and other fields.

You can report an escaped issue with these basic fields:

Field

Required?

Explanation

Title

Required

A brief title of the escaped issue in the failure-when style. This helps to understand the context of the particular issue when reviewing the issues list.

Description

A detailed description of the issue including any applicable links or reference information (if possible, attach the email [without disclosing PII] or screenshots of communication).

Found Date

Required

The date the issue occurred and came to be known to the customer. Found and reported dates are distinguished to understand the delay it takes to notify Testlio.

Reported Date

The date the escaped issue was reported to Testlio.

Link to issue

URL reference to the same escaped issue in an external system. Use the full URL (https://...).

Attach file

Optional field to collect reference materials, such as recordings, logs.

Advanced Details about Escaped Issues

Advanced details offer the chance to add more information to resolve and close an escaped issues. Some fields must be filled in before an Escaped Issue can be closed but none are required to open an Escaped Issue.

Explanation of Drivers

Category

Driver

General Source

Description

Process Integration

Limited Coverage

Client/Testlio

Devices, locations, languages, and/or other aspects of coverage were not tested, because of: 1) scope/budget; 2) a decision based on focus; and 3) a misunderstanding.

Process Integration

Build Delivery

Client

The customer provided an unanticipated or problematic build (including a web environment). Can include building access and sample data problems. Also includes lack of build receipt.

Process Integration

Issue Escalation

Client/Testlio

Issues discovered were not clearly presented to the correct action source.

Process Integration

Issue Remediation

Client

Issues were not resolved sufficiently before the production release.

Test Preparation

Team Onboarding

Client/Testlio

Testers, Coordinators, Scripters, and/or other participants were not sufficiently skilled, trained, or equipped to perform key tasks. This can include poor selection decisions.

Test Preparation

Testing Instructions

Client/Testlio

The Run Instructions, Test Case, and/or other directions were problematic. This can include missing tests.

Test Preparation

Testing Methodology

Testlio

Testing techniques (e.g. functional v exploratory, positive v negative) were poorly selected, badly designed, and/or weakly implemented.

Testing Execution

Insufficient Testing

Tester

Unintentional missed issue. Tester did the work by following instructions but did not "see" the issue, potentially because of fatigue, misunderstanding, miscommunication, limited time, or other problems.

Testing Execution

Misaligned Testing

Tester

The tester did not follow the instructions given in the task potentially due to lack of attention, sloppiness, or other factors, resulting in a wrong testing setup or incorrect testing scenarios.

Testing Execution

Misrepresented Testing

Tester

Intentional breach of Freelancer Agreement. Tester knowingly misrepresented their work (e.g. false passes), location, equipment, skills, time, or other factors (can include tester subcontracting work to someone else and/or parallel testing).

Close an Escaped Issue

Once an escaped issue is recorded and remediation completed, then closing the issue follows the same model as the regular issue. When closing issues, ensure that all required fields are completed and if possible, also collect optional data fields for greater impact on future testing loops and learnings.

Did this answer your question?