Skip to main content

Use LeoSuccess, the Testlio AI Assistant

Learn about the AI assistant built in to LeoCore to help you manage testing through natural conversation rather than clicks.

Written by Aaron Collier

LeoSuccess is an AI assistant built directly into LeoCore. It sits within your screen and enables you to manage tests, plans, and workspace content through plain conversation, without navigating menus or filling in forms manually.

You describe what you need in natural language and LeoSuccess takes action inside your workspace. It acts as an agent to carry out tasks, rather than just answering questions.

LeoSuccess is only available with certain packages.

Where to find LeoSuccess

You can find LeoSuccess across LeoCore in the main navigation.

The Tests module in an Example Workspace in LeoCore with a button to Open Leo AI Chat.

When you open LeoSuccess, a chat opens with context depending on where you are in LeoCore.

LeoSuccess open in the Tests module in LeoCore with context set as "Tests".

What permissions LeoSuccess has

LeoSuccess can take actions with the same permissions you have. So, for example, if you have the Observer role in a workspace, you can use LeoSuccess to search and analyze, but not to create or refactor (you don’t have permission to create or edit).

To see your role and manage what roles others have, see more on managing team members.

What LeoSuccess can do

Bear in mind that LeoSuccess is under active development, with new features being added every week. LeoSuccess has the most capabilities in these areas:

Tests

Search for tests

Search for specific tests or tests that meet certain criteria (the platform they test, labels, last updated, or other). You can search by meaning, not only exact text.

Examples:

  • Find exploratory tests for the iOS platform

  • Show me all tests tagged as Payments

  • What tests do we have that deal with logging in?

  • What tests were updated in the past week?

Analyze tests

Analyze individual tests and test coverage across your test suite. Identify unclear or incomplete steps and where you have gaps in your test coverage.

You can also request all feedback from testers on test steps within a test to help you understand where additional clarity might be needed.

Examples:

  • Are the steps in this test clear enough? Should any of them be split into multiple steps?

  • Which features have the fewest tests?

  • Give me a coverage summary of the login feature

  • Summarize the step feedback on this test and suggest what to fix

Refactor tests

If you find any tests that could use improvements, direct LeoSuccess to make changes to them. You can offer specific instructions you want to be carried out or general requests for improvement.

Examples:

  • Mark this test as high priority

  • Refactor this test – the steps are too vague

  • Improve the expected results for the login test

  • Clean up this test to match the exploratory test guidelines

Create tests

Create tests that automatically fit the Testlio guidelines for optimizing test clarity and coverage. You can focus on one test at a time, or create multiple tests at once from a single prompt.

Examples:

  • Create a test for the login flow with invalid credentials

  • Add a test for checkout with an expired payment card and mark it as high priority

Import tests

If you have many tests you want to add to your test suite, get LeoSuccess to help you upload them all in a single file and mapping the columns to the fields in LeoCore.

To upload a file, click + (Attach options) > Upload file.

LeoSuccess for tests with a button to "Attach options" that opens a list with the option to "Upload file".

Once you have uploaded a file, LeoSuccess maps its columns to LeoCore fields and shows you a preview. After confirmation, it creates the tests.

Take action on tests

Archive tests you no longer need. Archiving a test is the same as deleting it.

Examples:

  • Archive TEST-124

  • Archive TEST-11, TEST-12, and TEST-13

  • Archive all the tests tagged with the old Checkout v1 feature we retired

Plans

Search for plans

Search for specific plans and see which tests a plan includes.

Examples:

  • Find me a test plan that covers the checkout process

  • Show me all plans that include a test on adding a credit card

Analyze plans

Analyze individual plans and see where coverage might need to be expanded. Look across your test suite for plans that meet certain criteria.

Examples:

  • Is there anything about this plan that could be improved?

  • What test plans do we have for the mobile app?

Refactor plans

If you find any plans that could use improvements, direct LeoSuccess to make changes to them. You can offer specific instructions you want to be carried out or general requests for improvement.

Examples:

  • Add all Authentication tests to the regression plan

  • Reorder the tests in this plan by priority

  • Add a description to the plan that covers the included tests

Create plans

Create plans to expand your coverage, either one at a time or multiple plans from a single prompt.

Examples:

  • Create a test plan for the Q3 regression cycle

  • Build a plan for payments testing with existing high-priority tests

Issues

Search for issues

Use LeoSuccess to search for specific issues or issues that meet certain criteria (the feature they come from, the labels they have, or other).

Examples:

  • Show me all open high-severity issues about the Payments feature

  • List all issues with the needs-triage label

Analyze issues

Analyze trends in your issues to see what it might mean for your priorities going forward. Find patterns or gaps that might guide what actions you need to take.

Examples:

  • What are the most common severity levels reported this month?

  • Summarize issue trends in Payments over the last quarter

Refactor issues

If you find any issues that could use improvements, direct LeoSuccess to make changes to them. You can offer specific instructions you want to be carried out or general requests for improvement.

Examples:

  • Rewrite this issue description so it's clearer and includes reproduction steps

  • Clean up the description for issue 204 so it's easier to scan

  • Add labels to this issue just like with issue 12345

Create issues

Create issues from a plain description. LeoSuccess shows you the issue and asks before creating it. LeoSuccess asks any questions necessary to get a clear issue.

Examples:

  • Log a new high-severity bug: checkout button unresponsive on iOS Safari

  • Create an issue for the broken CSV export, tagged with Reporting

Take action on issues

Issues have a specific workflow with different statuses. Move issues through the workflow or take other common actions.

Examples:

  • Approve all triaged issues about the Payments feature

  • This issue is fixed – close it for me

Known current limitations

LeoSuccess is under active development and so does not cover every need at the moment. The following list includes areas without features at the moment where work is being done:

  • Doesn’t know current execution. LeoSuccess can’t get context from runs and reports and so can’t tell you information such as what tests are failing.

  • Doesn’t know workspace-specific guidelines. Each workspace can contain specific guidelines such as issue templates to shape how issues and tests are created. These are not currently available to LeoSuccess.

  • Test import only supports CSV and XLSX files.

  • Context is added only at the start of a chat. If you navigate to a different section of LeoCore, you don’t get new context automatically. You can add different context by clicking + (Attach options) > Add current view as context.

  • Can’t archive or comment on issues.

If you run into any issues outside this list, please reach out to your Engagement Manager to let them know.

Did this answer your question?