What does it mean if I can't see any rating?
- You only see a rating after you've participated in your first testing runs and your tasks have been approved.
Do issues closed by clients after approval affect the Issue Acceptance rate?
- No, an issue being approved means the team considers if valuable. If a client later closes it, the Issue Acceptance rate is not affected.
Does the rating include Test Lead tasks as well?
- No it doesn't, the Test Lead tasks are excluded from the rating.
Does a run being cancelled affect my Run Attendance rate?
- No, cancelled runs are excluded from the Run Attendance rate
Do some metrics bear more weight than others?
- Yes, some metrics weigh more than the others.
Can one metric include several sub-metrics?
- No, we don't look at single resolutions separately. We calculate the rates based on approved issues, high priority approved issues, and total issues.
Given that invites come in and expire during the night or when I objectively can't be expected to respond, is there a way to exclude them?
- Invites sent and expired between 11 pm and 7 am (in your local time) do not affect your rating negatively.
Do issues reported two years ago count differently than recently reported issues?
- Yes, the issues reported 1–2 years ago weigh less than the issues you have recently reported.
How does it affect my rating if I test in a workspace where issues are reported on an external platform like Jira?
- It doesn't affect your rating. You are compared to other testers in the same workspace who are also reporting issues on an external platform.
How often is the rating updated?
- The rating is updated daily.
Why isn't my rating changing?
- Your ability to change your rating is affected by all testers in the workspace. Your rating can stay the same if you started to improve or get worse but other testers also started to improve or get worse.
Given that the data goes back up to 2 years, isn't it difficult to improve my rating?
- No. The less you have tested, the easier it is to improve your rating. In addition, events from long ago have less effect than events that happened recently. So if you keep doing well, your rating will improve.
Given that the data goes back up to 2 years, does it affect my rating if I have marked myself as "Away" for a month or more?
- At the moment, the rating counts 24 months back from today and doesn't take inactivity into account.
Why has my rating decreased?
- Your rating is comparative. So if your rating has decreased without your effort changing, it means that other testers in the same workspace are doing better.
My rating just decreased, does it mean I will get fewer invites from now on?
- A slight or infrequent decreases in your rating don't negatively affect your chances of receiving future run invites. The run invites are sent based on a combination of factors including devices, sometimes location, performance, skills, fit to client needs, and availability.
Are the current rating metrics final or is there a possibility new ones will be added in the future?
- We will work on improving the rating system in the future, but the metrics are final for the first stage.
#TestlioBot