Skip to main content
Get More Details on Device Coverage
Aaron Collier avatar
Written by Aaron Collier
Updated over a week ago

This section of the Devices report offers a deep dive into coverage indicators, with insights into the manufacturers, models, operating systems, and browsers tested.

Track Manufacturers

Indicators on the manufacturers involved in tested devices with example data in the Testlio platform.

Indicator

What It Tracks

What Signals It Might Bring

Manufacturers

The total number of unique device manufacturers included in testing during the period. Automatically compares with the number of manufacturers during the prior period.

Changes in the number of unique device manufacturers can highlight shifts in device diversity or brand focus. Review to ensure all relevant manufacturers are included in testing and adjust as needed.

Manufacturer Coverage

The proportions of device usage across manufacturers.

This metric helps in identifying dominant brands and areas where additional manufacturer coverage may be needed.

Dominant usage of certain manufacturers may indicate bias toward specific brands or a focus on an operating system update. Ensure diverse representation of manufacturers and adjust coverage as needed to align with platform updates or shifts in testing focus.

Devices by Manufacturer

The distribution of devices by manufacturer over time.

This chart provides insight into how brands are tested throughout the period.

Shifts in device distribution by manufacturer can reveal trends in brand usage over time. Compare this data to the list of top devices using the product being tested to ensure the devices being tested align with the target audience and user base.

Track Models

This section provides insights into the distribution and usage of devices by model, enabling teams to track the diversity and representation of specific device models in testing.

Indicators on the models of tested devices with example data in the Testlio platform.

Indicator

What It Tracks

What Signals It Might Bring

Models

The total number of unique device models tested during the period. Automatically compares with the number of models during the prior period.

Changes in the number of unique device models compared to the prior period can indicate shifts in model diversity. Ensure that critical models are included and adjust the testing focus as necessary to capture a representative sample of devices.

Model Coverage

Device usage across models.

This chart helps in identifying the most and least utilized models within the testing process.

Uneven usage across device models may highlight under- or over-utilized models. Review the distribution to ensure the most relevant models are covered without neglecting others, particularly for popular or newer models.

Devices by Model

The distribution of device models over time.

This chart offers insight into model representation and usage trends across the testing period.

Changes in the distribution of device models over time can provide insights into trends and model representation. Ensure that the testing process reflects the diversity of models used by the audience of the product being tested, adjusting for trends or changes in popularity.

Track Operating System (OS) Versions

This section provides insights into the usage and diversity of OS versions across devices, enabling teams to track OS representation in testing.

Indicators on the OS versions of tested devices with example data in the Testlio platform.

Indicator

What It Tracks

What Signals It Might Bring

Operating System

The total number of unique OS versions tested during the period. Automatically compares with the number of OS versions during the prior period.

This metric highlights any changes in OS diversity across testing cycles.

Changes in the number of unique OS versions tested may signal shifts in OS coverage. Ensure testing reflects the diversity of OS versions relevant to the target audience, adjusting as necessary to address emerging trends or updates.

Major Versions

The total number of distinct major versions across all OSs during the period. Automatically compares with the number of major versions during the prior period.

This indicator provides enables you to track version-level coverage changes.

Changes in the number of distinct major OS versions tested may indicate gaps or shifts in coverage. Track version diversity to ensure both popular and less-used versions are adequately tested to avoid missing critical compatibility issues.

Major Version Coverage

A visual representation of device usage across major OS versions.

This chart help in identifying dominant versions and ensuring sufficient testing coverage for less-used versions.

  • Dominant OS versions in testing might signal an over-focus on popular versions.

  • Underrepresented versions could indicate coverage gaps.

Ensure balanced coverage of major versions, particularly for those with significant user bases or upcoming updates.

Devices by Operating System Major Version

The distribution of devices segmented by major OS version over time.

This chart provides insights into trends and shifts in OS testing.

Changes in OS version usage over time can reveal trends in OS adoption and changes in user preferences. Monitor this distribution to ensure comprehensive testing across all relevant OS versions and respond to shifts in usage patterns.

Track Browser and Operating System (OS) Combinations

This section provides insights into the usage of browser and OS combinations, enabling teams to ensure compatibility and coverage across platforms.

Indicators on the browser and OS combinations of tested devices with example data in the Testlio platform.

Indicator

What It Tracks

What Signals It Might Bring

Browser & OS Combinations

The total number of unique browser and OS pairings tested during the period. Automatically compares with the number of combinations during the prior period.

This metric highlights changes in the diversity of combinations tested.

Changes in the number of unique browser and OS pairings may indicate shifts in platform focus. Ensure all critical combinations are tested, adjusting for emerging trends or new platform releases.

Browser & OS Coverage

A visual representation of the proportion of usage across browser and OS pairings.

This chart helps in identifying dominant combinations and potential coverage gaps

An uneven distribution of browser and OS combinations may highlight an over-focus on certain pairings or gaps in others. Review and adjust coverage to ensure balanced testing across all relevant combinations, especially for emerging browsers or OS versions.

Devices by Browser & OS

The distribution of devices segmented by browser and OS combinations over time.

This chart providies insights into testing trends and shifts in platform usage.

Changes in device distribution across browser and OS pairings over time can reveal trends in browser and OS adoption. Monitor these patterns to ensure comprehensive testing across all critical combinations and adjust as user behavior changes.

Did this answer your question?