Visual testing

Suitest is also able to test the application content visually - based on screen capture. This ability is handy when the content displayed on the screen cannot be covered using elements.

A few examples:

  • Automating device setup task - e.g. setting up a different region for application store on the device.
  • Automating test on platform not supported by Suitest - e.g. with C++ based apps.
  • Checking the content visually - e.g. does the logo have correct new brand colors?

Setup - capturing the screen

In order to make visual testing possible, image capture device needs to be properly configured. Considering also streaming and recording capabilities, Suitest currently offers 3 different image capture sources:

  1. Capturing the HDMI output of the testing device using WingBox
  2. Capturing the screen using Android mobile phone with Suitest Camera app.
  3. Capturing the screen using USB camera

Visual testing features (OCR and image comparison) currently work reliably only when capturing the image over the HDMI with the WingBox. If you want to use the Suitest Camera app or a USB camera, in order to increase the reliability, check the stream to ensure there are no reflections on the screen and the content is in focus through the corresponding lens. Additionally, when using OCR define the region and when using image comparison, make sure that you set up high accuracy and that you define a region.

Visual testing without additional screen capture device

Supported platforms

  • Android
  • Apple iPhone / iPad (iOS) devices and simulators
  • Apple TV (tvOS) devices and simulators
  • Browsers
  • HbbTV (on LG webOS TVs 2016+)
  • LG webOS (2016+)
  • PlayStation 4/5
  • Roku
  • Sky (Entertainment OS)
  • VIDAA - Lite
  • Xbox (One, Series X/S)
  • Xumo (Entertainment OS)
Currently not supported on

  • HbbTV / Freeview Play
  • Samsung Tizen
  • Sky Q
  • VIDAA - Instrumentation library
  • Vizio SmartCast
  • Xfinity / Xumo TV / XClass TV
  • Other Smart TVs and STBs

In case of supported platforms, Suitest does not need any capturing device and visual testing features use device API to receive image capture. However, in specific cases protected content may not be visible for Suitest to be properly evaluated. You can check using Suitest screenshots feature if given content is available.

Once the capturing device is added to Suitest, it needs to be assigned to the testing device.

Visual testing features

In order to store reference images in Suitest for testing purposes take a look at Image repository page.