Test Reports

Last updated at 2020-06-16

Japanese translation unavailable

This page has not been translated into Japanese yet - we apologise for the inconvenience! If you’re interested in helping us out, feel free to translate any article in the jp folder of the DevCenter repository and open a PR!

このページは日本語への翻訳がまだ完了しておりません。ご不便をおかけして申し訳ございません! もしお手伝いできる方がいらっしゃれば、ご自由にjpフォルダの記事を日本語に訳していただき、PRを開いてください

Test Reports allows you to view all your test results in a convenient way.

Use our testing Steps, and all your test results will be deployed to the same directory. From there, Test Reports can process them and display them in a way that’s easy to read and analyze.

Test Reports overview

You can run both UI tests and unit tests on Bitrise and with Test Reports , you can view the results of the different test types on the same page.

Test Reports can read and display test results that are in either of two formats:

You can use Test Reports with four of our testing Steps:

These Steps will run the tests defined in your repository and then store the output in an Environment Variable. The Deploy to Step will do the rest: it can read the results and send it to Test Reports.

Testing guides

Check out our testing guides to read more about how to use these Steps on Bitrise:

Using custom Script Steps

You can use custom Script Steps to export test results to Test Reports. Read the details in our Exporting from custom Script Steps to Test Reports guide.

Configuring Test Reports

Test Reports doesn’t require any sort of complicated configuration. All you need is to have tests in your repository, and two Steps in your Workflow.

Deploy to version

The Deploy to Step must be of version 1.4.1 or newer - older versions of the Step do NOT support Test Reports.

  1. Add tests to your app’s repository.
  2. Add the appropriate testing Steps to your Workflow. For example, if you have an iOS project, you can use the Xcode Test for iOS Step to run Xcode tests.
  3. Make sure you have the Deploy to Step in your Workflow.
  4. Run your build.

And that’s it! Once the build is finished, you will be able to view your test reports.

Checking test results

Test Reports display the most important information about all the tests you ran on the Test Summary tab. You will see all the tests you ran, their duration, and their results. You can also click on the tabs of the individual tests to see their details.

To access the result of a particular test:

  1. Open your app’s page on Bitrise.
  2. Click the Builds tab and select the build that ran the tests.
  3. Under the build status, click See more next to the Test reports label.

    Test Reports

  4. On the Test Summary tab, find the test you want to check.

    Alternatively, on the top bar, click the tab of the test set you want to check out.

    To filter tests based on their results, open the menu on the top right, which is set to All by default.

    Test Reports

  5. Click Test cases to see the details.

    UI tests are grouped according to device while unit tests are grouped according to test cases.

You will find:

Test Reports

You can check, depending on the test type:

As noted above, this depends on test type, too: for unit tests, you won’t see screenshots or videos, of course.

Downloading files

Every file can be downloaded from Test Reports: that includes screenshots, videos, or APK and IPA files.

  1. Open a test set.
  2. On the left menu, click a tab that contains files.

    For example, Test Artifacts.

    Test Reports

  3. Click Download next to the file name.

    If you want to download all files available on the tab, click Download All Files.