Instructions to run and collect results of the android Compatibility Test Suite for Replicant 4.2


Device preparation

  • Connect the Replicant 4.2 device to USB and verify adb sees it
    # adb devices
    List of devices attached
    00090ad763a48f  device
    4df1066d14d15fbd        device
  • Configure the device (adapted from, not including Wifi, GPS, bluetooth since they are not supported)
    • Factory data reset the device: Settings > Backup & reset > Factory data reset
    • Set your device's language to English (United States) from: Settings > Language & input > Language
    • Make sure no lock pattern or password is set on the device: Settings > Security > Screen lock > None
    • Make sure no PIN lock is set on the device: Settings > Security > Set up SIM card lock > Lock SIM card > unset (only shows if there is a SIM card in the phone)
    • Select: Settings > Developer options > Stay Awake > On
    • Verify Settings > Developer options > Verify apps over USB is dimmed and cannot be changed, meaning there is no application to verify apps over USB which is what CTS needs.
    • Connect the desktop machine that will be used to test the device with a USB cable. The system shows a dialog asking whether to accept an RSA key that allows debugging through this computer. Select Allow USB debugging. Tick the "Always allow" checkbox.
    • Install and configure helper apps on the device:
      • adb install -r android-cts/repository/testcases/CtsDelegatingAccessibilityService.apk
      • On the device, enable: Settings > Accessibility > Accessibility > Delegating Accessibility Service
    • Copy the CTS media files to the device as follows:
      # adb devices
      List of devices attached
      00090ad763a48f  device
      4df1066d14d15fbd        device
      # cd android-cts-media-1.2
      # ./ all -s 00090ad763a48f

Running CTS

It runs in the background and takes about 8 hours. It will display results as they become available. See the usage documentation for more information.

# ./android-cts/tools/cts-tradefed
cts-tf > run cts --plan CTS --disable-reboot

The test results are in ./android-cts/repository/results/ and the logs in ./android-cts/repository/logs/

Note: the --disable-reboot is necessary because of a cm-10.1.3 bug

Updated by Wolfgang Wiedmeyer about 7 years ago ยท 11 revisions

Also available in: PDF HTML TXT