Project

General

Profile

CompatibilityTestSuite » History » Version 11

Wolfgang Wiedmeyer, 04/26/2017 11:44 PM
local links for Redmine urls

1 11 Wolfgang Wiedmeyer
Instructions to run and collect results of the android "Compatibility Test Suite":https://source.android.com/compatibility/cts/setup.html for [[ReplicantStatus#Replicant-42|Replicant 4.2]]
2 1 Loic Dachary
3
h1. Installation
4
5
* On a newly installed Ubuntu 14.04
6 3 Loic Dachary
* Install the dependencies
7
** apt-get update
8 4 Loic Dachary
** apt-get install -y android-tools-adb openjdk-6-jdk wget unzip
9 1 Loic Dachary
* Install the "pre-built CTS":https://source.android.com/compatibility/cts/downloads.html (or "build it from source":https://source.android.com/compatibility/cts/development.html#building-and-running-cts)
10
** wget https://dl.google.com/dl/android/cts/android-cts-4.2_r4-linux_x86-arm.zip ; unzip android-cts-4.2_r4-linux_x86-arm.zip
11
** wget https://dl.google.com/dl/android/cts/android-cts-verifier-4.2_r5-linux_x86-arm.zip ; unzip android-cts-verifier-4.2_r5-linux_x86-arm.zip
12
** wget https://dl.google.com/dl/android/cts/android-cts-media-1.2.zip ; unzip android-cts-media-1.2.zip
13 3 Loic Dachary
14 1 Loic Dachary
h1. Device preparation
15
16
* Connect the Replicant 4.2 device to USB and verify *adb* sees it
17
   <pre>
18
# adb devices
19
List of devices attached
20
00090ad763a48f  device
21
4df1066d14d15fbd        device
22
   </pre>
23
* Configure the device (adapted from https://source.android.com/compatibility/cts/setup.html#config_device, not including Wifi, GPS, bluetooth since they are not supported)
24
** Factory data reset the device: *Settings > Backup & reset > Factory data reset*
25
** Set your device's language to English (United States) from: *Settings > Language & input > Language*
26
** Make sure no lock pattern or password is set on the device: *Settings > Security > Screen lock > None*
27 5 Loic Dachary
** Make sure no PIN lock is set on the device: *Settings > Security > Set up SIM card lock > Lock SIM card > unset* (only shows if there is a SIM card in the phone)
28 1 Loic Dachary
** Select: *Settings > Developer options > Stay Awake > On*
29
** Verify *Settings > Developer options > Verify apps over USB* is dimmed and cannot be changed, meaning there is no application to verify apps over USB which is what CTS needs.
30 10 Loic Dachary
** Connect the desktop machine that will be used to test the device with a USB cable. The system shows a dialog asking whether to accept an RSA key that allows debugging through this computer. Select Allow USB debugging. Tick the "Always allow" checkbox.
31 1 Loic Dachary
** Install and configure helper apps on the device:
32
*** adb install -r android-cts/repository/testcases/CtsDelegatingAccessibilityService.apk
33
*** On the device, enable: *Settings > Accessibility > Accessibility > Delegating Accessibility Service*
34
** Copy the CTS media files to the device as follows:
35
   <pre>
36
# adb devices
37
List of devices attached
38
00090ad763a48f  device
39
4df1066d14d15fbd        device
40
# cd android-cts-media-1.2
41
# ./copy_media.sh all -s 00090ad763a48f
42
   </pre>
43
44
h1. Running CTS
45
46
It runs in the background and takes about 8 hours. It will display results as they become available. See "the usage documentation":https://source.android.com/compatibility/cts/run.html#using-cts-v1 for more information.
47
48
<pre>
49
# ./android-cts/tools/cts-tradefed
50 9 Loic Dachary
cts-tf > run cts --plan CTS --disable-reboot
51 1 Loic Dachary
</pre>
52 2 Loic Dachary
53 1 Loic Dachary
The test results are in *./android-cts/repository/results/* and the logs in *./android-cts/repository/logs/*
54 9 Loic Dachary
55 11 Wolfgang Wiedmeyer
Note: the **--disable-reboot** is necessary because of a "cm-10.1.3 bug":/issues/1775