Project

General

Profile

DeprecatedPortingToAndroid10 » History » Version 137

Denis 'GNUtoo' Carikli, 06/06/2019 04:49 PM
ADB was tested with -eng

1 1 Denis 'GNUtoo' Carikli
h1. Porting Replicant to Android 9
2
3 101 Denis 'GNUtoo' Carikli
{{>toc}}
4 1 Denis 'GNUtoo' Carikli
5 101 Denis 'GNUtoo' Carikli
h2. AOSP 9
6
7
h3. Status with AOSP 9
8
9 98 Denis 'GNUtoo' Carikli
* The Galaxy SIII 4G (i9305) boots (with graphics hacks) under AOSP9, without having to import nonfree libraries:
10 99 Denis 'GNUtoo' Carikli
** The device boots until the lock screen
11 98 Denis 'GNUtoo' Carikli
** The graphics work but are really slow as they have not been optimized
12 49 Denis 'GNUtoo' Carikli
** Sometime the display content is corrupted
13 1 Denis 'GNUtoo' Carikli
** The touchscreen works
14 100 Denis 'GNUtoo' Carikli
* The kernel used is based on Linux 5.0-rc6 and has ~150 Android specific patches on top and some patches for the Galaxy SIII 4G (i9305) on top
15
16
h3.  Repositories and changes
17 46 Denis 'GNUtoo' Carikli
 
18
* git://git.putti.eu/aosp/manifest_i9305.git
19
* git://git.putti.eu/aosp/kernel_i9305.git
20 1 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/device_i9305.git
21 109 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/external_mesa3d.git
22 110 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/build_make.git
23 111 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/core.git
24 1 Denis 'GNUtoo' Carikli
25 100 Denis 'GNUtoo' Carikli
h3. Building AOSP version
26 1 Denis 'GNUtoo' Carikli
27 100 Denis 'GNUtoo' Carikli
h4. Source code
28 88 Denis 'GNUtoo' Carikli
29 46 Denis 'GNUtoo' Carikli
First get the source code:
30 1 Denis 'GNUtoo' Carikli
<pre>
31 46 Denis 'GNUtoo' Carikli
$ repo init -u git://git.putti.eu/aosp/manifest_i9305.git -b android-9.0.0
32 1 Denis 'GNUtoo' Carikli
</pre>
33 88 Denis 'GNUtoo' Carikli
34 100 Denis 'GNUtoo' Carikli
h4. For Trisquel8
35 45 Denis 'GNUtoo' Carikli
<pre>
36 1 Denis 'GNUtoo' Carikli
sudo apt-get install git-core gnupg flex bison gperf build-essential zip curl zlib1g-dev gcc-multilib g++-multilib libc6-dev-i386 lib32ncurses5-dev x11proto-core-dev libx11-dev lib32z-dev libgl1-mesa-dev libxml2-utils xsltproc unzip bc python-mako
37
</pre>
38
39 100 Denis 'GNUtoo' Carikli
h4. Building it
40 88 Denis 'GNUtoo' Carikli
41
Once this is done, see the device/putti/i9305/README.md for the build instructions.
42
43 100 Denis 'GNUtoo' Carikli
h4. Trisquel 8 LXC
44 88 Denis 'GNUtoo' Carikli
45
If you use Parabola, you may be interested in running Trisquel 8 in LXC.
46
47
To do that first debootstrap a Trisquel 8 rootfs. 
48
49
Parabola's debootstrap does support Trisquel 8 and its manual has an example on how to do that:
50
<pre>
51
$ man debootstrap
52
[...]
53
# debootstrap flidas flidas-root http://archive.trisquel.info/trisquel
54
</pre>
55
56
Then you can use virt-manager to setup the LXC instance.
57
58 89 Denis 'GNUtoo' Carikli
The advantages of this solution are that:
59 88 Denis 'GNUtoo' Carikli
* The LXC guest and host shares their resources (CPU, RAM) with almost no penalty
60
* Trisquel 8 is not a rolling release distribution
61
62
The disadvantage of this solution are that:
63
* you need to configure again the Trisquel 8 LXC instance (vimrc, sshd_config, etc)
64 1 Denis 'GNUtoo' Carikli
* It's more complicated to setup
65 90 Denis 'GNUtoo' Carikli
* The Android build system output a warning message about not being able to use namespaces which may become mandatory in newer Android versions
66 48 Denis 'GNUtoo' Carikli
67 102 Denis 'GNUtoo' Carikli
h2. LineageOS 16
68
69 120 Denis 'GNUtoo' Carikli
h3. Status with LineageOS 16
70 1 Denis 'GNUtoo' Carikli
71 121 Denis 'GNUtoo' Carikli
For now the focus is on rebasing all the changes on top of LineageOS 16:
72
* nothing is usable so far, nothing has been tested yet on real devices
73 122 Denis 'GNUtoo' Carikli
* it can build images but it most probably contains proprietary software as it has not been removed yet
74 121 Denis 'GNUtoo' Carikli
* the commits and the manifests are constantly rebased
75 105 Denis 'GNUtoo' Carikli
76 120 Denis 'GNUtoo' Carikli
h3. Repositories and changes for LineageOS 16
77 105 Denis 'GNUtoo' Carikli
78 114 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/kernel_i9305.git
79 1 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/external_mesa3d.git
80
* https://git.replicant.us/GNUtoo/android_build.git
81
* https://git.replicant.us/GNUtoo/device_i9305.git
82 116 Denis 'GNUtoo' Carikli
* https://git.replicant.us/GNUtoo/manifest.git
83
* https://git.replicant.us/GNUtoo/vendor_replicant.git
84 120 Denis 'GNUtoo' Carikli
85
h3. Building LineageOS 16 version
86 102 Denis 'GNUtoo' Carikli
87 1 Denis 'GNUtoo' Carikli
h4. Source code
88 102 Denis 'GNUtoo' Carikli
89 1 Denis 'GNUtoo' Carikli
<pre>
90
$ rm -rf .repo/manifests/ # This enables me to force push and rebase the manifest repository as well
91 133 Denis 'GNUtoo' Carikli
$ repo init -u https://git.replicant.us/GNUtoo/manifest.git -b GNUtoo/lineage-16.0-base
92 117 Denis 'GNUtoo' Carikli
$ repo sync --force-sync
93 102 Denis 'GNUtoo' Carikli
</pre>
94
95
h4. For Trisquel8
96 107 Denis 'GNUtoo' Carikli
<pre>
97 102 Denis 'GNUtoo' Carikli
sudo apt-get install bc bison build-essential ccache curl flex g++-multilib gcc-multilib git gnupg gperf imagemagick lib32ncurses5-dev lib32readline-dev lib32z1-dev liblz4-tool libncurses5-dev libsdl1.2-dev libssl-dev libwxgtk3.0-dev libxml2 libxml2-utils lzop pngcrush rsync schedtool squashfs-tools xsltproc zip zlib1g-dev gcc-5-arm-linux-gnueabi
98 104 Denis 'GNUtoo' Carikli
</pre>
99 1 Denis 'GNUtoo' Carikli
100 104 Denis 'GNUtoo' Carikli
h4. Launching the build
101 1 Denis 'GNUtoo' Carikli
102 118 Denis 'GNUtoo' Carikli
Follow the "i9300 manifest instructions:":https://github.com/CustomRoms/android_local_manifests_i9300
103 104 Denis 'GNUtoo' Carikli
<pre>
104 118 Denis 'GNUtoo' Carikli
$ subject='/C=US/ST=California/L=Mountain View/O=Android/OU=Android/CN=Android/emailAddress=android@android.com'
105
$ mkdir .android-certs
106
$ for x in releasekey platform shared media testkey; do \
107
  ./development/tools/make_key .android-certs/$x "$subject"; \
108
  done
109
$ parallel_tasks=$(echo "$(grep 'processor' /proc/cpuinfo | wc -l ) + 1" | bc)
110 104 Denis 'GNUtoo' Carikli
$ source build/envsetup.sh
111 137 Denis 'GNUtoo' Carikli
$ lunch lineage_i9305-eng
112 118 Denis 'GNUtoo' Carikli
$ make -j${parallel_tasks} bacon
113 87 Denis 'GNUtoo' Carikli
</pre>
114 136 Denis 'GNUtoo' Carikli
115
The images can then be flashed with heimdall. They are then in:
116
<pre>
117
  out/target/product/i9305/obj/PACKAGING/target_files_intermediates/lineage_i9305-target_files-eng.replicant/IMAGES/
118
</pre>
119
120 87 Denis 'GNUtoo' Carikli
h2. TODO
121 51 Denis 'GNUtoo' Carikli
122 74 Denis 'GNUtoo' Carikli
First month of full time equivalent work:
123 81 Denis 'GNUtoo' Carikli
124 127 Denis 'GNUtoo' Carikli
|_. Time estimation  |_.Task |_. Comments |
125
| DONE | -boot a device under AOSP9- | Only boots with graphics, not much more |
126
| -7h- DONE | -build it under a "FSDG compliant distribution":https://www.gnu.org/distros/free-distros.html like Trisquel8- | -WIP for AOSP, It's difficult to do precise time estimations as it could work out of the box or require one full time month of work depending on how much issues are encountered- 
127 59 Denis 'GNUtoo' Carikli
Builds under Trisquel8|
128 127 Denis 'GNUtoo' Carikli
| 21h | * port the changes from AOSP9 to LineageOS 16
129 73 Denis 'GNUtoo' Carikli
* cleanup the code
130
* build the kernel from the Android build system
131 125 Denis 'GNUtoo' Carikli
* -make sure it builds with an FSDG compliant distribution-
132 127 Denis 'GNUtoo' Carikli
* -document the build procedure- | |
133
| 14h | find, remove and document proprietary software in LineageOS 16 | |
134
| 21h | find, remove and document privacy issues in LineageOS 16 | |
135
| 7h | port the touch keys Linux driver | |
136
| 7h | upstream the AAT1290 flash led Linux -driver- dts for the galaxy-s3 boards | Upstream has already a driver, only the device DTS seem to be lacking. Simon Shields commit doesn't have a signed-off-by. |
137
| 7h | rebrand LineageOS as Replicant | |
138
| 70h | port and cleanup the the Galaxy SIII (i9300) "modem":https://github.com/fourkbomb/linux/tree/modem Linux driver from 4.16 to 5.0| |
139
|_\3. Total: 147h (~1 month) |
140 95 Denis 'GNUtoo' Carikli
141 75 Denis 'GNUtoo' Carikli
Second month of full time equivalent work:
142 1 Denis 'GNUtoo' Carikli
| * port  libsamsung-ril and libsamsung-ipc to Android 9
143
* Make the modem driver and libsamsung-ipc work together | 157h | -libsamsung-ipc should be trivial, libsamsung-ril probably needs to be heavily adapted to Trebble or the new RIL interfaces-
144 125 Denis 'GNUtoo' Carikli
libsamsung-ipc and samsung-ril were fixed to compile on Android 9.
145
The code was not yet tested at runtime.
146
It also probably still need to be adapted to trebble or the new RIL interfaces to be more substainable. |
147 1 Denis 'GNUtoo' Carikli
|_. Total |_. 157h | ~1 month |
148
149
Third month of full time equivalent work:
150 75 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
151 125 Denis 'GNUtoo' Carikli
| -port the sensors libraries and other device specific libraries- | -70h- | Already done by the unofficial LineageOS port of the Galaxy SIII (i9300), needs testing |
152
| add support for Audio with the upstream kernel driver | 70h | Might be way faster, depending on what Android 9 uses |
153
| add partial (no modem) support for the -Galaxy SIII (i9300)- Galaxy SIII 4G (i9305) and factorize the code with i9305 | 14h | The work for the Galaxy SIII (i9300) has already been done by the unofficial LineageOS port.
154
It needs to be adapted to the upstream kernel and not to use proprietary libraries.
155
It also needs to be adapted to the Galaxy SIII 4G (i9305) |
156 1 Denis 'GNUtoo' Carikli
|_. Total |_. 154h | ~1 month |
157 67 Denis 'GNUtoo' Carikli
158 71 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
159 96 Denis 'GNUtoo' Carikli
| create a recovery | 21h | |
160 74 Denis 'GNUtoo' Carikli
| add internal WiFi support and validate the functionality | 6h | |
161 71 Denis 'GNUtoo' Carikli
| add external WiFi dongles support | 20h | External dongles support might be tricky |
162 125 Denis 'GNUtoo' Carikli
| -create new- update the install and upgrade instructions | -35h- | -Our current install instructions don't scale as we have one copy for each device.-
163
-We also created generic instructions but they tend to be harder to follow[1] than the device specific ones.-
164
-This will be made in a modular format (for instance in LaTeX) that enables to generate per device install instructions without requiring to have multiples copy of the same text.-
165
-The instructions will need to be able to be modified and compiled on an FSDG compliant distribution.- |
166 92 Denis 'GNUtoo' Carikli
167 71 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
168
| Estimate the amount of work to Reduce the attack surface | ? | |
169 1 Denis 'GNUtoo' Carikli
| Estimate the amount of work to add in-system upgrades | ? | |
170
171 82 Denis 'GNUtoo' Carikli
fn1. The generic instructions were tested at Install parties in Paris 
172 1 Denis 'GNUtoo' Carikli
173 85 Denis 'GNUtoo' Carikli
h3. Devices support:
174 1 Denis 'GNUtoo' Carikli
175 77 Denis 'GNUtoo' Carikli
h4. Easy, because it's similar enough to the Galaxy SIII (I9300)
176 97 Denis 'GNUtoo' Carikli
177
|_\3. Galaxy Note II (N7100) |
178 94 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
179 86 Denis 'GNUtoo' Carikli
| port the EA8061 LCD Linux driver | 35h | |
180
| port the S6EVR02 LCD Linux driver | 35h | |
181
| port the MAX77693 flash led Linux driver | 7h | |
182
| android: add support for the Note II (N7100) and factorize the code with Galaxy SIII (i9300) and Galaxy SIII 4G (i9305) | 14h | Should be similar to the Galaxy SIII |
183
| port the sensors libraries and other device specific libraries | 70h | It's difficult to evaluate how much time it could take |
184 125 Denis 'GNUtoo' Carikli
| add support for Audio with the upstream kernel driver | 14h | Should be similar to the Galaxy SIII |
185 86 Denis 'GNUtoo' Carikli
186 1 Denis 'GNUtoo' Carikli
|_\3. Galaxy Note 8.0 (N5100) and 8.0 WiFi (N5110) |
187 70 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
188
| Evaluate the time required to do the port | 14h | TODO |
189 69 Denis 'GNUtoo' Carikli
190 94 Denis 'GNUtoo' Carikli
h4. Needs more work and unknown upstream Linux status
191
192 54 Denis 'GNUtoo' Carikli
|_. Device |_. Time estimation |_. Comments |
193
| Galaxy S II (i9100) | | Linux: devboard dts upstream? unknown status |
194
| Galaxy Note (N7000) | | unknown Linux upstream status |
195 34 Denis 'GNUtoo' Carikli
| Galaxy Nexus (I9250) | |/2. OMAP4, no dts upsrteam |
196
| Galaxy Tab 2 7.0 (P3100), 7.0 WiFi (P3110), 10.1 (P5100), 10.1 WiFi (P5110) | |
197 2 Denis 'GNUtoo' Carikli
| GTA04 >= A4 | | TODO: a RIL needs to be written, userspace GPS support is missing, audio scenarios, etc |
198 4 Denis 'GNUtoo' Carikli
199 128 Denis 'GNUtoo' Carikli
h2. Documentation
200 1 Denis 'GNUtoo' Carikli
201 128 Denis 'GNUtoo' Carikli
h3. Replicant 6.0 changes
202
203 32 Denis 'GNUtoo' Carikli
|_. Repository path |_. rebase worked |_. Changes |
204 5 Denis 'GNUtoo' Carikli
| build | No | |
205 31 Denis 'GNUtoo' Carikli
| manifest | No | N/A |
206 4 Denis 'GNUtoo' Carikli
| bootable/recovery | Yes | * UI changes to improve usability 
207
* Branding
208
* Small fix(es) | 
209
| external/boringssl | Yes | * Small fix(es) |
210
| external/heimdall | No | |
211
| frameworks/av | Yes | * Software rendering fix(es) |
212 1 Denis 'GNUtoo' Carikli
| frameworks/base | Yes | * WiFi fixe(s) for external dongles
213 5 Denis 'GNUtoo' Carikli
* Software rendering fix(es) 
214
* Privacy fix(es) 
215
* Security improvements 
216 10 Denis 'GNUtoo' Carikli
* Usability improvements |
217 5 Denis 'GNUtoo' Carikli
| frameworks/native | No |
218
| hardware/broadcom/wlan | Yes | * Remove nonfree software |
219 33 Denis 'GNUtoo' Carikli
| hardware/libhardware | Yes | * Software rendering fix(es) |
220
| hardware/libhardware_legacy | Yes | * Don't depend on nonfree software |
221 6 Denis 'GNUtoo' Carikli
| hardware/ti/omap4 | Yes | * Remove nonfree software 
222 8 Denis 'GNUtoo' Carikli
* Don't depend on nonfree software 
223 33 Denis 'GNUtoo' Carikli
* Small fix(es) |
224 7 Denis 'GNUtoo' Carikli
| libcore | Yes | * Small fix(es) | 
225 33 Denis 'GNUtoo' Carikli
| packages/apps/Browser | Yes | * Privacy fix(es) 
226 22 Denis 'GNUtoo' Carikli
* Branding
227
* Small fix(es) |
228 11 Denis 'GNUtoo' Carikli
| packages/apps/LegacyCamera | Yes | * Software rendering fix(es)
229
* Small fix(es) |
230
| packages/apps/RepWifi | Not upstreamed, obsolete | N/A |
231
| packages/apps/ReplicantWallpapers | Not upstreamed | * Branding |
232 12 Denis 'GNUtoo' Carikli
| packages/apps/Settings | No | |
233
| packages/apps/SetupWizard | Yes | * Privacy fix(es) 
234 33 Denis 'GNUtoo' Carikli
* Don't depend on nonfree software
235 13 Denis 'GNUtoo' Carikli
* Branding |
236
| packages/apps/ThemeChooser | Yes | * Privacy fix(es) ?
237
* Don't depend on nonfree software ? |
238
| packages/providers/ContactsProvider | Yes | * Small fix(es) |
239 14 Denis 'GNUtoo' Carikli
| system/core | Yes | * Branding
240
* various fixes |
241
| vendor/replicant | No | |
242
| vendor/cmsdk | Yes | * Branding |
243
| external/chromium-webview | ? | ? |
244 33 Denis 'GNUtoo' Carikli
| external/drm_gralloc | Yes | * Software rendering fix(es) |
245 14 Denis 'GNUtoo' Carikli
| external/llvm | Yes | * Software rendering fix(es) |
246
| external/mesa3d |  Yes | * Software rendering fix(es)
247
* Performance debugging for software rendering |
248 33 Denis 'GNUtoo' Carikli
| external/parameter-framework | Yes | * Small fix(es) |
249
| external/protobuf | N/A | No changes |
250 14 Denis 'GNUtoo' Carikli
| prebuilts/ndk | ? | ? |
251 33 Denis 'GNUtoo' Carikli
| prebuilts/sdk | ? | ? |
252
| sdk | Yes | * Small fix(es) |
253 22 Denis 'GNUtoo' Carikli
| toolchain/src/binutils | Yes | * Small fix(es) |
254 1 Denis 'GNUtoo' Carikli
| toolchain/src/gcc | No | |
255
| toolchain/src/jack | Yes | * Small fix(es) |
256 20 Denis 'GNUtoo' Carikli
| toolchain/src/jill | Yes | * Small fix(es) |
257 33 Denis 'GNUtoo' Carikli
| kernel/samsung/smdk4412 |/3. Yes |/3. * Security fixes
258 22 Denis 'GNUtoo' Carikli
* Privacy Fixes (TrustZone)
259
* Don't depend on nonfree software
260 28 Denis 'GNUtoo' Carikli
* Remove nonfree software
261
* Small fix(es) |
262
| kernel/samsung/tuna |
263 25 Denis 'GNUtoo' Carikli
| kernel/samsung/espresso10 |
264 29 Denis 'GNUtoo' Carikli
| device/samsung/i9100 | No |/14. * Replace nonfree software by free software
265
* free software sensors implementation(s)
266
* free software modem audio implementation(s)
267 1 Denis 'GNUtoo' Carikli
* Software rendering fix(es)
268 33 Denis 'GNUtoo' Carikli
* Privacy Fixes (TrustZone)
269 1 Denis 'GNUtoo' Carikli
* Don't depend on nonfree software
270
* Remove nonfree software
271
* Branding
272
* Small fix(es) |
273 29 Denis 'GNUtoo' Carikli
| device/samsung/n7000 | Yes |
274
| device/samsung/i9300 | No |
275
| device/samsung/i9305 | No |
276
| device/samsung/n7100 | Yes |
277 30 Denis 'GNUtoo' Carikli
| device/samsung/n5100 | Yes |
278
| device/samsung/n5110 | Yes |
279
| device/samsung/maguro | Yes |
280
| device/samsung/tuna | Yes |
281
| device/samsung/espressowifi | Yes |
282 22 Denis 'GNUtoo' Carikli
| device/samsung/espresso3g | Yes |
283
| device/samsung/galaxys2-common | Yes |
284 23 Denis 'GNUtoo' Carikli
| device/samsung/smdk4412-common | No |
285 40 Denis 'GNUtoo' Carikli
| device/samsung/kona-common | Yes |
286
| hardware/ril/samsung-ril | Not upstreamed | N/A |
287
| external/libsamsung-ipc | Not upstreamed | N/A |
288 1 Denis 'GNUtoo' Carikli
| hardware/tinyalsa-audio | Not upstreamed? | N/A |
289 128 Denis 'GNUtoo' Carikli
290
h3. CustomROMs i9300 components
291
292 131 Denis 'GNUtoo' Carikli
|_. Repository |_. Tree path |_. Dependencies |_. Function |_. Comments |
293
|/8. https://github.com/CustomROMs/android_hardware_samsung
294
lineage-16.0 branch | hardware/samsung/macloader | | Loads the MAC Address of the WiFi network interface | Might be useful |
295
| hardware/samsung/wifiloader | | Loads the wifi kernel module (like modprobe) and setup firmware filesystems permissions | May be useful |
296
| hardware/samsung/audio | | seems to contains ril related stuff as well | Look if the ril stuff is required, go for standard audio |
297
| hardware/samsung/lineagehw/hidl/livedisplay | | livedisplay is a feature similar to what redshift does on GNU/Linux | Not sure if it works with mainline |
298
| hardware/samsung/exynos/multimedia/utils/ | seem meant for audio/video decoding offload | assembly obtimized color conversion and resize code | check assembly code license, not sure if useful |
299
| all other directories in hardware/samsung/exynos/ | nonfree firmwares, nonfree software?, smdk kernel? | audio/video decoding offload | Avoid using that |
300
| hardware/samsung/exynos3 |/2. nonfree firmwares?, nonfree software?, smdk kernel? |/2. some light libraries, display stuff (gralloc, etc), 2D acceleration (FIMG), camera (FIMC), 3D acceleration, etc |/2. Avoid using that for now |
301
| hardware/samsung/exynos4 | 
302 1 Denis 'GNUtoo' Carikli
303
h2. Links 
304
305
* https://source.android.com/setup/build/requirements
306 132 Denis 'GNUtoo' Carikli
* https://forum.xda-developers.com/galaxy-s3/development/rom-lineageos-16-0-t3875899 : status of the unofficial LineageOS port