Project

General

Profile

DeprecatedPortingToAndroid10 » History » Version 136

Denis 'GNUtoo' Carikli, 06/05/2019 02:47 PM

1 1 Denis 'GNUtoo' Carikli
h1. Porting Replicant to Android 9
2
3 101 Denis 'GNUtoo' Carikli
{{>toc}}
4 1 Denis 'GNUtoo' Carikli
5 101 Denis 'GNUtoo' Carikli
h2. AOSP 9
6
7
h3. Status with AOSP 9
8
9 98 Denis 'GNUtoo' Carikli
* The Galaxy SIII 4G (i9305) boots (with graphics hacks) under AOSP9, without having to import nonfree libraries:
10 99 Denis 'GNUtoo' Carikli
** The device boots until the lock screen
11 98 Denis 'GNUtoo' Carikli
** The graphics work but are really slow as they have not been optimized
12 49 Denis 'GNUtoo' Carikli
** Sometime the display content is corrupted
13 1 Denis 'GNUtoo' Carikli
** The touchscreen works
14 100 Denis 'GNUtoo' Carikli
* The kernel used is based on Linux 5.0-rc6 and has ~150 Android specific patches on top and some patches for the Galaxy SIII 4G (i9305) on top
15
16
h3.  Repositories and changes
17 46 Denis 'GNUtoo' Carikli
 
18
* git://git.putti.eu/aosp/manifest_i9305.git
19
* git://git.putti.eu/aosp/kernel_i9305.git
20 1 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/device_i9305.git
21 109 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/external_mesa3d.git
22 110 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/build_make.git
23 111 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/core.git
24 1 Denis 'GNUtoo' Carikli
25 100 Denis 'GNUtoo' Carikli
h3. Building AOSP version
26 1 Denis 'GNUtoo' Carikli
27 100 Denis 'GNUtoo' Carikli
h4. Source code
28 88 Denis 'GNUtoo' Carikli
29 46 Denis 'GNUtoo' Carikli
First get the source code:
30 1 Denis 'GNUtoo' Carikli
<pre>
31 46 Denis 'GNUtoo' Carikli
$ repo init -u git://git.putti.eu/aosp/manifest_i9305.git -b android-9.0.0
32 1 Denis 'GNUtoo' Carikli
</pre>
33 88 Denis 'GNUtoo' Carikli
34 100 Denis 'GNUtoo' Carikli
h4. For Trisquel8
35 45 Denis 'GNUtoo' Carikli
<pre>
36 1 Denis 'GNUtoo' Carikli
sudo apt-get install git-core gnupg flex bison gperf build-essential zip curl zlib1g-dev gcc-multilib g++-multilib libc6-dev-i386 lib32ncurses5-dev x11proto-core-dev libx11-dev lib32z-dev libgl1-mesa-dev libxml2-utils xsltproc unzip bc python-mako
37
</pre>
38
39 100 Denis 'GNUtoo' Carikli
h4. Building it
40 88 Denis 'GNUtoo' Carikli
41
Once this is done, see the device/putti/i9305/README.md for the build instructions.
42
43 100 Denis 'GNUtoo' Carikli
h4. Trisquel 8 LXC
44 88 Denis 'GNUtoo' Carikli
45
If you use Parabola, you may be interested in running Trisquel 8 in LXC.
46
47
To do that first debootstrap a Trisquel 8 rootfs. 
48
49
Parabola's debootstrap does support Trisquel 8 and its manual has an example on how to do that:
50
<pre>
51
$ man debootstrap
52
[...]
53
# debootstrap flidas flidas-root http://archive.trisquel.info/trisquel
54
</pre>
55
56
Then you can use virt-manager to setup the LXC instance.
57
58 89 Denis 'GNUtoo' Carikli
The advantages of this solution are that:
59 88 Denis 'GNUtoo' Carikli
* The LXC guest and host shares their resources (CPU, RAM) with almost no penalty
60
* Trisquel 8 is not a rolling release distribution
61
62
The disadvantage of this solution are that:
63
* you need to configure again the Trisquel 8 LXC instance (vimrc, sshd_config, etc)
64 1 Denis 'GNUtoo' Carikli
* It's more complicated to setup
65 90 Denis 'GNUtoo' Carikli
* The Android build system output a warning message about not being able to use namespaces which may become mandatory in newer Android versions
66 48 Denis 'GNUtoo' Carikli
67 102 Denis 'GNUtoo' Carikli
h2. LineageOS 16
68
69 120 Denis 'GNUtoo' Carikli
h3. Status with LineageOS 16
70 1 Denis 'GNUtoo' Carikli
71 121 Denis 'GNUtoo' Carikli
For now the focus is on rebasing all the changes on top of LineageOS 16:
72
* nothing is usable so far, nothing has been tested yet on real devices
73 122 Denis 'GNUtoo' Carikli
* it can build images but it most probably contains proprietary software as it has not been removed yet
74 121 Denis 'GNUtoo' Carikli
* the commits and the manifests are constantly rebased
75 105 Denis 'GNUtoo' Carikli
76 120 Denis 'GNUtoo' Carikli
h3. Repositories and changes for LineageOS 16
77 105 Denis 'GNUtoo' Carikli
78 114 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/kernel_i9305.git
79 1 Denis 'GNUtoo' Carikli
* git://git.putti.eu/aosp/external_mesa3d.git
80
* https://git.replicant.us/GNUtoo/android_build.git
81
* https://git.replicant.us/GNUtoo/device_i9305.git
82 116 Denis 'GNUtoo' Carikli
* https://git.replicant.us/GNUtoo/manifest.git
83
* https://git.replicant.us/GNUtoo/vendor_replicant.git
84 120 Denis 'GNUtoo' Carikli
85
h3. Building LineageOS 16 version
86 102 Denis 'GNUtoo' Carikli
87 1 Denis 'GNUtoo' Carikli
h4. Source code
88 102 Denis 'GNUtoo' Carikli
89 1 Denis 'GNUtoo' Carikli
<pre>
90
$ rm -rf .repo/manifests/ # This enables me to force push and rebase the manifest repository as well
91 133 Denis 'GNUtoo' Carikli
$ repo init -u https://git.replicant.us/GNUtoo/manifest.git -b GNUtoo/lineage-16.0-base
92 117 Denis 'GNUtoo' Carikli
$ repo sync --force-sync
93 102 Denis 'GNUtoo' Carikli
</pre>
94
95
h4. For Trisquel8
96 107 Denis 'GNUtoo' Carikli
<pre>
97 102 Denis 'GNUtoo' Carikli
sudo apt-get install bc bison build-essential ccache curl flex g++-multilib gcc-multilib git gnupg gperf imagemagick lib32ncurses5-dev lib32readline-dev lib32z1-dev liblz4-tool libncurses5-dev libsdl1.2-dev libssl-dev libwxgtk3.0-dev libxml2 libxml2-utils lzop pngcrush rsync schedtool squashfs-tools xsltproc zip zlib1g-dev gcc-5-arm-linux-gnueabi
98 104 Denis 'GNUtoo' Carikli
</pre>
99 1 Denis 'GNUtoo' Carikli
100 104 Denis 'GNUtoo' Carikli
h4. Launching the build
101 1 Denis 'GNUtoo' Carikli
102 118 Denis 'GNUtoo' Carikli
Follow the "i9300 manifest instructions:":https://github.com/CustomRoms/android_local_manifests_i9300
103 104 Denis 'GNUtoo' Carikli
<pre>
104 118 Denis 'GNUtoo' Carikli
$ subject='/C=US/ST=California/L=Mountain View/O=Android/OU=Android/CN=Android/emailAddress=android@android.com'
105
$ mkdir .android-certs
106
$ for x in releasekey platform shared media testkey; do \
107
  ./development/tools/make_key .android-certs/$x "$subject"; \
108
  done
109
$ parallel_tasks=$(echo "$(grep 'processor' /proc/cpuinfo | wc -l ) + 1" | bc)
110 104 Denis 'GNUtoo' Carikli
$ source build/envsetup.sh
111 135 Denis 'GNUtoo' Carikli
$ lunch lineage_i9305-userdebug
112 118 Denis 'GNUtoo' Carikli
$ make -j${parallel_tasks} bacon
113 38 Denis 'GNUtoo' Carikli
</pre>
114 87 Denis 'GNUtoo' Carikli
115 136 Denis 'GNUtoo' Carikli
116
The images can then be flashed with heimdall. They are then in:
117
<pre>
118
  out/target/product/i9305/obj/PACKAGING/target_files_intermediates/lineage_i9305-target_files-eng.replicant/IMAGES/
119
</pre>
120
121 87 Denis 'GNUtoo' Carikli
h2. TODO
122 51 Denis 'GNUtoo' Carikli
123 74 Denis 'GNUtoo' Carikli
First month of full time equivalent work:
124 81 Denis 'GNUtoo' Carikli
125 127 Denis 'GNUtoo' Carikli
|_. Time estimation  |_.Task |_. Comments |
126
| DONE | -boot a device under AOSP9- | Only boots with graphics, not much more |
127
| -7h- DONE | -build it under a "FSDG compliant distribution":https://www.gnu.org/distros/free-distros.html like Trisquel8- | -WIP for AOSP, It's difficult to do precise time estimations as it could work out of the box or require one full time month of work depending on how much issues are encountered- 
128 59 Denis 'GNUtoo' Carikli
Builds under Trisquel8|
129 127 Denis 'GNUtoo' Carikli
| 21h | * port the changes from AOSP9 to LineageOS 16
130 73 Denis 'GNUtoo' Carikli
* cleanup the code
131
* build the kernel from the Android build system
132 125 Denis 'GNUtoo' Carikli
* -make sure it builds with an FSDG compliant distribution-
133 127 Denis 'GNUtoo' Carikli
* -document the build procedure- | |
134
| 14h | find, remove and document proprietary software in LineageOS 16 | |
135
| 21h | find, remove and document privacy issues in LineageOS 16 | |
136
| 7h | port the touch keys Linux driver | |
137
| 7h | upstream the AAT1290 flash led Linux -driver- dts for the galaxy-s3 boards | Upstream has already a driver, only the device DTS seem to be lacking. Simon Shields commit doesn't have a signed-off-by. |
138
| 7h | rebrand LineageOS as Replicant | |
139
| 70h | port and cleanup the the Galaxy SIII (i9300) "modem":https://github.com/fourkbomb/linux/tree/modem Linux driver from 4.16 to 5.0| |
140
|_\3. Total: 147h (~1 month) |
141 95 Denis 'GNUtoo' Carikli
142 75 Denis 'GNUtoo' Carikli
Second month of full time equivalent work:
143 1 Denis 'GNUtoo' Carikli
| * port  libsamsung-ril and libsamsung-ipc to Android 9
144
* Make the modem driver and libsamsung-ipc work together | 157h | -libsamsung-ipc should be trivial, libsamsung-ril probably needs to be heavily adapted to Trebble or the new RIL interfaces-
145 125 Denis 'GNUtoo' Carikli
libsamsung-ipc and samsung-ril were fixed to compile on Android 9.
146
The code was not yet tested at runtime.
147
It also probably still need to be adapted to trebble or the new RIL interfaces to be more substainable. |
148 1 Denis 'GNUtoo' Carikli
|_. Total |_. 157h | ~1 month |
149
150
Third month of full time equivalent work:
151 75 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
152 125 Denis 'GNUtoo' Carikli
| -port the sensors libraries and other device specific libraries- | -70h- | Already done by the unofficial LineageOS port of the Galaxy SIII (i9300), needs testing |
153
| add support for Audio with the upstream kernel driver | 70h | Might be way faster, depending on what Android 9 uses |
154
| add partial (no modem) support for the -Galaxy SIII (i9300)- Galaxy SIII 4G (i9305) and factorize the code with i9305 | 14h | The work for the Galaxy SIII (i9300) has already been done by the unofficial LineageOS port.
155
It needs to be adapted to the upstream kernel and not to use proprietary libraries.
156
It also needs to be adapted to the Galaxy SIII 4G (i9305) |
157 1 Denis 'GNUtoo' Carikli
|_. Total |_. 154h | ~1 month |
158 67 Denis 'GNUtoo' Carikli
159 71 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
160 96 Denis 'GNUtoo' Carikli
| create a recovery | 21h | |
161 74 Denis 'GNUtoo' Carikli
| add internal WiFi support and validate the functionality | 6h | |
162 71 Denis 'GNUtoo' Carikli
| add external WiFi dongles support | 20h | External dongles support might be tricky |
163 125 Denis 'GNUtoo' Carikli
| -create new- update the install and upgrade instructions | -35h- | -Our current install instructions don't scale as we have one copy for each device.-
164
-We also created generic instructions but they tend to be harder to follow[1] than the device specific ones.-
165
-This will be made in a modular format (for instance in LaTeX) that enables to generate per device install instructions without requiring to have multiples copy of the same text.-
166
-The instructions will need to be able to be modified and compiled on an FSDG compliant distribution.- |
167 92 Denis 'GNUtoo' Carikli
168 71 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
169
| Estimate the amount of work to Reduce the attack surface | ? | |
170 1 Denis 'GNUtoo' Carikli
| Estimate the amount of work to add in-system upgrades | ? | |
171
172 82 Denis 'GNUtoo' Carikli
fn1. The generic instructions were tested at Install parties in Paris 
173 1 Denis 'GNUtoo' Carikli
174 85 Denis 'GNUtoo' Carikli
h3. Devices support:
175 1 Denis 'GNUtoo' Carikli
176 77 Denis 'GNUtoo' Carikli
h4. Easy, because it's similar enough to the Galaxy SIII (I9300)
177 97 Denis 'GNUtoo' Carikli
178
|_\3. Galaxy Note II (N7100) |
179 94 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
180 86 Denis 'GNUtoo' Carikli
| port the EA8061 LCD Linux driver | 35h | |
181
| port the S6EVR02 LCD Linux driver | 35h | |
182
| port the MAX77693 flash led Linux driver | 7h | |
183
| android: add support for the Note II (N7100) and factorize the code with Galaxy SIII (i9300) and Galaxy SIII 4G (i9305) | 14h | Should be similar to the Galaxy SIII |
184
| port the sensors libraries and other device specific libraries | 70h | It's difficult to evaluate how much time it could take |
185 125 Denis 'GNUtoo' Carikli
| add support for Audio with the upstream kernel driver | 14h | Should be similar to the Galaxy SIII |
186 86 Denis 'GNUtoo' Carikli
187 1 Denis 'GNUtoo' Carikli
|_\3. Galaxy Note 8.0 (N5100) and 8.0 WiFi (N5110) |
188 70 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
189
| Evaluate the time required to do the port | 14h | TODO |
190 69 Denis 'GNUtoo' Carikli
191 94 Denis 'GNUtoo' Carikli
h4. Needs more work and unknown upstream Linux status
192
193 54 Denis 'GNUtoo' Carikli
|_. Device |_. Time estimation |_. Comments |
194
| Galaxy S II (i9100) | | Linux: devboard dts upstream? unknown status |
195
| Galaxy Note (N7000) | | unknown Linux upstream status |
196 34 Denis 'GNUtoo' Carikli
| Galaxy Nexus (I9250) | |/2. OMAP4, no dts upsrteam |
197
| Galaxy Tab 2 7.0 (P3100), 7.0 WiFi (P3110), 10.1 (P5100), 10.1 WiFi (P5110) | |
198 2 Denis 'GNUtoo' Carikli
| GTA04 >= A4 | | TODO: a RIL needs to be written, userspace GPS support is missing, audio scenarios, etc |
199 4 Denis 'GNUtoo' Carikli
200 128 Denis 'GNUtoo' Carikli
h2. Documentation
201 1 Denis 'GNUtoo' Carikli
202 128 Denis 'GNUtoo' Carikli
h3. Replicant 6.0 changes
203
204 32 Denis 'GNUtoo' Carikli
|_. Repository path |_. rebase worked |_. Changes |
205 5 Denis 'GNUtoo' Carikli
| build | No | |
206 31 Denis 'GNUtoo' Carikli
| manifest | No | N/A |
207 4 Denis 'GNUtoo' Carikli
| bootable/recovery | Yes | * UI changes to improve usability 
208
* Branding
209
* Small fix(es) | 
210
| external/boringssl | Yes | * Small fix(es) |
211
| external/heimdall | No | |
212
| frameworks/av | Yes | * Software rendering fix(es) |
213 1 Denis 'GNUtoo' Carikli
| frameworks/base | Yes | * WiFi fixe(s) for external dongles
214 5 Denis 'GNUtoo' Carikli
* Software rendering fix(es) 
215
* Privacy fix(es) 
216
* Security improvements 
217 10 Denis 'GNUtoo' Carikli
* Usability improvements |
218 5 Denis 'GNUtoo' Carikli
| frameworks/native | No |
219
| hardware/broadcom/wlan | Yes | * Remove nonfree software |
220 33 Denis 'GNUtoo' Carikli
| hardware/libhardware | Yes | * Software rendering fix(es) |
221
| hardware/libhardware_legacy | Yes | * Don't depend on nonfree software |
222 6 Denis 'GNUtoo' Carikli
| hardware/ti/omap4 | Yes | * Remove nonfree software 
223 8 Denis 'GNUtoo' Carikli
* Don't depend on nonfree software 
224 33 Denis 'GNUtoo' Carikli
* Small fix(es) |
225 7 Denis 'GNUtoo' Carikli
| libcore | Yes | * Small fix(es) | 
226 33 Denis 'GNUtoo' Carikli
| packages/apps/Browser | Yes | * Privacy fix(es) 
227 22 Denis 'GNUtoo' Carikli
* Branding
228
* Small fix(es) |
229 11 Denis 'GNUtoo' Carikli
| packages/apps/LegacyCamera | Yes | * Software rendering fix(es)
230
* Small fix(es) |
231
| packages/apps/RepWifi | Not upstreamed, obsolete | N/A |
232
| packages/apps/ReplicantWallpapers | Not upstreamed | * Branding |
233 12 Denis 'GNUtoo' Carikli
| packages/apps/Settings | No | |
234
| packages/apps/SetupWizard | Yes | * Privacy fix(es) 
235 33 Denis 'GNUtoo' Carikli
* Don't depend on nonfree software
236 13 Denis 'GNUtoo' Carikli
* Branding |
237
| packages/apps/ThemeChooser | Yes | * Privacy fix(es) ?
238
* Don't depend on nonfree software ? |
239
| packages/providers/ContactsProvider | Yes | * Small fix(es) |
240 14 Denis 'GNUtoo' Carikli
| system/core | Yes | * Branding
241
* various fixes |
242
| vendor/replicant | No | |
243
| vendor/cmsdk | Yes | * Branding |
244
| external/chromium-webview | ? | ? |
245 33 Denis 'GNUtoo' Carikli
| external/drm_gralloc | Yes | * Software rendering fix(es) |
246 14 Denis 'GNUtoo' Carikli
| external/llvm | Yes | * Software rendering fix(es) |
247
| external/mesa3d |  Yes | * Software rendering fix(es)
248
* Performance debugging for software rendering |
249 33 Denis 'GNUtoo' Carikli
| external/parameter-framework | Yes | * Small fix(es) |
250
| external/protobuf | N/A | No changes |
251 14 Denis 'GNUtoo' Carikli
| prebuilts/ndk | ? | ? |
252 33 Denis 'GNUtoo' Carikli
| prebuilts/sdk | ? | ? |
253
| sdk | Yes | * Small fix(es) |
254 22 Denis 'GNUtoo' Carikli
| toolchain/src/binutils | Yes | * Small fix(es) |
255 1 Denis 'GNUtoo' Carikli
| toolchain/src/gcc | No | |
256
| toolchain/src/jack | Yes | * Small fix(es) |
257 20 Denis 'GNUtoo' Carikli
| toolchain/src/jill | Yes | * Small fix(es) |
258 33 Denis 'GNUtoo' Carikli
| kernel/samsung/smdk4412 |/3. Yes |/3. * Security fixes
259 22 Denis 'GNUtoo' Carikli
* Privacy Fixes (TrustZone)
260
* Don't depend on nonfree software
261 28 Denis 'GNUtoo' Carikli
* Remove nonfree software
262
* Small fix(es) |
263
| kernel/samsung/tuna |
264 25 Denis 'GNUtoo' Carikli
| kernel/samsung/espresso10 |
265 29 Denis 'GNUtoo' Carikli
| device/samsung/i9100 | No |/14. * Replace nonfree software by free software
266
* free software sensors implementation(s)
267
* free software modem audio implementation(s)
268 1 Denis 'GNUtoo' Carikli
* Software rendering fix(es)
269 33 Denis 'GNUtoo' Carikli
* Privacy Fixes (TrustZone)
270 1 Denis 'GNUtoo' Carikli
* Don't depend on nonfree software
271
* Remove nonfree software
272
* Branding
273
* Small fix(es) |
274 29 Denis 'GNUtoo' Carikli
| device/samsung/n7000 | Yes |
275
| device/samsung/i9300 | No |
276
| device/samsung/i9305 | No |
277
| device/samsung/n7100 | Yes |
278 30 Denis 'GNUtoo' Carikli
| device/samsung/n5100 | Yes |
279
| device/samsung/n5110 | Yes |
280
| device/samsung/maguro | Yes |
281
| device/samsung/tuna | Yes |
282
| device/samsung/espressowifi | Yes |
283 22 Denis 'GNUtoo' Carikli
| device/samsung/espresso3g | Yes |
284
| device/samsung/galaxys2-common | Yes |
285 23 Denis 'GNUtoo' Carikli
| device/samsung/smdk4412-common | No |
286 40 Denis 'GNUtoo' Carikli
| device/samsung/kona-common | Yes |
287
| hardware/ril/samsung-ril | Not upstreamed | N/A |
288
| external/libsamsung-ipc | Not upstreamed | N/A |
289 1 Denis 'GNUtoo' Carikli
| hardware/tinyalsa-audio | Not upstreamed? | N/A |
290 128 Denis 'GNUtoo' Carikli
291
h3. CustomROMs i9300 components
292
293 131 Denis 'GNUtoo' Carikli
|_. Repository |_. Tree path |_. Dependencies |_. Function |_. Comments |
294
|/8. https://github.com/CustomROMs/android_hardware_samsung
295
lineage-16.0 branch | hardware/samsung/macloader | | Loads the MAC Address of the WiFi network interface | Might be useful |
296
| hardware/samsung/wifiloader | | Loads the wifi kernel module (like modprobe) and setup firmware filesystems permissions | May be useful |
297
| hardware/samsung/audio | | seems to contains ril related stuff as well | Look if the ril stuff is required, go for standard audio |
298
| hardware/samsung/lineagehw/hidl/livedisplay | | livedisplay is a feature similar to what redshift does on GNU/Linux | Not sure if it works with mainline |
299
| hardware/samsung/exynos/multimedia/utils/ | seem meant for audio/video decoding offload | assembly obtimized color conversion and resize code | check assembly code license, not sure if useful |
300
| all other directories in hardware/samsung/exynos/ | nonfree firmwares, nonfree software?, smdk kernel? | audio/video decoding offload | Avoid using that |
301
| hardware/samsung/exynos3 |/2. nonfree firmwares?, nonfree software?, smdk kernel? |/2. some light libraries, display stuff (gralloc, etc), 2D acceleration (FIMG), camera (FIMC), 3D acceleration, etc |/2. Avoid using that for now |
302
| hardware/samsung/exynos4 | 
303 1 Denis 'GNUtoo' Carikli
304
h2. Links 
305
306
* https://source.android.com/setup/build/requirements
307 132 Denis 'GNUtoo' Carikli
* https://forum.xda-developers.com/galaxy-s3/development/rom-lineageos-16-0-t3875899 : status of the unofficial LineageOS port