Project

General

Profile

PortingToAndroid10 » History » Version 266

dl lud, 06/29/2020 10:14 AM
Move Replicant 9 build instructions to a separate page.

1 264 dl lud
h1. Porting Replicant to Android 10
2 1 Denis 'GNUtoo' Carikli
3 101 Denis 'GNUtoo' Carikli
{{>toc}}
4 1 Denis 'GNUtoo' Carikli
5 266 dl lud
Active development has moved towards LineageOS 17 (based on Android 10).
6
The basic features working on Replicant 9 have been confirmed to work on Replicant 10, but not everything has been tested yet on either version.
7
Replicant 9 source code and build instruction have been kept to do regression tracking: [[DeprecatedPortingToAndroid9|Porting Replicant to Android 9]].
8 1 Denis 'GNUtoo' Carikli
9 266 dl lud
h2. Building Replicant 10
10 256 Denis 'GNUtoo' Carikli
11 266 dl lud
h3. Source code
12 256 Denis 'GNUtoo' Carikli
13
<pre>
14 262 Denis 'GNUtoo' Carikli
$ repo init -u https://git.replicant.us/replicant-9/manifest.git -b replicant-10-dev
15 256 Denis 'GNUtoo' Carikli
$ repo sync
16
</pre>
17
18
Alternatively a shallow copy of the source tree can be fetched in order to save on disk space:
19
20
<pre>
21 262 Denis 'GNUtoo' Carikli
$ repo init -u https://git.replicant.us/replicant-9/manifest.git -b replicant-10-dev --depth=1
22 256 Denis 'GNUtoo' Carikli
$ repo sync -c
23 1 Denis 'GNUtoo' Carikli
</pre>
24 256 Denis 'GNUtoo' Carikli
25
To `unshallow` a specific module:
26
27
<pre>
28
$ cd path/to/module
29 1 Denis 'GNUtoo' Carikli
$ git fetch --unshallow <remote>
30 256 Denis 'GNUtoo' Carikli
</pre>
31
32 266 dl lud
h3. For Trisquel 8
33 256 Denis 'GNUtoo' Carikli
34
<pre>
35
sudo apt-get install bc bison build-essential bsdmainutils ccache curl flex g++-multilib gcc-multilib gettext git gnupg gperf imagemagick lib32ncurses5-dev lib32readline-dev lib32z1-dev liblz4-tool libncurses5-dev libsdl1.2-dev libssl-dev libwxgtk3.0-dev libxml2 libxml2-utils lzop python-mako pngcrush rsync schedtool squashfs-tools xsltproc zip zlib1g-dev
36
sudo apt-get install gcc-5-arm-linux-gnueabi
37
</pre>
38
39 266 dl lud
h3. Launching the build
40 256 Denis 'GNUtoo' Carikli
41 260 Denis 'GNUtoo' Carikli
Not 100% sure if this is still needed:
42 256 Denis 'GNUtoo' Carikli
<pre>
43
$ subject='/C=US/ST=California/L=Mountain View/O=Android/OU=Android/CN=Android/emailAddress=android@android.com'
44
$ mkdir .android-certs
45
$ for x in releasekey platform shared media testkey; do \
46
  ./development/tools/make_key .android-certs/$x "$subject"; \
47
  done
48 260 Denis 'GNUtoo' Carikli
</pre>
49
50
To avoid the following error:
51
<pre>
52
16:20:13 See https://android.googlesource.com/platform/build/+/master/Changes.md#PATH_Tools for more information.
53
[  3% 2585/70375] build out/target/product/i9305/gen/STATIC_LIBRARIES/libmesa_nir_intermediates/nir/nir_builder_opcodes.h
54
FAILED: out/target/product/i9305/gen/STATIC_LIBRARIES/libmesa_nir_intermediates/nir/nir_builder_opcodes.h
55
/bin/bash -c "python external/mesa3d/src/compiler/nir/nir_builder_opcodes_h.py external/mesa3d/src/compiler/nir/nir_opcodes.py > out/target/product/i9305/gen/STATIC_LIBRARIES/libmesa_nir_intermediates/nir/nir_builder_opcodes.h"
56
Traceback (most recent call last):
57
  File "external/mesa3d/src/compiler/nir/nir_builder_opcodes_h.py", line 106, in <module>
58
    from mako.template import Template
59
ImportError: No module named mako.template
60
16:20:20 ninja failed with: exit status 1
61
</pre>
62
63
You need to run the following command:
64
<pre>
65
$ cd prebuilts/build-tools/path/linux-x86/
66 1 Denis 'GNUtoo' Carikli
$ rm python && ln -s /usr/bin/python python
67 260 Denis 'GNUtoo' Carikli
</pre>
68
69
Then you can launch the build:
70
<pre>
71 256 Denis 'GNUtoo' Carikli
$ source build/envsetup.sh
72 1 Denis 'GNUtoo' Carikli
$ export TEMPORARY_DISABLE_PATH_RESTRICTIONS=true
73
$ lunch lineage_i9305-eng
74 265 dl lud
$ make bacon
75 256 Denis 'GNUtoo' Carikli
</pre>
76
77 266 dl lud
h3. Getting lastest changes
78 256 Denis 'GNUtoo' Carikli
79 1 Denis 'GNUtoo' Carikli
* The repositories are being constantly modified with git push --force as we are trying things out, and don't want to make the commits history look too dirty, so be sure to backup your local changes.
80 256 Denis 'GNUtoo' Carikli
* Sometimes the manifest repository is also modified with git push --force. In that case the following commands will loose all the work you did locally but will make the repository consistent with upstream repositories again:
81
<pre>
82
$ rm -rf .repo/manifests/ # This enables me to force push and rebase the manifest repository as well
83
$ repo init -u https://git.replicant.us/replicant-9/manifest.git -b replicant-10-dev
84 263 Denis 'GNUtoo' Carikli
$ repo sync --force-sync
85 256 Denis 'GNUtoo' Carikli
</pre>
86
* The following command might also be necessary to make the state consistent with upstream repositories again, when the manifest history wasn't rewritten, but it will also loose all the work you did locally: 
87
<pre>
88
$ repo sync --force-sync
89
</pre>
90
91 266 dl lud
h3. Install the images
92 256 Denis 'GNUtoo' Carikli
93
TODO
94
95 266 dl lud
h3. Get adb
96 256 Denis 'GNUtoo' Carikli
97
As the device IDs are the ones given by the Linux kernel, they are not in the adb udev rules, so for now it requires to run adb as root:
98
<pre>
99
$ sudo adb shell
100
* daemon not running; starting now at tcp:5037
101
* daemon started successfully
102
i9305:/ #                                 
103
$ sudo adb kill-server
104
$ adb shell
105 1 Denis 'GNUtoo' Carikli
* daemon not running; starting now at tcp:5037
106 256 Denis 'GNUtoo' Carikli
* daemon started successfully
107
error: no devices/emulators found
108
</pre>
109 199 Kurtis Hanna
So make sure to kill the adb-server and run it as root:
110
<pre>
111
$ adb kill-server
112
$ sudo adb shell
113
* daemon not running; starting now at tcp:5037
114
* daemon started successfully
115
i9305:/ # 
116
</pre>
117
118
119 266 dl lud
h3. Trisquel 8 LXC
120 199 Kurtis Hanna
121
If you use Parabola, you may be interested in running Trisquel 8 in LXC.
122
123
To do that first debootstrap a Trisquel 8 rootfs. 
124
125
Parabola's debootstrap does support Trisquel 8 and its manual has an example on how to do that:
126
<pre>
127
$ man debootstrap
128
[...]
129
# debootstrap flidas flidas-root http://archive.trisquel.info/trisquel
130
</pre>
131
132
Then you can use virt-manager to setup the LXC instance.
133
134
The advantages of this solution are that:
135
* The LXC guest and host shares their resources (CPU, RAM) with almost no penalty
136
* Trisquel 8 is not a rolling release distribution
137
138
The disadvantage of this solution are that:
139
* you need to configure again the Trisquel 8 LXC instance (vimrc, sshd_config, etc)
140
* It's more complicated to setup
141
* The Android build system output a warning message about not being able to use namespaces which may become mandatory in newer Android versions
142 172 Joonas Kylmälä
143 153 Denis 'GNUtoo' Carikli
h2. Upstreaming status
144
145 261 Denis 'GNUtoo' Carikli
* The stock bootloader is incompatible with Linux, see [[BootloadersIncompatibleWithLinux#Devices-with-the-Exynos-4412]] for more information. So we maintain patches to enable the Galaxy SIII, and Galaxy Note II to boot with the stock bootloader. In the long run we need to look into using u-boot in the kernel partition as using u-boot instead of the stock bootloader currently require nonfree and non-redistributable software (BL1).
146
* For the patches that are not merged yet, see the "issues of the redmine upstreaming sub-project":https://redmine.replicant.us/projects/upstreaming/issues
147 153 Denis 'GNUtoo' Carikli
148 227 Denis 'GNUtoo' Carikli
h2. Modem status
149
150 228 Denis 'GNUtoo' Carikli
*libsamsung-ipc:* 
151
* Fully tested under GNU/Linux only
152 235 Denis 'GNUtoo' Carikli
* Can initialize completely the modem and receive messages (see the #1954 bug report for the logs)
153 228 Denis 'GNUtoo' Carikli
* Needs more cleanup but there is now a better abstraction
154 229 Denis 'GNUtoo' Carikli
155 228 Denis 'GNUtoo' Carikli
*libsamsung-ril:* 
156
* Ported to Replicant 9 using a wrapper for the API >=12 in libsamsung-ril source code that needs to be removed
157
* Tested under Replicant 9 without up to date libsamsung-ipc (no modem init)
158
* Tested and validated under Replicant 6 (doesn't break telephony)
159
160
h3. Modem status TODO
161
162 227 Denis 'GNUtoo' Carikli
* Implement the missing part to shut down the modem, close the interfaces and such, in order to need to reboot after each test.
163
* Continue to clean up the libsamsung-ipc and libsamsung-ril patches, test the patches in Replicant 6 when applicable, and merge them in the upstream repositories.
164
* Convert the firmware loading driver to the upstream API and then adapt libsamsung-ipc for that. This should also benefit other devices like the Galaxy SIII 4G, and the Galaxy Note II 4G which probably don't need much more to get their modem supported by upstream Linux.
165
* Cleanup and convert the rest of the drivers to look like the ones for the Nokia N900 and adapt the userspace in libsamsung-ipc, and merge libsamsung-ipc support for that once the kernel API is stable.
166
* Test the code under Replicant 9 when the graphics status will enable to have decent enough speed to do some testing through human interaction.
167
168 87 Denis 'GNUtoo' Carikli
h2. TODO
169 51 Denis 'GNUtoo' Carikli
170 74 Denis 'GNUtoo' Carikli
First month of full time equivalent work:
171 81 Denis 'GNUtoo' Carikli
172 127 Denis 'GNUtoo' Carikli
|_. Time estimation  |_.Task |_. Comments |
173
| DONE | -boot a device under AOSP9- | Only boots with graphics, not much more |
174
| -7h- DONE | -build it under a "FSDG compliant distribution":https://www.gnu.org/distros/free-distros.html like Trisquel8- | -WIP for AOSP, It's difficult to do precise time estimations as it could work out of the box or require one full time month of work depending on how much issues are encountered- 
175 59 Denis 'GNUtoo' Carikli
Builds under Trisquel8|
176 213 Denis 'GNUtoo' Carikli
| -21h- DONE | * -port the changes from AOSP9 to LineageOS 16-
177 155 Denis 'GNUtoo' Carikli
* -cleanup the code-
178 151 Joonas Kylmälä
* -build the kernel from the Android build system-
179 125 Denis 'GNUtoo' Carikli
* -make sure it builds with an FSDG compliant distribution-
180 143 Denis 'GNUtoo' Carikli
* -document the build procedure- |
181
Status:
182 155 Denis 'GNUtoo' Carikli
* Boots with adb.
183 143 Denis 'GNUtoo' Carikli
* Has ultra slow graphics |
184 127 Denis 'GNUtoo' Carikli
| 14h | find, remove and document proprietary software in LineageOS 16 | |
185
| 21h | find, remove and document privacy issues in LineageOS 16 | |
186 241 Denis 'GNUtoo' Carikli
| 7h | -Add support for the touch keys driver in the  galaxy-s3 dts- | "applied":https://lists.infradead.org/pipermail/linux-arm-kernel/2019-November/694100.html |
187 240 Denis 'GNUtoo' Carikli
| 7h | -upstream the AAT1290 flash led Linux dts for the galaxy-s3 boards- | "Now in 5.3":https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?h=v5.3&id=4e4dfcb2a425cccc6dd1fb7d46e060cd57999afc |
188 127 Denis 'GNUtoo' Carikli
| 7h | rebrand LineageOS as Replicant | |
189 234 Denis 'GNUtoo' Carikli
| 70h | -port and- cleanup the the Galaxy SIII (i9300) "modem":https://github.com/fourkbomb/linux/tree/modem Linux driver from 4.16 to 5.0| See the [[PortingToAndroid9/#Modem-status|modem status]] for more details |
190 127 Denis 'GNUtoo' Carikli
|_\3. Total: 147h (~1 month) |
191 95 Denis 'GNUtoo' Carikli
192 1 Denis 'GNUtoo' Carikli
Second month of full time equivalent work:
193 216 Denis 'GNUtoo' Carikli
| * port  libsamsung-ril and libsamsung-ipc to Android 9
194 234 Denis 'GNUtoo' Carikli
* Make the modem driver and libsamsung-ipc work together | 157h | See the [[PortingToAndroid9/#Modem-status|modem status]] for more details |
195 1 Denis 'GNUtoo' Carikli
|_. Total |_. 157h | ~1 month |
196
197
Third month of full time equivalent work:
198
|_. Task |_. Time estimation |_. Comments |
199 213 Denis 'GNUtoo' Carikli
| -port the sensors libraries and other device specific libraries-
200
Look which sensor libraries can be used | 70h | Already done by the unofficial LineageOS port of the Galaxy SIII (i9300), needs testing |
201 255 Denis 'GNUtoo' Carikli
| add support for Audio with the upstream kernel driver | 70h | Might be way faster, depending on what Android 9 uses
202
                                                               See also "this bugreport":https://github.com/CustomROMs/android_local_manifests_i9300/issues/1 |
203 212 Denis 'GNUtoo' Carikli
| -add partial (no modem) support for the Galaxy SIII 4G (i9305) and- factorize the code with i9300 | 14h | * The source code on which the work was based changed from AOSP to an unofficial LineageOS port to a port of i9305 support for AOSP by Joonas to the official LineageOS so it's now supported by default
204
* The work to factorize the code between the i9300 and i9305 still need to be done |
205
 |
206 1 Denis 'GNUtoo' Carikli
|_. Total |_. 154h | ~1 month |
207 67 Denis 'GNUtoo' Carikli
208 71 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
209 96 Denis 'GNUtoo' Carikli
| create a recovery | 21h | |
210 74 Denis 'GNUtoo' Carikli
| add internal WiFi support and validate the functionality | 6h | |
211 71 Denis 'GNUtoo' Carikli
| add external WiFi dongles support | 20h | External dongles support might be tricky |
212 125 Denis 'GNUtoo' Carikli
| -create new- update the install and upgrade instructions | -35h- | -Our current install instructions don't scale as we have one copy for each device.-
213
-We also created generic instructions but they tend to be harder to follow[1] than the device specific ones.-
214
-This will be made in a modular format (for instance in LaTeX) that enables to generate per device install instructions without requiring to have multiples copy of the same text.-
215 214 Denis 'GNUtoo' Carikli
-The instructions will need to be able to be modified and compiled on an FSDG compliant distribution.-
216
Mostly done: 
217
* The installation instructions are now generic enough. 
218
* Some long standing TODO were also done along the way like adding backup instructions for the EFS.
219
* The current instructions are still for Replicant 6.0 and will need to be updated for Replicant 9.0 |
220 92 Denis 'GNUtoo' Carikli
221 71 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
222
| Estimate the amount of work to Reduce the attack surface | ? | |
223 1 Denis 'GNUtoo' Carikli
| Estimate the amount of work to add in-system upgrades | ? | |
224
225 82 Denis 'GNUtoo' Carikli
fn1. The generic instructions were tested at Install parties in Paris 
226 1 Denis 'GNUtoo' Carikli
227 85 Denis 'GNUtoo' Carikli
h3. Devices support:
228 1 Denis 'GNUtoo' Carikli
229 77 Denis 'GNUtoo' Carikli
h4. Easy, because it's similar enough to the Galaxy SIII (I9300)
230 97 Denis 'GNUtoo' Carikli
231
|_\3. Galaxy Note II (N7100) |
232 94 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
233 86 Denis 'GNUtoo' Carikli
| port the EA8061 LCD Linux driver | 35h | |
234
| port the S6EVR02 LCD Linux driver | 35h | |
235
| port the MAX77693 flash led Linux driver | 7h | |
236
| android: add support for the Note II (N7100) and factorize the code with Galaxy SIII (i9300) and Galaxy SIII 4G (i9305) | 14h | Should be similar to the Galaxy SIII |
237
| port the sensors libraries and other device specific libraries | 70h | It's difficult to evaluate how much time it could take |
238 125 Denis 'GNUtoo' Carikli
| add support for Audio with the upstream kernel driver | 14h | Should be similar to the Galaxy SIII |
239 86 Denis 'GNUtoo' Carikli
240 1 Denis 'GNUtoo' Carikli
|_\3. Galaxy Note 8.0 (N5100) and 8.0 WiFi (N5110) |
241 70 Denis 'GNUtoo' Carikli
|_. Task |_. Time estimation |_. Comments |
242
| Evaluate the time required to do the port | 14h | TODO |
243 69 Denis 'GNUtoo' Carikli
244 94 Denis 'GNUtoo' Carikli
h4. Needs more work and unknown upstream Linux status
245
246 54 Denis 'GNUtoo' Carikli
|_. Device |_. Time estimation |_. Comments |
247
| Galaxy S II (i9100) | | Linux: devboard dts upstream? unknown status |
248
| Galaxy Note (N7000) | | unknown Linux upstream status |
249 254 Jens Korte
| Galaxy Nexus (I9250) | |/2. OMAP4, no dts upstream |
250 34 Denis 'GNUtoo' Carikli
| Galaxy Tab 2 7.0 (P3100), 7.0 WiFi (P3110), 10.1 (P5100), 10.1 WiFi (P5110) | |
251 2 Denis 'GNUtoo' Carikli
| GTA04 >= A4 | | TODO: a RIL needs to be written, userspace GPS support is missing, audio scenarios, etc |
252 4 Denis 'GNUtoo' Carikli
253 128 Denis 'GNUtoo' Carikli
h2. Documentation
254 1 Denis 'GNUtoo' Carikli
255 128 Denis 'GNUtoo' Carikli
h3. Replicant 6.0 changes
256
257 252 Denis 'GNUtoo' Carikli
See [[Replican6Changes]].
258 128 Denis 'GNUtoo' Carikli
259 193 Denis 'GNUtoo' Carikli
h3. Other rebases
260
261 253 Denis 'GNUtoo' Carikli
See the [[Samsung-ipc]] page.
262 193 Denis 'GNUtoo' Carikli
263 217 Denis 'GNUtoo' Carikli
h2. Other attempts
264
265 218 Denis 'GNUtoo' Carikli
* It might be interesting to contact the people doing ports once we have something working well enough.
266
* It is also interesting to look at other attempts to understand if a given device is powerful enough to run Android 9 and what configuration was used to achieve it.
267
268 217 Denis 'GNUtoo' Carikli
|_. Device(s) |_. Repository |_. status |_. Comments |
269 238 Kurtis Hanna
| i9300 | "CustomROMs":https://github.com/CustomROMs/android_local_manifests_i9300 | * "March 3 2019 release":https://forum.xda-developers.com/galaxy-s3/development/rom-lineageos-16-0-t3875899 | |
270
| i9300 | "Team InFusion":https://github.com/team-infusion-developers/android_local_manifests_i9300 | * "August 20 2019 release":https://forum.xda-developers.com/galaxy-s3/development/rom-optimized-lineageos-16-0-team-t3940142 | Issues: * Uses a Samsung kernel
271
* Uses too many nonfree libraries
272 237 Kurtis Hanna
=> Probably nothing we could reuse from its code |
273
| N7100 | "ComicoTeam":https://github.com/ComicoTeam/android_device_samsung_n7100 | * "September 13 2019 release":https://forum.xda-developers.com/galaxy-note-2/development/rom-lineageos-16-0-20190112-comico-t3889281 | |
274 236 Kurtis Hanna
| I9100 | | "XDA":https://forum.xda-developers.com/galaxy-s2/development-derivatives/pie-i9100-t3850588 | |
275 217 Denis 'GNUtoo' Carikli
276 220 Denis 'GNUtoo' Carikli
h3. Links for other attempts
277
278
* https://www.xda-developers.com/android-pie-android-9-port-custom-roms/
279
280 128 Denis 'GNUtoo' Carikli
h3. CustomROMs i9300 components
281
282 131 Denis 'GNUtoo' Carikli
|_. Repository |_. Tree path |_. Dependencies |_. Function |_. Comments |
283
|/8. https://github.com/CustomROMs/android_hardware_samsung
284
lineage-16.0 branch | hardware/samsung/macloader | | Loads the MAC Address of the WiFi network interface | Might be useful |
285
| hardware/samsung/wifiloader | | Loads the wifi kernel module (like modprobe) and setup firmware filesystems permissions | May be useful |
286
| hardware/samsung/audio | | seems to contains ril related stuff as well | Look if the ril stuff is required, go for standard audio |
287
| hardware/samsung/lineagehw/hidl/livedisplay | | livedisplay is a feature similar to what redshift does on GNU/Linux | Not sure if it works with mainline |
288
| hardware/samsung/exynos/multimedia/utils/ | seem meant for audio/video decoding offload | assembly obtimized color conversion and resize code | check assembly code license, not sure if useful |
289
| all other directories in hardware/samsung/exynos/ | nonfree firmwares, nonfree software?, smdk kernel? | audio/video decoding offload | Avoid using that |
290
| hardware/samsung/exynos3 |/2. nonfree firmwares?, nonfree software?, smdk kernel? |/2. some light libraries, display stuff (gralloc, etc), 2D acceleration (FIMG), camera (FIMC), 3D acceleration, etc |/2. Avoid using that for now |
291 202 Kurtis Hanna
| hardware/samsung/exynos4 |
292 1 Denis 'GNUtoo' Carikli
293
h2. Links 
294 205 dl lud
295
* "Android build requirements - hardware and software":https://source.android.com/setup/build/requirements
296
* "Why LineageOS Developers are building Android Go-optimized custom ROMs":https://www.xda-developers.com/android-go-old-android-8-1-oreo/
297
* "Android Go recommended default values for propreties for optimization":https://android.googlesource.com/platform/build/+/master/target/product/go_defaults_common.mk
298
* "Team InFusion i9300 optimized system.prop":https://github.com/team-infusion-developers/android_device_samsung_i9300/blob/lineage-16.0/system.prop#L23
299
* "Hack to fix high CPU usage caused by logd":https://github.com/team-infusion-developers/android_device_samsung_smdk4412-common/commit/c66015514fc9779edfed2665f67e841f3620c71e
300
* "Use low-end video codecs":https://github.com/team-infusion-developers/android_device_samsung_smdk4412-common/commit/adc919f04b981a4fe005fab2cf443596a22992b2
301
* "Optimize ActivityManager cached apps":https://github.com/team-infusion-developers/android_device_samsung_smdk4412-common/commit/24bc62970d35eb5a7a257463e7dbfe873ceb5779
302
* "Use 1Gb Dalvik config":https://github.com/team-infusion-developers/android_device_samsung_smdk4412-common/commit/8a7cebc5af772a2949420ac4a383f5f75236c65c