[Python] Install Python AI Learning packages on Termux

Android 平台上 AI 套件的資源有多種可選用，在安裝前可先搜集資訊，比較之後再決定採用何種方案。

 

AI 套件替代方案：

APK	Aid Learning (Android APP)
雲端	Google Colab (Colaboratory)
雲端	CoCalc (Collaborative Calculation and Data Science) https://cocalc.com/index.html
	Termux + Python packages for AI Learning

 

使用雲端的缺點主要是程式碼需上傳，如果不介意程式碼可能會被架 server 的公司取用，那麼使用雲端來使用 JupyterLab 是最容易的，客戶端只要使用瀏覽器登入遠端 JupyterLab server 即可，不需安裝任何程式：Google Colab 有 google 帳號就可使用；CoCalc 有無註冊皆可使用，但無註冊的使用者工作 session 無法保存；Aid Learning 則是安裝在 Android 裝置的應用程式，已封裝好各種 AI packages，也可很容易就使用。

 

Termux 平台上安裝 Python AI Learning packages 需自行輸入安裝指令（透過 pip）。

優點：

    ◎ 可自主決定要安裝的套件及版本
    ◎ 不需上網也可使用
    ◎ 程式碼儲存在 Android 內部記憶體，不需公開

缺點：

    ◎ 相對較麻煩
    ◎ 遇到問題需自行搜集資訊排除

 

我個人是採用 Termux 來安裝，主要是為了隨時可在手機上檢視程式碼或執行測試，在 LAN 的環境下也可以很容易的在別台裝置登入手機端的 JupyterLab 來使用。在 Linux 平台下安裝軟體時常遇到版本相依性的問題，雖然很惱人，不過網路上通常找的到解法。

 

這裡記錄在 Termux 平台上透過 pip 安裝 AI 相關套件的方法，主要有：

[1] Numpy：
        pip install numpy

[2] Pandas：
        pip install pandas

[3] Matplotlib：
        apt install freetype libpng pkg-config
        pip install matplotlib

[4] Scipy：
        curl -L https://its-pointless.github.io/setup-pointless-repo.sh | sh
        apt install scipy

 

注意：有的套件安裝時間很長，需耐心等待。

 

安裝後需更新套件的話，使用更新指令：

pip install --upgrade xxx

（xxx 是要更新的套件名，同樣的，可能需修正相依性的問題）

 

 

安裝套件：

[1] Numpy

pip install numpy

$ pip install numpy Collecting numpy   Downloading numpy-1.18.4.zip (5.4 MB)      |████████████████████████████████| 5.4 MB 55 kB/s   Installing build dependencies ... done   Getting requirements to build wheel ... done     Preparing wheel metadata ... done Building wheels for collected packages: numpy   Building wheel for numpy (PEP 517) ... done   Created wheel for numpy: filename=numpy-1.18.4-cp38-cp38-linux_aarch64.whl size=10833680 sha256=00833838894345f954db1484028ea10834ac8eeb61e201648818fe02f1d8228b   Stored in directory: /data/data/com.termux/files/home/.cache/pip/wheels/bd/b0/b1/59b5614f0a18f0d0d40d4e3dd0ca28613b921245c973ea27d8 Successfully built numpy Installing collected packages: numpy Successfully installed numpy-1.18.4

 

[2] Pandas: Panel data + Data analysis

pip install pandas

$ pip install pandas Collecting pandas   Downloading pandas-1.0.3.tar.gz (5.0 MB)      |████████████████████████████████| 5.0 MB 4.5 MB/s   Installing build dependencies ... done     Getting requirements to build wheel ... done     Preparing wheel metadata ... done Collecting pytz>=2017.2   Downloading pytz-2020.1-py2.py3-none-any.whl (510 kB)      |████████████████████████████████| 510 kB 1.4 MB/s Requirement already satisfied: numpy>=1.13.3 in /data/data/com.termux/files/usr/lib/python3.8/site-packages (from pandas) (1.18.4) Requirement already satisfied: python-dateutil>=2.6.1 in /data/data/com.termux/files/usr/lib/python3.8/site-packages (from pandas) (2.8.1) Requirement already satisfied: six>=1.5 in /data/data/com.termux/files/usr/lib/python3.8/site-packages (from python-dateutil>=2.6.1->pandas) (1.14.0) Building wheels for collected packages: pandas   Building wheel for pandas (PEP 517) ... done   Created wheel for pandas: filename=pandas-1.0.3-cp38-cp38-linux_aarch64.whl size=23684254 sha256=8e21af4a1779ad3a06c350479f41116961fdc5f7813394cec871a8525b074e4b   Stored in directory: /data/data/com.termux/files/home/.cache/pip/wheels/23/d2/44/50574994cafe4e229e05bbcb34f212f3cf9eda2d6364fe1f08 Successfully built pandas Installing collected packages: pytz, pandas Successfully installed pandas-1.0.3 pytz-2020.1

 

[3] Matplotlib: matlab + plot

<1> apt install freetype libpng pkg-config

$ apt install freetype libpng pkg-config Reading package lists... Done Building dependency tree Reading state information... Done pkg-config is already the newest version (0.29.2). pkg-config set to manually installed. The following packages were automatically installed and are no longer required:   libandroid-spawn liblzo lzip lzop ninja Use 'apt autoremove' to remove them. The following NEW packages will be installed:   freetype libpng 0 upgraded, 2 newly installed, 0 to remove and 0 not upgraded. Need to get 562 kB of archives. After this operation, 2052 kB of additional disk space will be used. Do you want to continue? [Y/n] Get:1 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 libpng aarch64 1.6.37-2 [189 kB] Get:2 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 freetype aarch64 2.10.2 [374 kB] Fetched 562 kB in 3s (175 kB/s) Selecting previously unselected package libpng. (Reading database ... 24602 files and directories currently installed.) Preparing to unpack .../libpng_1.6.37-2_aarch64.deb ... Unpacking libpng (1.6.37-2) ... Selecting previously unselected package freetype. Preparing to unpack .../freetype_2.10.2_aarch64.deb ... Unpacking freetype (2.10.2) ... Setting up libpng (1.6.37-2) ... Setting up freetype (2.10.2) ... Processing triggers for man (1.14.5-1) ...

 

<2> pip install matplotlib

$ pip install matplotlib Collecting matplotlib   Downloading matplotlib-3.2.1.tar.gz (40.3 MB)      |████████████████████████████████| 40.3 MB 3.5 kB/s Collecting cycler>=0.10   Downloading cycler-0.10.0-py2.py3-none-any.whl (6.5 kB) Collecting kiwisolver>=1.0.1   Downloading kiwisolver-1.2.0.tar.gz (52 kB)      |████████████████████████████████| 52 kB 262 kB/s Requirement already satisfied: numpy>=1.11 in /data/data/com.termux/files/usr/lib/python3.8/site-packages (from matplotlib) (1.18.4) Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 in /data/data/com.termux/files/usr/lib/python3.8/site-packages (from matplotlib) (2.4.7) Requirement already satisfied: python-dateutil>=2.1 in /data/data/com.termux/files/usr/lib/python3.8/site-packages (from matplotlib) (2.8.1) Requirement already satisfied: six in /data/data/com.termux/files/usr/lib/python3.8/site-packages (from cycler>=0.10->matplotlib) (1.14.0) Using legacy setup.py install for matplotlib, since package 'wheel' is not installed. Using legacy setup.py install for kiwisolver, since package 'wheel' is not installed. Installing collected packages: cycler, kiwisolver, matplotlib     Running setup.py install for kiwisolver ... done     Running setup.py install for matplotlib ... done Successfully installed cycler-0.10.0 kiwisolver-1.2.0 matplotlib-3.2.1

 

[4] Scipy

<1> 直接安裝 scipy 會有 Preparing wheel metadata ... error 錯誤出現：

pip install scipy

$ pip install scipy Collecting scipy   Downloading scipy-1.4.1.tar.gz (24.6 MB)      |████████████████████████████████| 24.6 MB 96 kB/s   Installing build dependencies ... done   Getting requirements to build wheel ... done     Preparing wheel metadata ... error     ERROR: Command errored out with exit status 1:      command: /data/data/com.termux/files/usr/bin/python3 /data/data/com.termux/files/usr/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py prepare_metadata_for_build_wheel /data/data/com.termux/files/usr/tmp/tmpeggakpua          cwd: /data/data/com.termux/files/usr/tmp/pip-install-dqnda0yj/scipy     Complete output (107 lines):     lapack_opt_info:     lapack_mkl_info:     customize UnixCCompiler       libraries mkl_rt not found in ['/data/data/com.termux/files/usr/lib']       NOT AVAILABLE       openblas_lapack_info:     customize UnixCCompiler     customize UnixCCompiler       libraries openblas not found in ['/data/data/com.termux/files/usr/lib']       NOT AVAILABLE       openblas_clapack_info:     customize UnixCCompiler     customize UnixCCompiler       libraries openblas,lapack not found in ['/data/data/com.termux/files/usr/lib']       NOT AVAILABLE       flame_info:     customize UnixCCompiler       libraries flame not found in ['/data/data/com.termux/files/usr/lib']       NOT AVAILABLE       atlas_3_10_threads_info:     Setting PTATLAS=ATLAS     customize UnixCCompiler       libraries lapack_atlas not found in /data/data/com.termux/files/usr/lib     customize UnixCCompiler       libraries tatlas,tatlas not found in /data/data/com.termux/files/usr/lib     <class 'numpy.distutils.system_info.atlas_3_10_threads_info'>       NOT AVAILABLE       atlas_3_10_info:     customize UnixCCompiler       libraries lapack_atlas not found in /data/data/com.termux/files/usr/lib     customize UnixCCompiler       libraries satlas,satlas not found in /data/data/com.termux/files/usr/lib     <class 'numpy.distutils.system_info.atlas_3_10_info'>       NOT AVAILABLE       atlas_threads_info:     Setting PTATLAS=ATLAS     customize UnixCCompiler       libraries lapack_atlas not found in /data/data/com.termux/files/usr/lib     customize UnixCCompiler       libraries ptf77blas,ptcblas,atlas not found in /data/data/com.termux/files/usr/lib     <class 'numpy.distutils.system_info.atlas_threads_info'>       NOT AVAILABLE       atlas_info:     customize UnixCCompiler       libraries lapack_atlas not found in /data/data/com.termux/files/usr/lib     customize UnixCCompiler       libraries f77blas,cblas,atlas not found in /data/data/com.termux/files/usr/lib     <class 'numpy.distutils.system_info.atlas_info'>       NOT AVAILABLE       accelerate_info:       NOT AVAILABLE       lapack_info:     customize UnixCCompiler       libraries lapack not found in ['/data/data/com.termux/files/usr/lib']       NOT AVAILABLE       lapack_src_info:       NOT AVAILABLE         NOT AVAILABLE       setup.py:418: UserWarning: Unrecognized setuptools command ('dist_info --egg-base /data/data/com.termux/files/usr/tmp/pip-modern-metadata-h2kj1sp7'), proceeding with generating Cython sources and expanding templates       warnings.warn("Unrecognized setuptools command ('{}'), proceeding with "     Running from scipy source directory.     /data/data/com.termux/files/usr/tmp/pip-build-env-oyvmj4v8/overlay/lib/python3.8/site-packages/numpy/distutils/system_info.py:1712: UserWarning:         Lapack (http://www.netlib.org/lapack/) libraries not found.         Directories to search for the libraries can be specified in the         numpy/distutils/site.cfg file (section [lapack]) or by setting         the LAPACK environment variable.       if getattr(self, '_calc_info_{}'.format(lapack))():     /data/data/com.termux/files/usr/tmp/pip-build-env-oyvmj4v8/overlay/lib/python3.8/site-packages/numpy/distutils/system_info.py:1712: UserWarning:         Lapack (http://www.netlib.org/lapack/) sources not found.         Directories to search for the sources can be specified in the         numpy/distutils/site.cfg file (section [lapack_src]) or by setting         the LAPACK_SRC environment variable.       if getattr(self, '_calc_info_{}'.format(lapack))():     Traceback (most recent call last):       File "/data/data/com.termux/files/usr/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py", line 280, in <module>         main()       File "/data/data/com.termux/files/usr/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py", line 263, in main         json_out['return_val'] = hook(**hook_input['kwargs'])       File "/data/data/com.termux/files/usr/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py", line 133, in prepare_metadata_for_build_wheel         return hook(metadata_directory, config_settings)       File "/data/data/com.termux/files/usr/tmp/pip-build-env-oyvmj4v8/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 158, in prepare_metadata_for_build_wheel         self.run_setup()       File "/data/data/com.termux/files/usr/tmp/pip-build-env-oyvmj4v8/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 249, in run_setup         super(_BuildMetaLegacyBackend,       File "/data/data/com.termux/files/usr/tmp/pip-build-env-oyvmj4v8/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 143, in run_setup         exec(compile(code, __file__, 'exec'), locals())       File "setup.py", line 540, in <module>         setup_package()       File "setup.py", line 536, in setup_package         setup(**metadata)       File "/data/data/com.termux/files/usr/tmp/pip-build-env-oyvmj4v8/overlay/lib/python3.8/site-packages/numpy/distutils/core.py", line 137, in setup         config = configuration()       File "setup.py", line 435, in configuration         raise NotFoundError(msg)     numpy.distutils.system_info.NotFoundError: No lapack/blas resources found.     ---------------------------------------- ERROR: Command errored out with exit status 1: /data/data/com.termux/files/usr/bin/python3 /data/data/com.termux/files/usr/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py prepare_metadata_for_build_wheel /data/data/com.termux/files/usr/tmp/tmpeggakpua Check the logs for full command output.

=> libraries mkl_rt not openblas found

 

<2> piontless

這個問題可透過安裝 piontless 解決，參考：

https://github.com/termux/termux-packages/issues/1737

 

安裝 piontless：

curl -L https://its-pointless.github.io/setup-pointless-repo.sh | sh

$ curl -L https://its-pointless.github.io/setup-pointless-repo.sh | sh   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current                                  Dload  Upload   Total   Spent    Left  Speed 100   982  100   982    0     0    945      0  0:00:01  0:00:01 --:--:--   945 Ign:1 https://dl.bintray.com/termux/termux-packages-24 stable InRelease Ign:2 https://dl.bintray.com/grimler/game-packages-24 games InRelease Ign:3 https://dl.bintray.com/grimler/science-packages-24 science InRelease Get:4 https://dl.bintray.com/termux/termux-packages-24 stable Release [6061 B] Hit:4 https://dl.bintray.com/termux/termux-packages-24 stable Release Get:6 https://dl.bintray.com/grimler/game-packages-24 games Release [5344 B] Hit:6 https://dl.bintray.com/grimler/game-packages-24 games Release Get:8 https://dl.bintray.com/grimler/science-packages-24 science Release [6191 B] Hit:8 https://dl.bintray.com/grimler/science-packages-24 science Release Reading package lists... Done Reading package lists... Done Building dependency tree Reading state information... Done Calculating upgrade... Done The following packages were automatically installed and are no longer required:   libandroid-spawn liblzo lzip lzop ninja Use 'apt autoremove' to remove them. 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. Reading package lists... Done Building dependency tree Reading state information... Done coreutils is already the newest version (8.32-1). coreutils set to manually installed. The following packages were automatically installed and are no longer required:   libandroid-spawn liblzo lzip lzop ninja Use 'apt autoremove' to remove them. The following additional packages will be installed:   libassuan libgnutls libidn2 libksba libnettle libnpth pinentry resolv-conf The following NEW packages will be installed:   gnupg libassuan libgnutls libidn2 libksba libnettle libnpth pinentry resolv-conf 0 upgraded, 9 newly installed, 0 to remove and 0 not upgraded. Need to get 3585 kB of archives. After this operation, 16.1 MB of additional disk space will be used. Get:1 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 libassuan aarch64 2.5.3-1 [68.7 kB] Get:2 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 libnettle aarch64 3.6 [348 kB] Get:3 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 libidn2 aarch64 2.3.0-1 [82.6 kB] Get:4 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 libgnutls aarch64 3.6.13-1 [1859 kB] Get:5 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 libksba aarch64 1.3.5-2 [90.6 kB] Get:6 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 libnpth aarch64 1.6-1 [10.7 kB] Get:7 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 pinentry aarch64 1.1.0-4 [20.9 kB] Get:8 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 resolv-conf aarch64 1.2 [852 B] Get:9 https://dl.bintray.com/termux/termux-packages-24 stable/main aarch64 gnupg aarch64 2.2.20-3 [1104 kB] Fetched 3585 kB in 8s (419 kB/s) Selecting previously unselected package libassuan. (Reading database ... 24680 files and directories currently installed.) Preparing to unpack .../0-libassuan_2.5.3-1_aarch64.deb ... Unpacking libassuan (2.5.3-1) ... Selecting previously unselected package libnettle. Preparing to unpack .../1-libnettle_3.6_aarch64.deb ... Unpacking libnettle (3.6) ... Selecting previously unselected package libidn2. Preparing to unpack .../2-libidn2_2.3.0-1_aarch64.deb ... Unpacking libidn2 (2.3.0-1) ... Selecting previously unselected package libgnutls. Preparing to unpack .../3-libgnutls_3.6.13-1_aarch64.deb ... Unpacking libgnutls (3.6.13-1) ... Selecting previously unselected package libksba. Preparing to unpack .../4-libksba_1.3.5-2_aarch64.deb ... Unpacking libksba (1.3.5-2) ... Selecting previously unselected package libnpth. Preparing to unpack .../5-libnpth_1.6-1_aarch64.deb ... Unpacking libnpth (1.6-1) ... Selecting previously unselected package pinentry. Preparing to unpack .../6-pinentry_1.1.0-4_aarch64.deb ... Unpacking pinentry (1.1.0-4) ... Selecting previously unselected package resolv-conf. Preparing to unpack .../7-resolv-conf_1.2_aarch64.deb ... Unpacking resolv-conf (1.2) ... Selecting previously unselected package gnupg. Preparing to unpack .../8-gnupg_2.2.20-3_aarch64.deb ... Unpacking gnupg (2.2.20-3) ... Setting up libksba (1.3.5-2) ... Setting up resolv-conf (1.2) ... Setting up libnettle (3.6) ... Setting up libassuan (2.5.3-1) ... Setting up pinentry (1.1.0-4) ... Setting up libidn2 (2.3.0-1) ... Setting up libnpth (1.6-1) ... Setting up libgnutls (3.6.13-1) ... Setting up gnupg (2.2.20-3) ... Processing triggers for man (1.14.5-1) ... OK Ign:1 https://dl.bintray.com/termux/termux-packages-24 stable InRelease Ign:2 https://dl.bintray.com/grimler/game-packages-24 games InRelease Get:3 https://its-pointless.github.io/files/24 termux InRelease [8970 B] Ign:4 https://dl.bintray.com/grimler/science-packages-24 science InRelease Get:5 https://dl.bintray.com/termux/termux-packages-24 stable Release [6061 B] Hit:5 https://dl.bintray.com/termux/termux-packages-24 stable Release Get:6 https://its-pointless.github.io/files/24 termux/extras aarch64 Packages [28.4 kB] Get:7 https://dl.bintray.com/grimler/game-packages-24 games Release [5344 B] Hit:7 https://dl.bintray.com/grimler/game-packages-24 games Release Get:8 https://its-pointless.github.io/files/24 termux/extras all Packages [1452 B] Get:10 https://dl.bintray.com/grimler/science-packages-24 science Release [6191 B] Hit:10 https://dl.bintray.com/grimler/science-packages-24 science Release Fetched 38.8 kB in 4s (9220 B/s) Reading package lists... Done Building dependency tree Reading state information... Done All packages are up to date.

 

<3> 此時再安裝 scipy 即可成功

apt install scipy

$ apt install scipy Reading package lists... Done Building dependency tree Reading state information... Done The following packages were automatically installed and are no longer required:   libandroid-spawn liblzo lzip lzop ninja Use 'apt autoremove' to remove them. The following additional packages will be installed:   libgfortran5 numpy openblas The following NEW packages will be installed:   libgfortran5 numpy openblas scipy 0 upgraded, 4 newly installed, 0 to remove and 0 not upgraded. Need to get 16.9 MB of archives. After this operation, 85.7 MB of additional disk space will be used. Do you want to continue? [Y/n] Get:1 https://its-pointless.github.io/files/24 termux/extras aarch64 libgfortran5 aarch64 9.3.0 [252 kB] Get:2 https://its-pointless.github.io/files/24 termux/extras aarch64 openblas aarch64 0.3.8 [2251 kB] Get:3 https://its-pointless.github.io/files/24 termux/extras aarch64 numpy aarch64 1.18.0 [2892 kB] Get:4 https://its-pointless.github.io/files/24 termux/extras aarch64 scipy aarch64 1.4.1 [11.5 MB] Fetched 16.9 MB in 7s (2309 kB/s) Selecting previously unselected package libgfortran5. (Reading database ... 26079 files and directories currently installed.) Preparing to unpack .../libgfortran5_9.3.0_aarch64.deb ... Unpacking libgfortran5 (9.3.0) ... Selecting previously unselected package openblas. Preparing to unpack .../openblas_0.3.8_aarch64.deb ... Unpacking openblas (0.3.8) ... Selecting previously unselected package numpy. Preparing to unpack .../numpy_1.18.0_aarch64.deb ... Unpacking numpy (1.18.0) ... Selecting previously unselected package scipy. Preparing to unpack .../scipy_1.4.1_aarch64.deb ... Unpacking scipy (1.4.1) ... Setting up libgfortran5 (9.3.0) ... Setting up openblas (0.3.8) ... Setting up numpy (1.18.0) ... installing numpy Setting up scipy (1.4.1) ... installing scipy