QEMUv8: RUST_ENABLE=y takes a lot of disk space

[jforissier]

RUST_ENABLE=y requires a lot of disk space compared to RUST_ENABLE=n. This has been the cause of CI failures in the optee_os repository multiple times, and therefore Rust was disabled in OP-TEE/optee_os#7574. There must be a way to reduce the disk space requirements and run the Rust tests again.

[DemesneGH]

FYI we also encountered a disk space issue. Here’s the workaround we used:
https://github.com/apache/teaclave-trustzone-sdk/blob/main/.github/workflows/reuse_test_in_optee_repo.yml#L38

[jforissier]

FYI we also encountered a disk space issue. Here’s the workaround we used: https://github.com/apache/teaclave-trustzone-sdk/blob/main/.github/workflows/reuse_test_in_optee_repo.yml#L38

Nice suggestion! I will definitely try it.

That being said, don't you think there are other things that could be done to reduce the size of the Rust build? The word "rust" appears too many times in the top contributors to the total disk size IMHO see below 😉

$ docker run -it --rm jforissier/optee_os_ci:qemu_check
root@61b3b83bea92:/# export FORCE_UNSAFE_CONFIGURE=1
root@61b3b83bea92:/# export CFG_TEE_CORE_LOG_LEVEL=2
root@61b3b83bea92:/# /root/get_optee.sh qemu_v8 /root/optee
root@61b3b83bea92:/# cd optee/build
root@61b3b83bea92:~/optee/build# make -j$(nproc)
root@61b3b83bea92:~/optee/build# ./du.py /
**Computing sizes for: / -- max depth: 9999 (-d 9999), sub-directory list truncation: { min contribution to top 1.0% (-D 1.0) or max lines 9999 (-n 9999) or cumulative size 75% of parent (-c 75) or sub-dir size less than 10% of parent (-s 10) }, size mode: Allocated (default)**

32.3G   /
    29.6G       /root
        29G     /root/optee
            17.9G       /root/optee/out-br
                15.1G   /root/optee/out-br/build
                    10.7G       /root/optee/out-br/build/optee_rust_examples_ext-1.0
                        10.7G   /root/optee/out-br/build/optee_rust_examples_ext-1.0/examples
                            1.9G        /root/optee/out-br/build/optee_rust_examples_ext-1.0/examples/mnist-rs
                                1.2G    /root/optee/out-br/build/optee_rust_examples_ext-1.0/examples/mnist-rs/ta
                                    1.2G        /root/optee/out-br/build/optee_rust_examples_ext-1.0/examples/mnist-rs/ta/target
                                        786.7M  /root/optee/out-br/build/optee_rust_examples_ext-1.0/examples/mnist-rs/ta/target/aarch64-unknown-linux-gnu
                                            482.7M      /root/optee/out-br/build/optee_rust_examples_ext-1.0/examples/mnist-rs/ta/target/aarch64-unknown-linux-gnu/release
                                                474.5M  /root/optee/out-br/build/optee_rust_examples_ext-1.0/examples/mnist-rs/ta/target/aarch64-unknown-linux-gnu/release/deps
                                        374.3M  /root/optee/out-br/build/optee_rust_examples_ext-1.0/examples/mnist-rs/ta/target/debug
                                700.3M  /root/optee/out-br/build/optee_rust_examples_ext-1.0/examples/mnist-rs/host
                                    700.2M      /root/optee/out-br/build/optee_rust_examples_ext-1.0/examples/mnist-rs/host/target
                            ... (20 more subdirs)
                    1.6G        /root/optee/out-br/build/host-rust-bin-1.86.0
                        707.4M  /root/optee/out-br/build/host-rust-bin-1.86.0/rust-docs
                            707.3M      /root/optee/out-br/build/host-rust-bin-1.86.0/rust-docs/share
                                707.3M  /root/optee/out-br/build/host-rust-bin-1.86.0/rust-docs/share/doc
                                    707.3M      /root/optee/out-br/build/host-rust-bin-1.86.0/rust-docs/share/doc/rust
                                        707.3M  /root/optee/out-br/build/host-rust-bin-1.86.0/rust-docs/share/doc/rust/html
                        345.7M  /root/optee/out-br/build/host-rust-bin-1.86.0/rustc
                    ... (2 more subdirs)
                ...     (2 more subdirs)
            4.3G        /root/optee/toolchains
                3.2G    /root/optee/toolchains/rust
                    3G  /root/optee/toolchains/rust/.rustup
                        3G      /root/optee/toolchains/rust/.rustup/toolchains
                            1.3G        /root/optee/toolchains/rust/.rustup/toolchains/stable-x86_64-unknown-linux-gnu
                                715M    /root/optee/toolchains/rust/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/share
                                    714.5M      /root/optee/toolchains/rust/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/share/doc
                                        714.4M  /root/optee/toolchains/rust/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/share/doc/rust
                                            702.1M      /root/optee/toolchains/rust/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/share/doc/rust/html
                                498.9M  /root/optee/toolchains/rust/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib
                            869.9M      /root/optee/toolchains/rust/.rustup/toolchains/nightly-2025-05-16-x86_64-unknown-linux-gnu
                                781.8M  /root/optee/toolchains/rust/.rustup/toolchains/nightly-2025-05-16-x86_64-unknown-linux-gnu/lib
                                    466.2M      /root/optee/toolchains/rust/.rustup/toolchains/nightly-2025-05-16-x86_64-unknown-linux-gnu/lib/rustlib
                            861.2M      /root/optee/toolchains/rust/.rustup/toolchains/nightly-2024-05-15-x86_64-unknown-linux-gnu
                                790.7M  /root/optee/toolchains/rust/.rustup/toolchains/nightly-2024-05-15-x86_64-unknown-linux-gnu/lib
                                    521.8M      /root/optee/toolchains/rust/.rustup/toolchains/nightly-2024-05-15-x86_64-unknown-linux-gnu/lib/rustlib
                629.6M  /root/optee/toolchains/aarch64
                    343.6M      /root/optee/toolchains/aarch64/aarch64-none-linux-gnu
                503.2M  /root/optee/toolchains/aarch32
            ... (5 more subdirs)
        ...     (1 more subdirs)
    ... (15 more subdirs)

du.py

[DemesneGH]

That being said, don't you think there are other things that could be done to reduce the size of the Rust build? The word "rust" appears too many times in the top contributors to the total disk size IMHO see below 😉

One possible approach is to use cargo install and cargo clean to remove the large intermediate building artifacts. We are designing a new build system based on Cargo, I think this cleanup step could be incorporated into its command list.

But the new building system needs some time for implementation, if the workaround isn’t ideal, it’s fine to temporarily disable the Rust build in the OP-TEE OS CI. We have a periodic CI job in the SDK to verify compatibility with latest OP-TEE repo 😃

[jforissier]

That being said, don't you think there are other things that could be done to reduce the size of the Rust build? The word "rust" appears too many times in the top contributors to the total disk size IMHO see below 😉

One possible approach is to use cargo install and cargo clean to remove the large intermediate building artifacts. We are designing a new build system based on Cargo, I think this cleanup step could be incorporated into its command list.

Sounds good.

But the new building system needs some time for implementation, if the workaround isn’t ideal, it’s fine to temporarily disable the Rust build in the OP-TEE OS CI. We have a periodic CI job in the SDK to verify compatibility with latest OP-TEE repo 😃

No worries. As I said I'll try to implement the CI runner cleanup you mentioned, if that works then fine otherwise I will leave Rust disabled. Once again, thanks for the quick and valuable help.

[jforissier]

I did implement the host cleanup and I enabled the Rust builds again in OP-TEE/optee_os#7580. I am leaving this issue open with the "improvement" tag since it would still be cool to reduce the size of optee_rust_examples_ext-1.0 and possibly consolidate the toolchains. But it is not urgent.

[DemesneGH]

Got it, I’ll reply on this thread once there’s any progress. Thanks!