Rust installation freezes on Raspberry PI (worked in 1.26)

[bernardolansing]

Verification

• I searched for recent similar issues at https://github.com/rust-lang/rustup/issues?q=is%3Aissue+is%3Aopen%2Cclosed and found no duplicates.
• I am on the latest version of Rustup according to https://github.com/rust-lang/rustup/tags and am still able to reproduce my issue.

Problem

The installation of Rust toolchain freezes when installing rust-docs on a Raspberry PI. The PI that I got here is a Zero 2W, 64-bit (aarch64-unknown-linux-gnu). The system image (RaspiOS Lite Bookworm, 64 bits) was made in the same day, so I doubt there was something messed up in my system specifically.

If I remember well, the only component that hanged the installation was rust-docs, and always soon after reaching 5.4 MB of installed size (I may be wrong, but I think that's it). Setting the installation profile to minimal didn't change a thing.

When I say it "freezes" the PI, I mean that the PI would get completely stuck and irresponsive. The disk write LED wouldn't stop blinking, and I couldn't start any new SSH sessions. Only solution was brute restart. I tried to wait a few hours to see if it eventually completed, but it didn't look as it'd happen.

Then I downloaded the rustup-init script version 1.26 and it worked fine.

Steps

1. Get a fresh RaspiOS Bookworm Lite system image running on a Raspberry Zero 2W (actually this is the only combination that I could test, perhaps the bug regards only the system and not the hardware, or vice-versa).
2. Execute curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh and start the installation.
3. See your PI die as it tries to install rust-docs.

Possible Solution(s)

No response

Notes

No response

Rustup version

1.27.1

Installed toolchains

I couldn't see, as installation would not finish.

OS version

RaspiOS Bookworm Lite

[djc]

Would you be able to bisect rustup changes to figure out which commit caused the issue?

[bernardolansing]

I guess, but that'll take a while as I'm busy with some things. I'll keep you updated.

[djc]

Sorry, other than I'm afraid there isn't much I can do make sense of this failure mode.

[Supermanuu]

I have the same problem with another Raspberry Pi Zero 2W, same OS, same rustup version.

For me, the installation freezes in the rustc installation (I think is the very last part). It gets to the 90% of that step and freezes. Could not Ctrl+C nor Ctrl+Z... The only way to restore the raspberry was power cut...

I have 105GB of free space in the SD card.

The 1.26 version did not work for me... I tried to install it several times...

[Supermanuu]

I could install it with the 1.27 minimal profile... but I think that it was by pure chance because it was the first time I use the minimal installation. I will check with the latest version of the script and a minimal profile.

This is the log of the installation:

platform@raspberrypi:~/rustup $ ./rustup-init.sh
info: downloading installer

Welcome to Rust!

This will download and install the official compiler for the Rust
programming language, and its package manager, Cargo.

Rustup metadata and toolchains will be installed into the Rustup
home directory, located at:

  /home/platform/.rustup

This can be modified with the RUSTUP_HOME environment variable.

The Cargo home directory is located at:

  /home/platform/.cargo

This can be modified with the CARGO_HOME environment variable.

The cargo, rustc, rustup and other commands will be added to
Cargo's bin directory, located at:

  /home/platform/.cargo/bin

This path will then be added to your PATH environment variable by
modifying the profile files located at:

  /home/platform/.profile
  /home/platform/.bashrc

You can uninstall at any time with rustup self uninstall and
these changes will be reverted.

Current installation options:


   default host triple: aarch64-unknown-linux-gnu
     default toolchain: stable (default)
               profile: default
  modify PATH variable: yes

1) Proceed with standard installation (default - just press enter)
2) Customize installation
3) Cancel installation
>2

I'm going to ask you the value of each of these installation options.
You may simply press the Enter key to leave unchanged.

Default host triple? [aarch64-unknown-linux-gnu]


Default toolchain? (stable/beta/nightly/none) [stable]


Profile (which tools and data to install)? (minimal/default/complete) [default]
minimal

Modify PATH variable? (Y/n)



Current installation options:


   default host triple: aarch64-unknown-linux-gnu
     default toolchain: stable
               profile: minimal
  modify PATH variable: yes

1) Proceed with selected options (default - just press enter)
2) Customize installation
3) Cancel installation
>1

info: profile set to 'minimal'
info: setting default host triple to aarch64-unknown-linux-gnu
info: syncing channel updates for 'stable-aarch64-unknown-linux-gnu'
info: latest update on 2024-09-05, rust version 1.81.0 (eeb90cda1 2024-09-04)
info: downloading component 'cargo'
  8.4 MiB /   8.4 MiB (100 %)   1.3 MiB/s in  7s ETA:  0s
info: downloading component 'rust-std'
 30.8 MiB /  30.8 MiB (100 %)   2.0 MiB/s in 19s ETA:  0s
info: downloading component 'rustc'
 80.5 MiB /  80.5 MiB (100 %)   1.6 MiB/s in 50s ETA:  0s
info: installing component 'cargo'
  8.4 MiB /   8.4 MiB (100 %)   3.3 MiB/s in  2s ETA:  0s
info: installing component 'rust-std'
 30.8 MiB /  30.8 MiB (100 %)   2.7 MiB/s in 33s ETA:  0s
info: installing component 'rustc'
 80.5 MiB /  80.5 MiB (100 %) 294.4 KiB/s in  1m 53s ETA:  0s
info: default toolchain set to 'stable-aarch64-unknown-linux-gnu'

  stable-aarch64-unknown-linux-gnu installed - rustc 1.81.0 (eeb90cda1 2024-09-04)


Rust is installed now. Great!

To get started you may need to restart your current shell.
This would reload your PATH environment variable to include
Cargo's bin directory ($HOME/.cargo/bin).

To configure your current shell, you need to source
the corresponding env file under $HOME/.cargo.

This is usually done by running one of the following (note the leading DOT):
. "$HOME/.cargo/env"            # For sh/bash/zsh/ash/dash/pdksh
source "$HOME/.cargo/env.fish"  # For fish

[Supermanuu]

I could not install master with the minimal profile...

platform@raspberrypi:~ $ curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
info: downloading installer

Welcome to Rust!

This will download and install the official compiler for the Rust
programming language, and its package manager, Cargo.

Rustup metadata and toolchains will be installed into the Rustup
home directory, located at:

  /home/platform/.rustup

This can be modified with the RUSTUP_HOME environment variable.

The Cargo home directory is located at:

  /home/platform/.cargo

This can be modified with the CARGO_HOME environment variable.

The cargo, rustc, rustup and other commands will be added to
Cargo's bin directory, located at:

  /home/platform/.cargo/bin

This path will then be added to your PATH environment variable by
modifying the profile files located at:

  /home/platform/.profile
  /home/platform/.bashrc

You can uninstall at any time with rustup self uninstall and
these changes will be reverted.

Current installation options:


   default host triple: aarch64-unknown-linux-gnu
     default toolchain: stable (default)
               profile: default
  modify PATH variable: yes

1) Proceed with standard installation (default - just press enter)
2) Customize installation
3) Cancel installation
>2

I'm going to ask you the value of each of these installation options.
You may simply press the Enter key to leave unchanged.

Default host triple? [aarch64-unknown-linux-gnu]


Default toolchain? (stable/beta/nightly/none) [stable]


Profile (which tools and data to install)? (minimal/default/complete) [default]
minimal

Modify PATH variable? (Y/n)



Current installation options:


   default host triple: aarch64-unknown-linux-gnu
     default toolchain: stable
               profile: minimal
  modify PATH variable: yes

1) Proceed with selected options (default - just press enter)
2) Customize installation
3) Cancel installation
>1

info: profile set to 'minimal'
info: setting default host triple to aarch64-unknown-linux-gnu
info: syncing channel updates for 'stable-aarch64-unknown-linux-gnu'
804.2 KiB / 804.2 KiB (100 %) 729.8 KiB/s in  1s ETA:  0s
info: latest update on 2024-09-05, rust version 1.81.0 (eeb90cda1 2024-09-04)
info: downloading component 'cargo'
  8.4 MiB /   8.4 MiB (100 %)   1.3 MiB/s in  6s ETA:  0s
info: downloading component 'rust-std'
 30.8 MiB /  30.8 MiB (100 %)   2.7 MiB/s in 14s ETA:  0s
info: downloading component 'rustc'
 80.5 MiB /  80.5 MiB (100 %)   2.1 MiB/s in 43s ETA:  0s
info: installing component 'cargo'
  8.4 MiB /   8.4 MiB (100 %)   3.3 MiB/s in  2s ETA:  0s
info: installing component 'rust-std'
 30.8 MiB /  30.8 MiB (100 %)   1.7 MiB/s in 31s ETA:  0s
info: installing component 'rustc'
 80.5 MiB /  80.5 MiB (95 %)   1.7 MiB/s in 1m 31s ETA:  2m 30s (this line is added by me because it dissapeared before copying the terminal, bu it was something like this)

[Supermanuu]

I could not install it with the 1.27.0 but standard profile:

platform@raspberrypi:~/rustup $ ./rustup-init.sh
info: downloading installer

Welcome to Rust!

This will download and install the official compiler for the Rust
programming language, and its package manager, Cargo.

Rustup metadata and toolchains will be installed into the Rustup
home directory, located at:

  /home/platform/.rustup

This can be modified with the RUSTUP_HOME environment variable.

The Cargo home directory is located at:

  /home/platform/.cargo

This can be modified with the CARGO_HOME environment variable.

The cargo, rustc, rustup and other commands will be added to
Cargo's bin directory, located at:

  /home/platform/.cargo/bin

This path will then be added to your PATH environment variable by
modifying the profile files located at:

  /home/platform/.profile
  /home/platform/.bashrc

You can uninstall at any time with rustup self uninstall and
these changes will be reverted.

Current installation options:


   default host triple: aarch64-unknown-linux-gnu
     default toolchain: stable (default)
               profile: default
  modify PATH variable: yes

1) Proceed with standard installation (default - just press enter)
2) Customize installation
3) Cancel installation
>1

info: profile set to 'default'
info: default host triple is aarch64-unknown-linux-gnu
info: syncing channel updates for 'stable-aarch64-unknown-linux-gnu'
804.2 KiB / 804.2 KiB (100 %) 658.4 KiB/s in  1s ETA:  0s
info: latest update on 2024-09-05, rust version 1.81.0 (eeb90cda1 2024-09-04)
info: downloading component 'cargo'
  8.4 MiB /   8.4 MiB (100 %) 352.0 KiB/s in 31s ETA:  0s
info: downloading component 'clippy'
  2.8 MiB /   2.8 MiB (100 %) 284.7 KiB/s in 11s ETA:  0s
info: downloading component 'rust-docs'
 15.9 MiB /  15.9 MiB (100 %) 255.0 KiB/s in 58s ETA:  0s
info: downloading component 'rust-std'
 30.8 MiB /  30.8 MiB (100 %)   1.5 MiB/s in 34s ETA:  0s
info: downloading component 'rustc'
 80.5 MiB /  80.5 MiB (100 %)   1.4 MiB/s in  1m 35s ETA:  0s
info: downloading component 'rustfmt'
  2.4 MiB /   2.4 MiB (100 %)   1.2 MiB/s in  2s ETA:  0s
info: installing component 'cargo'
  8.4 MiB /   8.4 MiB (100 %)   3.3 MiB/s in  3s ETA:  0s
info: installing component 'clippy'
info: installing component 'rust-docs'
 15.9 MiB /  15.9 MiB (100 %) 153.6 KiB/s in  1m 44s ETA:  0s
info: installing component 'rust-std'
 30.8 MiB /  30.8 MiB (100 %)   1.7 MiB/s in 37s ETA:  0s
info: installing component 'rustc'
 78.0 MiB /  80.5 MiB ( 97 %) 328.0 KiB/s in  1m 39s ETA:  7s

[djc]

Please don't spam this issue with repeated instances of the same problem. If you think there's value here, please add them in a single comment within a <details></details> widget.

[dborel]

This is due to Rust installation exceeding the available memory. I was able to reproduce it with v1.26 and it didn't just occur when installing rust-docs. A minimal install produced the same kind of freeze when installing rustc. For me, the workaround was to increase the swapfile to 512MB (100MB was not enough, but I didn't try any other values).

sudo dphys-swapfile swapoff
sudo nano /etc/dphys-swapfile # Edit CONF_SWAPFILE=512
sudo dphys-swapfile setup
sudo dphys-swapfile swapon

[djc]

We do have some code in place to try to avoid this kind of situation. If one of you can do some experiments to see if/how we could adapt that, would be great!

[dborel]

It's pretty common to run out of memory on rpi, especially when compiling large codebases. I actually had to up the swapfile further to 2048 to build librespot with cargo as soon as I got past this issue. It would be nice if raspbian failed more gracefully in this situation. It's possible to watch swap usage with htop or /proc/swaps. Adding a 32-bit ARMv7 build might be another dirty hack to limit memory utilization on rpi.

[Supermanuu]

The swap increase worked for me too! I was able to install the latest version of rustup with curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh without problems! Thank you!

I have also problems to install some cargo crates too, I will try to install them again with the swap increase... But I think that this problem belongs to another people xD

Next week I can check with you @djc that code if you wish

[rami3l]

Closing in favor of #3125 (sorry, this is another old and recurring issue!). Rustup's handling of very little free memory definitely needs some improvement... And indeed many report using Raspi Zero 2 or similar platforms.

Sometimes RUSTUP_IO_THREADS=1 helps, but only occasionally.

With all the refactoring in v1.28 I'm not sure if the situation has turned better or worse...