armv7 exhausts memory on stage0 librustc w/ debuginfo

[cuviper]

I'm having trouble natively compiling rustc armv7-unknown-linux-gnueabihf with --enable-debuginfo, on both the beta and master branches. I haven't seen this on any stable release before. To reproduce the issue, I'm running on Fedora 26 armv7hl, using all default options apart from enabling debuginfo.

Building stage0 compiler artifacts (armv7-unknown-linux-gnueabihf -> armv7-unknown-linux-gnueabihf)
[...]
   Compiling rustc v0.0.0 (file:///home/jistone/rust-beta/src/librustc)
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
error: Could not compile `rustc`.

Caused by:
  process didn't exit successfully: `/home/jistone/rust-beta/build/bootstrap/debug/rustc --crate-name rustc src/librustc/lib.rs [...]` (signal: 6, SIGABRT: process abort signal)

I guess that C++ exception is probably LLVM running out of memory. This excerpt is from beta sources -- on master it also errors, but without the exception info, instead a SIGSEGV. I doubt that difference is very significant, just bad luck for who failed to allocate memory.

In either case, when I watch progress in htop, the process grows right up to 3GB virt size and then dies. That's the limit of the 32-bit user address space, of course. The resident size was just a little over 2GB at that time, so something is holding wasted memory here. It could be jemalloc, or could be extra capacity in vec/map/etc. -- I'm not sure how to tell.

My workaround for now is to use --enable-debuginfo-only-std.

(And FWIW, 32-bit i686 is not having this problem for me.)

[cuviper]

Firefox appears to be hitting this now too, while compiling gkrust:
https://bugzilla.redhat.com/show_bug.cgi?id=1523912

[glaubitz]

This also affects mips and mipsel on Debian which prevents us from bootstrapping the Rust compiler for these architectures. Disabling debug symbols doesn't help unfortunately, unlike on armel and armhf.

Both 32-bit MIPS architectures have unfortunately a memory limit of 2 GiB virtual address space per process.

[wzssyqa]

On Debian, for some packages, we use a gcc option: --param ggc-min-expand=10 on mips/mipsel.

Does llvm have some similiar options?