dyld[27309]: Library not loaded: @rpath/libtest-01ad18af57f4eecf.dylib on MacOS (or with mold on Linux)

[dpc]

I just migrated our project to nextest, landed the PR, just to discover it is broken on MacOS (which we test only on master branch, because GH MacOS runner is soooo slow).

After some looking I wonder: if the reason for it the macOS System Integrity Protection sanitization issue?

If so - I don't understand why am I supposed to do with the extra env variables, or rather ... where exacty. I don't think I'm using any target runners.

Full output:

$ cargo nextest run --no-run
    Finished test [unoptimized + debuginfo] target(s) in 0.51s
error: creating test list failed

Caused by:
  for `fedimint-derive::proc-macro/fedimint_derive`, command `/Users/runner/tmp/fedimint/target/debug/deps/fedimint_derive-0268f54e86f9ab6b --list --format terse` exited with signal 6 (SIGABRT)
--- stdout:

--- stderr:
dyld[31922]: Library not loaded: @rpath/libtest-01ad18af57f4eecf.dylib
  Referenced from: <no uuid> /Users/runner/tmp/fedimint/target/debug/deps/fedimint_derive-0268f54e86f9ab6b
  Reason: tried: '/System/Library/Frameworks/libtest-01ad18af57f4eecf.dylib' (no such file, not in dyld cache), '/System/Volumes/Preboot/Cryptexes/OS/System/Library/Frameworks/libtest-01ad18af57f4eecf.dylib' (no such file), '/System/Library/Frameworks/libtest-01ad18af57f4eecf.dylib' (no such file, not in dyld cache), '/System/Volumes/Preboot/Cryptexes/OS/System/Library/Frameworks/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/build/bzip2-sys-f147f00e3c7bd833/out/lib/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/build/librocksdb-sys-099d0c46376f143d/out/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/build/libsqlite3-sys-16aeb35454a560bd/out/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/build/libz-sys-aca9a3d7ce7e8072/out/lib/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/build/lz4-sys-eaf2000877b26334/out/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/build/ring-8399b7d27e1580d0/out/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/build/secp256k1-sys-202b4797af0d23a4/out/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/build/secp256k1-sys-6c26d5e24aeebaa8/out/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/build/secp256k1-zkp-sys-70a2dd2313be40d8/out/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/build/zstd-sys-3f00e657302f58e2/out/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/deps/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/tmp/fedimint/target/debug/libtest-01ad18af57f4eecf.dylib' (no such file), '/Users/runner/lib/libtest-01ad18af57f4eecf.dylib' (no such file), '/usr/local/lib/libtest-01ad18af57f4eecf.dylib' (no such file), '/usr/lib/libtest-01ad18af57f4eecf.dylib' (no such file, not in dyld cache)

---

[dpc]

OK. So I've found a helpful comment. And was able to fix it with:

$ env DYLD_FALLBACK_LIBRARY_PATH=/nix/store/vi0fm4l0xbx4yw2x45fiiybaa2jlk7xp-rust-stable-with-components-2023-08-24/lib/ cargo nextest run --no-run
    Finished test [unoptimized + debuginfo] target(s) in 0.53s

I guess I can work-around it in our Nix dev shell. Maybe it will be helpful for someone else.

[sunshowers]

This is unrelated to SIP, since there are no system binaries involved.

cargo should be responsible for setting this environment variable, so that's really strange.

[dpc]

What does "system binary" mean here exactly?

[dpc]

Coincidentally, I think I've just reproduced this problem on Linux, when I attempted to use mold as a linker. Similiar workaround works (wrapper that makes LD_LIBRARY_PATH point directory with that library, though after that I'm getting different library missing (librocksdb.so.7).

[dpc]

OK. Closing as a dup of #267

[dpc]

Nvmd. The Linux problem was a missing mold wrapper for Nix.