Self contained linking option #72738

mati865 · 2020-05-29T15:19:17Z

With objects moved to self-contained directory by #72999 we can now add option to control whether to use self-contained on native linkage mode.

mati865 · 2020-06-02T19:47:06Z

@petrochenkov could you do @bors try?

petrochenkov · 2020-06-04T21:56:23Z

@bors try

bors · 2020-06-04T21:56:35Z

⌛ Trying commit b173dca3afcee12951c6df33733197171f5cf0f8 with merge 97f416b9b95c99013190cc71a59bd73d0596ba36...

bors · 2020-06-05T00:47:18Z

☀️ Try build successful - checks-azure
Build commit: 97f416b9b95c99013190cc71a59bd73d0596ba36 (97f416b9b95c99013190cc71a59bd73d0596ba36)

mati865 · 2020-06-05T10:04:18Z

Proof of concept detection of external MinGW appears to work nice.

FYI: rust-mingw contains mingw-w64 libs and the linker (GCC+LD), CRT is shipped with rust-std.

Observations when linking Rust library to C library built with newer mingw-w64:

	rust-mingw installed	rust-mingw not installed
link_self_contained=no	`ld: cannot find crtbegin.o: No such file or directory`	Works
link_self_contained=yes	Error: Rust shipped mingw-w64 libs are too old for the CRT C lib is linked to	Error: external mingw-w64 libs are too new for the CRT Rust tries to link

link_self_contained=yes is not expected to work since Rust shipped mingw-64 might or might not match version that the other lib was built with.
link_self_contained=no does fix #68887 when rust-mingw is not installed. When rust-mingw is installed we use linker from it, even though we detected external mingw-w64 properly.

So to really fix #68887 we have to move the linker to self-contained directory similar way as ff2703c moves the libs and CRT.

petrochenkov · 2020-06-05T22:05:33Z

@mati865
Is it better to land #72999 first and then proceed to this PR, or this PR can be landed independently?
(I haven't read either of them yet.)

mati865 · 2020-06-05T22:22:44Z

At first I though this could be landed separately but now I'm not that sure. This PR is already a slight improvement but full potential requires #72999 + another change to also move bin to self-contained directory.
Ideally I would like all that stuff in different nightly builds so ppl can find possible regressions easier.

petrochenkov · 2020-06-05T22:29:13Z

Ok, let's start with #72999 then.

mati865 · 2020-06-19T14:42:32Z

Can I have one more try build to test musl and MinGW?

petrochenkov · 2020-06-19T15:12:59Z

@bors try

bors · 2020-06-19T15:13:13Z

⌛ Trying commit a98890521222b8a209d08db7e3ee68bcf876b503 with merge f90b336e3b94505daa475040dc34722df2ae2b16...

bors · 2020-06-19T18:12:43Z

☀️ Try build successful - checks-azure
Build commit: f90b336e3b94505daa475040dc34722df2ae2b16 (f90b336e3b94505daa475040dc34722df2ae2b16)

mati865 · 2020-06-22T14:14:47Z

That could use one last try.
I've modified the PR to have no effect unless unstable link-self-contained is passed so it should not require another MCP.
Once it lands we can ask users for the feedback, move detection logic to crt_objects_fallback and remove get_crt_libs_path.

petrochenkov · 2020-06-22T17:37:07Z

@bors try

bors · 2020-06-22T17:37:14Z

🔒 Merge conflict

This pull request and the master branch diverged in a way that cannot be automatically merged. Please rebase on top of the latest master branch, and let the reviewer approve again.

How do I rebase?

Assuming self is your fork and upstream is this repository, you can resolve the conflict following these steps:

git checkout self-contained-option (switch to your branch)
git fetch upstream master (retrieve the latest master)
git rebase upstream/master -p (rebase on top of it)
Follow the on-screen instruction to resolve conflicts (check git status if you got lost).
git push self self-contained-option --force-with-lease (update this PR)

You may also read Git Rebasing to Resolve Conflicts by Drew Blessing for a short tutorial.

Please avoid the "Resolve conflicts" button on GitHub. It uses git merge instead of git rebase which makes the PR commit history more difficult to read.

Sometimes step 4 will complete without asking for resolution. This is usually due to difference between how Cargo.lock conflict is handled during merge and rebase. This is normal, and you should still perform step 5 to update this PR.

Error message

Auto-merging src/librustc_session/options.rs
Auto-merging src/librustc_codegen_ssa/back/link.rs
Auto-merging src/ci/azure-pipelines/try.yml
CONFLICT (content): Merge conflict in src/ci/azure-pipelines/try.yml
Automatic merge failed; fix conflicts and then commit the result.

petrochenkov · 2020-06-22T17:37:43Z

Needs rebase.

src/librustc_codegen_ssa/back/link.rs

src/librustc_session/options.rs

petrochenkov · 2020-06-22T18:06:57Z

@bors try

bors · 2020-06-22T18:07:08Z

⌛ Trying commit fed5593fa808a369ea5126cfeb09874c2b687e3f with merge 122b602cd8399434540a6b5932a1938330f66c36...

bors · 2020-06-22T21:29:21Z

☀️ Try build successful - checks-azure
Build commit: 122b602cd8399434540a6b5932a1938330f66c36 (122b602cd8399434540a6b5932a1938330f66c36)

petrochenkov · 2020-06-24T09:52:44Z

Looks like this is ready?
r=me after squashing the commits.

mati865 · 2020-06-25T09:46:57Z

Looks like this is ready?

Yeah, forgot to write a comment 🤷‍♂️

petrochenkov · 2020-06-25T10:16:19Z

@bors r+

bors · 2020-06-25T10:16:21Z

📌 Commit f27dcd7 has been approved by petrochenkov

…trochenkov Self contained linking option With objects moved to self-contained directory by rust-lang#72999 we can now add option to control whether to use self-contained on native linkage mode.

@ghost

…arth Rollup of 14 pull requests Successful merges: - rust-lang#72617 (Add a fast path for `std::thread::panicking`.) - rust-lang#72738 (Self contained linking option) - rust-lang#72770 (Implement mixed script confusable lint.) - rust-lang#73418 (Add unstable `core::mem::variant_count` intrinsic) - rust-lang#73460 (Emit line info for generator variants) - rust-lang#73534 (Provide suggestions for some moved value errors) - rust-lang#73538 (make commented examples use valid syntax, and be more consistent ) - rust-lang#73581 (Create 0766 error code) - rust-lang#73619 (Document the mod keyword) - rust-lang#73621 (Document the mut keyword) - rust-lang#73648 (Document the return keyword) - rust-lang#73673 (Fix ptr doc warnings.) - rust-lang#73674 (Tweak binop errors) - rust-lang#73687 (Clean up E0701 explanation) Failed merges: - rust-lang#73708 (Explain move errors that occur due to method calls involving `self` (take two)) r? @ghost

petrochenkov self-assigned this Jun 4, 2020

petrochenkov added the S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. label Jun 4, 2020

petrochenkov added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels Jun 5, 2020

petrochenkov added S-blocked Status: Marked as blocked ❌ on something else such as an RFC or other implementation work. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Jun 6, 2020

petrochenkov added S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. and removed S-blocked Status: Marked as blocked ❌ on something else such as an RFC or other implementation work. labels Jun 19, 2020

mati865 mentioned this pull request Jun 19, 2020

provide a way of overriding the MinGW library path #68887

Closed

mati865 force-pushed the self-contained-option branch 4 times, most recently from ec4e7b0 to a988905 Compare June 19, 2020 14:05

This was referenced Jun 19, 2020

Rollup of 10 pull requests #73499

Closed

forbid mutable references in all constant contexts except for const-fns #72934

Merged

petrochenkov mentioned this pull request Jun 21, 2020

Version mismatch between Rust's bundled musl libc and system musl may cause linking errors with native libraries #73589

Open

mati865 force-pushed the self-contained-option branch from 9863a28 to 4c5e9f0 Compare June 22, 2020 14:04

mati865 changed the title ~~[WIP] Self contained linking option~~ Self contained linking option Jun 22, 2020

mati865 marked this pull request as ready for review June 22, 2020 14:14

petrochenkov reviewed Jun 22, 2020

View reviewed changes

src/librustc_codegen_ssa/back/link.rs Outdated Show resolved Hide resolved

src/librustc_codegen_ssa/back/link.rs Outdated Show resolved Hide resolved

src/librustc_session/options.rs Outdated Show resolved Hide resolved

mati865 force-pushed the self-contained-option branch from c1d1617 to fed5593 Compare June 22, 2020 18:03

mati865 force-pushed the self-contained-option branch from fed5593 to f2ee031 Compare June 23, 2020 18:14

mati865 added 3 commits June 25, 2020 11:27

Add unstable rustc option to control self-contained linkage mode

2e3f517

Rename get_self_contained_lib_path

54293c1

Rename remaining fallback to self_contained

f27dcd7

mati865 force-pushed the self-contained-option branch from f2ee031 to f27dcd7 Compare June 25, 2020 09:35

bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels Jun 25, 2020

This was referenced Jun 26, 2020

Rollup of 15 pull requests #73745

Closed

Rollup of 14 pull requests #73746

Merged

bors merged commit 9275ff7 into rust-lang:master Jun 26, 2020

mati865 deleted the self-contained-option branch June 26, 2020 07:31

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Self contained linking option #72738

Self contained linking option #72738

mati865 commented May 29, 2020 •

edited

Loading

mati865 commented Jun 2, 2020

petrochenkov commented Jun 4, 2020

bors commented Jun 4, 2020

bors commented Jun 5, 2020

mati865 commented Jun 5, 2020

petrochenkov commented Jun 5, 2020

mati865 commented Jun 5, 2020

petrochenkov commented Jun 5, 2020

mati865 commented Jun 19, 2020

petrochenkov commented Jun 19, 2020

bors commented Jun 19, 2020

bors commented Jun 19, 2020

mati865 commented Jun 22, 2020

petrochenkov commented Jun 22, 2020

bors commented Jun 22, 2020

petrochenkov commented Jun 22, 2020

petrochenkov commented Jun 22, 2020

bors commented Jun 22, 2020

bors commented Jun 22, 2020

petrochenkov commented Jun 24, 2020

mati865 commented Jun 25, 2020

petrochenkov commented Jun 25, 2020

bors commented Jun 25, 2020

Self contained linking option #72738

Self contained linking option #72738

Conversation

mati865 commented May 29, 2020 • edited Loading

mati865 commented Jun 2, 2020

petrochenkov commented Jun 4, 2020

bors commented Jun 4, 2020

bors commented Jun 5, 2020

mati865 commented Jun 5, 2020

petrochenkov commented Jun 5, 2020

mati865 commented Jun 5, 2020

petrochenkov commented Jun 5, 2020

mati865 commented Jun 19, 2020

petrochenkov commented Jun 19, 2020

bors commented Jun 19, 2020

bors commented Jun 19, 2020

mati865 commented Jun 22, 2020

petrochenkov commented Jun 22, 2020

bors commented Jun 22, 2020

petrochenkov commented Jun 22, 2020

petrochenkov commented Jun 22, 2020

bors commented Jun 22, 2020

bors commented Jun 22, 2020

petrochenkov commented Jun 24, 2020

mati865 commented Jun 25, 2020

petrochenkov commented Jun 25, 2020

bors commented Jun 25, 2020

mati865 commented May 29, 2020 •

edited

Loading