Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: give more time to GC in test-shadow-realm-gc-* #50735

Closed
wants to merge 1 commit into from

Conversation

joyeecheung
Copy link
Member

When --node-builtin-modules-path is used, we read and create new strings for builtins in each realm which increases the memory usage. As a result GC may not be able to keep up with the allocation done in the loop in the test.

As a workaround, give GC a bit more time by waiting for a timer in the loop.

Refs: #50726

@joyeecheung joyeecheung added the request-ci Add this label to start a Jenkins CI on a PR. label Nov 14, 2023
@nodejs-github-bot nodejs-github-bot added needs-ci PRs that need a full CI run. test Issues and PRs related to the tests. labels Nov 14, 2023
@github-actions github-actions bot removed the request-ci Add this label to start a Jenkins CI on a PR. label Nov 14, 2023
@nodejs-github-bot
Copy link
Collaborator

When --node-builtin-modules-path is used, we read and create
new strings for builtins in each realm which increases the memory
usage. As a result GC may not be able to keep up with the
allocation done in the loop in the test.

As a workaround, give GC a bit more time by waiting for a timer
in the loop.
@joyeecheung joyeecheung added the request-ci Add this label to start a Jenkins CI on a PR. label Nov 15, 2023
@github-actions github-actions bot removed the request-ci Add this label to start a Jenkins CI on a PR. label Nov 15, 2023
@nodejs-github-bot
Copy link
Collaborator

@joyeecheung
Copy link
Member Author

joyeecheung commented Nov 15, 2023

Testing with --node-builtin-modules-path=. https://ci.nodejs.org/job/node-test-commit/66586/

EDIT: er...looks like --node-builtin-modules-path=. doesn't work in the CI

@joyeecheung
Copy link
Member Author

joyeecheung commented Nov 15, 2023

Stress test for affected platforms (using nodejs/reliability#718) https://ci.nodejs.org/job/node-stress-single-test/465/

@nodejs-github-bot
Copy link
Collaborator

@joyeecheung
Copy link
Member Author

joyeecheung commented Nov 16, 2023

I am again seeing this in the V8 integration CI, not sure if this fixes the flake over there https://logs.chromium.org/logs/node-ci/buildbucket/cr-buildbucket/8764249834281259873/+/u/test_default__retry_/stdout

@joyeecheung
Copy link
Member Author

joyeecheung commented Nov 16, 2023

Last CI and stress tests were green although the bot did not communicate the result to GitHub again (failures are from #50735 (comment) which wasn't supported by the CI..)

@joyeecheung joyeecheung changed the title test: give more time to GC in test-shadow-realm-gc-module test: give more time to GC in test-shadow-realm-gc-* Nov 16, 2023
@joyeecheung
Copy link
Member Author

joyeecheung commented Nov 17, 2023

This needs another LGTM to land - I am seeing this again in another V8 CI so it's better to deflake them sooner too.

joyeecheung added a commit that referenced this pull request Nov 17, 2023
When --node-builtin-modules-path is used, we read and create
new strings for builtins in each realm which increases the memory
usage. As a result GC may not be able to keep up with the
allocation done in the loop in the test.

As a workaround, give GC a bit more time by waiting for a timer
in the loop.

PR-URL: #50735
Refs: #50726
Reviewed-By: Chengzhong Wu <legendecas@gmail.com>
Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>
@joyeecheung
Copy link
Member Author

landed in c5eb2c4

pthier pushed a commit to v8/node that referenced this pull request Nov 20, 2023
targos pushed a commit that referenced this pull request Nov 23, 2023
When --node-builtin-modules-path is used, we read and create
new strings for builtins in each realm which increases the memory
usage. As a result GC may not be able to keep up with the
allocation done in the loop in the test.

As a workaround, give GC a bit more time by waiting for a timer
in the loop.

PR-URL: #50735
Refs: #50726
Reviewed-By: Chengzhong Wu <legendecas@gmail.com>
Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>
martenrichter pushed a commit to martenrichter/node that referenced this pull request Nov 26, 2023
When --node-builtin-modules-path is used, we read and create
new strings for builtins in each realm which increases the memory
usage. As a result GC may not be able to keep up with the
allocation done in the loop in the test.

As a workaround, give GC a bit more time by waiting for a timer
in the loop.

PR-URL: nodejs#50735
Refs: nodejs#50726
Reviewed-By: Chengzhong Wu <legendecas@gmail.com>
Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>
zcbenz pushed a commit to photoionization/node_ci that referenced this pull request Nov 27, 2023
To include (partially) nodejs/node#50735 to fix
flaky tests.

Change-Id: I5355397d639bcb03ca2f5de24200db18d6e02505
Reviewed-on: https://chromium-review.googlesource.com/c/v8/node-ci/+/5038521
Reviewed-by: Victor Gomes <victorgomes@chromium.org>
Auto-Submit: Patrick Thier <pthier@chromium.org>
Commit-Queue: Victor Gomes <victorgomes@chromium.org>
lucshi pushed a commit to lucshi/node that referenced this pull request Nov 27, 2023
When --node-builtin-modules-path is used, we read and create
new strings for builtins in each realm which increases the memory
usage. As a result GC may not be able to keep up with the
allocation done in the loop in the test.

As a workaround, give GC a bit more time by waiting for a timer
in the loop.

PR-URL: nodejs#50735
Refs: nodejs#50726
Reviewed-By: Chengzhong Wu <legendecas@gmail.com>
Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>
@RafaelGSS RafaelGSS mentioned this pull request Nov 28, 2023
RafaelGSS pushed a commit that referenced this pull request Nov 29, 2023
When --node-builtin-modules-path is used, we read and create
new strings for builtins in each realm which increases the memory
usage. As a result GC may not be able to keep up with the
allocation done in the loop in the test.

As a workaround, give GC a bit more time by waiting for a timer
in the loop.

PR-URL: #50735
Refs: #50726
Reviewed-By: Chengzhong Wu <legendecas@gmail.com>
Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>
RafaelGSS pushed a commit that referenced this pull request Nov 30, 2023
When --node-builtin-modules-path is used, we read and create
new strings for builtins in each realm which increases the memory
usage. As a result GC may not be able to keep up with the
allocation done in the loop in the test.

As a workaround, give GC a bit more time by waiting for a timer
in the loop.

PR-URL: #50735
Refs: #50726
Reviewed-By: Chengzhong Wu <legendecas@gmail.com>
Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>
richardlau pushed a commit that referenced this pull request Mar 25, 2024
When --node-builtin-modules-path is used, we read and create
new strings for builtins in each realm which increases the memory
usage. As a result GC may not be able to keep up with the
allocation done in the loop in the test.

As a workaround, give GC a bit more time by waiting for a timer
in the loop.

PR-URL: #50735
Refs: #50726
Reviewed-By: Chengzhong Wu <legendecas@gmail.com>
Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>
@richardlau richardlau mentioned this pull request Mar 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs-ci PRs that need a full CI run. test Issues and PRs related to the tests.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants