Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Drop excessive cells after task reexecution #8170

Merged
merged 2 commits into from
Jul 24, 2024
Merged

Conversation

sokra
Copy link
Member

@sokra sokra commented May 17, 2024

Description

When cells become unused after recomputation of a task, drop them.

Testing Instructions

Copy link

vercel bot commented May 17, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
examples-nonmonorepo ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 24, 2024 7:19pm
rust-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 24, 2024 7:19pm
8 Skipped Deployments
Name Status Preview Comments Updated (UTC)
examples-basic-web ⬜️ Ignored (Inspect) Visit Preview Jul 24, 2024 7:19pm
examples-designsystem-docs ⬜️ Ignored (Inspect) Visit Preview Jul 24, 2024 7:19pm
examples-gatsby-web ⬜️ Ignored (Inspect) Visit Preview Jul 24, 2024 7:19pm
examples-kitchensink-blog ⬜️ Ignored (Inspect) Visit Preview Jul 24, 2024 7:19pm
examples-native-web ⬜️ Ignored (Inspect) Visit Preview Jul 24, 2024 7:19pm
examples-svelte-web ⬜️ Ignored (Inspect) Visit Preview Jul 24, 2024 7:19pm
examples-tailwind-web ⬜️ Ignored (Inspect) Visit Preview Jul 24, 2024 7:19pm
examples-vite-web ⬜️ Ignored (Inspect) Visit Preview Jul 24, 2024 7:19pm

Copy link
Contributor

github-actions bot commented May 17, 2024

✅ This change can build next-swc

Copy link
Contributor

github-actions bot commented May 17, 2024

🟢 Turbopack Benchmark CI successful 🟢

Thanks

Copy link
Contributor

github-actions bot commented May 17, 2024

⚠️ CI failed ⚠️

The following steps have failed in CI:

  • Turbopack Rust tests (mac/win, non-blocking)

See workflow summary for details

@@ -325,6 +324,7 @@ impl Backend for MemoryBackend {
task_id: TaskId,
duration: Duration,
memory_usage: usize,
cell_counters: AutoMap<ValueTypeId, u32, BuildHasherDefault<FxHasher>, 8>,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unrelated but it would be useful to log the max size of each of these items perhaps in the tracing mode @bgw built? It's hard as a reviewer to understand memory impact sometimes.

/// Access to a cell.
pub(crate) fn with_cell_mut<T>(
/// Read a cell.
pub(crate) fn read_cell(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bikeshedding but I prefer with_cell and with_cell_mut even it it not supposed to return anything

When cells become unused after recomputation of a task, drop them.
Copy link
Member Author

sokra commented Jul 24, 2024

Merge activity

@sokra sokra deleted the sokra/excessive-cells branch July 24, 2024 19:40
sokra added a commit to vercel/next.js that referenced this pull request Jul 25, 2024
* vercel/turborepo#8812 <!-- Benjamin Woodruff -
Simplify some of the syntax used with VcRead<T> -->
* vercel/turborepo#8823 <!-- hrmny -
feat(turbopack): support analysing string concatenation -->
* vercel/turborepo#8828 <!-- Tobias Koppers - change
from failsafe_analyse to failsafe_parse -->
* vercel/turborepo#8831 <!-- Alexander Lyon - make
sure that all the taiki-e/install-action calls use our env -->
* vercel/turborepo#8819 <!-- Tobias Koppers -
Refactor cell reading to handle removed cells -->
* vercel/turborepo#8038 <!-- Alexander Lyon - add
tags to turbo tasks -->
* vercel/turborepo#8807 <!-- Tobias Koppers - box
Scheduled task state to save memory -->
* vercel/turborepo#8170 <!-- Tobias Koppers - Drop
excessive cells after task reexecution -->
ForsakenHarmony pushed a commit to vercel/next.js that referenced this pull request Jul 25, 2024
### Description

When cells become unused after recomputation of a task, drop them.

### Testing Instructions

<!--
  Give a quick description of steps to test your changes.
-->
ForsakenHarmony pushed a commit to vercel/next.js that referenced this pull request Jul 29, 2024
### Description

When cells become unused after recomputation of a task, drop them.

### Testing Instructions

<!--
  Give a quick description of steps to test your changes.
-->
ForsakenHarmony pushed a commit to vercel/next.js that referenced this pull request Jul 29, 2024
### Description

When cells become unused after recomputation of a task, drop them.

### Testing Instructions

<!--
  Give a quick description of steps to test your changes.
-->
NicholasLYang pushed a commit that referenced this pull request Jul 31, 2024
When cells become unused after recomputation of a task, drop them.

<!--
  Give a quick description of steps to test your changes.
-->
ForsakenHarmony pushed a commit to vercel/next.js that referenced this pull request Aug 1, 2024
### Description

When cells become unused after recomputation of a task, drop them.

### Testing Instructions

<!--
  Give a quick description of steps to test your changes.
-->
NicholasLYang pushed a commit that referenced this pull request Aug 1, 2024
When cells become unused after recomputation of a task, drop them.

<!--
  Give a quick description of steps to test your changes.
-->
ForsakenHarmony pushed a commit to vercel/next.js that referenced this pull request Aug 14, 2024
* vercel/turborepo#8812 <!-- Benjamin Woodruff -
Simplify some of the syntax used with VcRead<T> -->
* vercel/turborepo#8823 <!-- hrmny -
feat(turbopack): support analysing string concatenation -->
* vercel/turborepo#8828 <!-- Tobias Koppers - change
from failsafe_analyse to failsafe_parse -->
* vercel/turborepo#8831 <!-- Alexander Lyon - make
sure that all the taiki-e/install-action calls use our env -->
* vercel/turborepo#8819 <!-- Tobias Koppers -
Refactor cell reading to handle removed cells -->
* vercel/turborepo#8038 <!-- Alexander Lyon - add
tags to turbo tasks -->
* vercel/turborepo#8807 <!-- Tobias Koppers - box
Scheduled task state to save memory -->
* vercel/turborepo#8170 <!-- Tobias Koppers - Drop
excessive cells after task reexecution -->
ForsakenHarmony pushed a commit to vercel/next.js that referenced this pull request Aug 15, 2024
* vercel/turborepo#8812 <!-- Benjamin Woodruff -
Simplify some of the syntax used with VcRead<T> -->
* vercel/turborepo#8823 <!-- hrmny -
feat(turbopack): support analysing string concatenation -->
* vercel/turborepo#8828 <!-- Tobias Koppers - change
from failsafe_analyse to failsafe_parse -->
* vercel/turborepo#8831 <!-- Alexander Lyon - make
sure that all the taiki-e/install-action calls use our env -->
* vercel/turborepo#8819 <!-- Tobias Koppers -
Refactor cell reading to handle removed cells -->
* vercel/turborepo#8038 <!-- Alexander Lyon - add
tags to turbo tasks -->
* vercel/turborepo#8807 <!-- Tobias Koppers - box
Scheduled task state to save memory -->
* vercel/turborepo#8170 <!-- Tobias Koppers - Drop
excessive cells after task reexecution -->
ForsakenHarmony pushed a commit to vercel/next.js that referenced this pull request Aug 16, 2024
* vercel/turborepo#8812 <!-- Benjamin Woodruff -
Simplify some of the syntax used with VcRead<T> -->
* vercel/turborepo#8823 <!-- hrmny -
feat(turbopack): support analysing string concatenation -->
* vercel/turborepo#8828 <!-- Tobias Koppers - change
from failsafe_analyse to failsafe_parse -->
* vercel/turborepo#8831 <!-- Alexander Lyon - make
sure that all the taiki-e/install-action calls use our env -->
* vercel/turborepo#8819 <!-- Tobias Koppers -
Refactor cell reading to handle removed cells -->
* vercel/turborepo#8038 <!-- Alexander Lyon - add
tags to turbo tasks -->
* vercel/turborepo#8807 <!-- Tobias Koppers - box
Scheduled task state to save memory -->
* vercel/turborepo#8170 <!-- Tobias Koppers - Drop
excessive cells after task reexecution -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants