Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

record the reported shuffle fetch failure tasks #42

Merged
merged 1 commit into from
Dec 20, 2024
Merged

Conversation

turboFei
Copy link
Owner

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

@turboFei turboFei changed the title record record the reported shuffle fetch failure tasks Dec 20, 2024
@turboFei turboFei merged commit 1c22a21 into task_id Dec 20, 2024
@turboFei turboFei deleted the record_taskInfo branch December 20, 2024 08:07
turboFei added a commit that referenced this pull request Dec 24, 2024
task_id

Align the LOG

spark3 only

Spark 2 (#30)

ut (#31)

revert ut

Refine the check

ut (#33)

log

Ut for spark utils (#36)

comments

record the reported shuffle fetch failure tasks (#42)

nit

Address comments from mridul (#44)

* revert logger => LOG

* taskScheduler instance lock and stage uniq id

* docs

* listener

* spark 2

* comments

* test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant