Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-48927][CORE] Show the number of cached RDDs in StoragePage #47390

Closed
wants to merge 1 commit into from

Conversation

dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Jul 17, 2024

What changes were proposed in this pull request?

This PR aims to show the number of cached RDDs in StoragePage like the other Jobs page or Stages page.

Why are the changes needed?

To improve the UX by providing additional summary information in a consistent way.

BEFORE

Screenshot 2024-07-17 at 09 46 44

AFTER

Screenshot 2024-07-17 at 09 46 01

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manual review.

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-48927][CORE] Show the total number of cached RDDs in StoragePage [SPARK-48927][CORE] Show the number of cached RDDs in StoragePage Jul 17, 2024
@dongjoon-hyun
Copy link
Member Author

Could you review this PR, @huaxingao ?

@huaxingao
Copy link
Contributor

LGTM. Thanks @dongjoon-hyun

@dongjoon-hyun
Copy link
Member Author

Thank you, @huaxingao !

@dongjoon-hyun
Copy link
Member Author

Merged to master for Apache Spark 4.0.0-preview2.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-48927 branch July 17, 2024 19:54
miaoever pushed a commit to miaoever/spark that referenced this pull request Jul 17, 2024
### What changes were proposed in this pull request?

This PR aims to show the number of cached RDDs in `StoragePage` like the other `Jobs` page or `Stages` page.

### Why are the changes needed?

To improve the UX by providing additional summary information in a consistent way.

**BEFORE**

![Screenshot 2024-07-17 at 09 46 44](https://github.com/user-attachments/assets/3e57bf91-e97d-404d-aeda-159ab9cb65e3)

**AFTER**

![Screenshot 2024-07-17 at 09 46 01](https://github.com/user-attachments/assets/d416ea16-8255-48d8-ade4-624dcac8f46e)

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#47390 from dongjoon-hyun/SPARK-48927.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
jingz-db pushed a commit to jingz-db/spark that referenced this pull request Jul 22, 2024
### What changes were proposed in this pull request?

This PR aims to show the number of cached RDDs in `StoragePage` like the other `Jobs` page or `Stages` page.

### Why are the changes needed?

To improve the UX by providing additional summary information in a consistent way.

**BEFORE**

![Screenshot 2024-07-17 at 09 46 44](https://github.com/user-attachments/assets/3e57bf91-e97d-404d-aeda-159ab9cb65e3)

**AFTER**

![Screenshot 2024-07-17 at 09 46 01](https://github.com/user-attachments/assets/d416ea16-8255-48d8-ade4-624dcac8f46e)

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#47390 from dongjoon-hyun/SPARK-48927.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
szehon-ho pushed a commit to szehon-ho/spark that referenced this pull request Aug 7, 2024
### What changes were proposed in this pull request?

This PR aims to show the number of cached RDDs in `StoragePage` like the other `Jobs` page or `Stages` page.

### Why are the changes needed?

To improve the UX by providing additional summary information in a consistent way.

**BEFORE**

![Screenshot 2024-07-17 at 09 46 44](https://github.com/user-attachments/assets/3e57bf91-e97d-404d-aeda-159ab9cb65e3)

**AFTER**

![Screenshot 2024-07-17 at 09 46 01](https://github.com/user-attachments/assets/d416ea16-8255-48d8-ade4-624dcac8f46e)

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#47390 from dongjoon-hyun/SPARK-48927.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
attilapiros pushed a commit to attilapiros/spark that referenced this pull request Oct 4, 2024
### What changes were proposed in this pull request?

This PR aims to show the number of cached RDDs in `StoragePage` like the other `Jobs` page or `Stages` page.

### Why are the changes needed?

To improve the UX by providing additional summary information in a consistent way.

**BEFORE**

![Screenshot 2024-07-17 at 09 46 44](https://github.com/user-attachments/assets/3e57bf91-e97d-404d-aeda-159ab9cb65e3)

**AFTER**

![Screenshot 2024-07-17 at 09 46 01](https://github.com/user-attachments/assets/d416ea16-8255-48d8-ade4-624dcac8f46e)

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#47390 from dongjoon-hyun/SPARK-48927.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
himadripal pushed a commit to himadripal/spark that referenced this pull request Oct 19, 2024
### What changes were proposed in this pull request?

This PR aims to show the number of cached RDDs in `StoragePage` like the other `Jobs` page or `Stages` page.

### Why are the changes needed?

To improve the UX by providing additional summary information in a consistent way.

**BEFORE**

![Screenshot 2024-07-17 at 09 46 44](https://github.com/user-attachments/assets/3e57bf91-e97d-404d-aeda-159ab9cb65e3)

**AFTER**

![Screenshot 2024-07-17 at 09 46 01](https://github.com/user-attachments/assets/d416ea16-8255-48d8-ade4-624dcac8f46e)

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#47390 from dongjoon-hyun/SPARK-48927.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants