Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-40697][SQL][FOLLOWUP] Read-side char padding should only be applied if necessary #38479

Closed
wants to merge 1 commit into from

Conversation

cloud-fan
Copy link
Contributor

What changes were proposed in this pull request?

This is a followup of #38151, to fix a perf issue. When struct/array/map doesn't contain char type field, we should not recreate the struct/array/map for nothing.

Why are the changes needed?

fix a perf issue

Does this PR introduce any user-facing change?

no

How was this patch tested?

new test

@cloud-fan
Copy link
Contributor Author

cc @yaooqinn @gengliangwang

@github-actions github-actions bot added the SQL label Nov 2, 2022
@gengliangwang
Copy link
Member

Thanks for fixing it. Merging to master

SandishKumarHN pushed a commit to SandishKumarHN/spark that referenced this pull request Dec 12, 2022
…plied if necessary

### What changes were proposed in this pull request?

This is a followup of apache#38151, to fix a perf issue. When struct/array/map doesn't contain char type field, we should not recreate the struct/array/map for nothing.

### Why are the changes needed?

fix a perf issue

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

new test

Closes apache#38479 from cloud-fan/char.

Authored-by: Wenchen Fan <wenchen@databricks.com>
Signed-off-by: Gengliang Wang <gengliang@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants