Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minor: Move hash utils to common #7684

Merged
merged 3 commits into from
Sep 29, 2023
Merged

Minor: Move hash utils to common #7684

merged 3 commits into from
Sep 29, 2023

Conversation

jayzhan211
Copy link
Contributor

Which issue does this PR close?

Closes #.

Rationale for this change

While working on #7629, I found create_hashes is placed to physical-expr.

Hash utils only import functions from arrow, std, and df-common. It seems it should be placed to df-common not physical-expr.

What changes are included in this PR?

We can have hash_utils from df-common.

Are these changes tested?

Nope, only import is modified, no need to add additional tests.

Are there any user-facing changes?

@github-actions github-actions bot added the physical-expr Physical Expressions label Sep 28, 2023
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @jayzhan211

I double checked and this change adds no new dependencies:
https://crates.io/crates/half/reverse_dependencies is already a dependency on arrow as is ahash: https://crates.io/crates/ahash/reverse_dependencies?page=3

@@ -28,7 +28,6 @@ pub mod equivalence;
pub mod execution_props;
pub mod expressions;
pub mod functions;
pub mod hash_utils;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is technically a breaking change if someone used hash_utils directly in their code.

Perhaps we could leave a pointer like

Suggested change
pub mod hash_utils;
// backwards compatibility
pub use datafusion_common::hash_util;

But I don't think that is critical

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
@jayzhan211
Copy link
Contributor Author

how to re-run CI without code changes?

@alamb
Copy link
Contributor

alamb commented Sep 29, 2023

how to re-run CI without code changes?

You can go to the job and click rerun:

https://github.com/apache/arrow-datafusion/actions/runs/6345797930/job/17238371168?pr=7684

Screenshot 2023-09-29 at 9 52 45 AM

@jayzhan211
Copy link
Contributor Author

Screenshot 2023-09-29 at 22 24 29
I dont have the option :(

@alamb
Copy link
Contributor

alamb commented Sep 29, 2023

I dont have the option :(

It must be related to permissions.

Another way to do so is to merge up from main (git merge apache/main) which I just did for this PR -- I'll plan to merge it once CI passes. Thank you

@alamb alamb merged commit 85f3578 into apache:main Sep 29, 2023
22 checks passed
Ted-Jiang pushed a commit to Ted-Jiang/arrow-datafusion that referenced this pull request Oct 7, 2023
* move hash utils to common

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>

* support backward compatibility

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>

---------

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
physical-expr Physical Expressions
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants