Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

[NSE-17]TPCDS Q72 optimization #47

Merged
merged 7 commits into from
Jan 19, 2021

Conversation

xuechendi
Copy link
Collaborator

couple optimization has been made:

  1. if hash map key is unique, we will directly put its ArrayItemIndex in key map instead of link table,
  2. hashmap size will be predicted by its total size, so small input will only allocate small size hash table
  3. move hash calculation inside Get/IfExists function and add a cache their to fast fetch most recent probed key.
  4. switch smj left and right sequence upon its numOutputFields.
  5. skip is_null check in payload column
  6. fix a small issue in round function

verified with TPCDS_DPP_SF500_V1

Fixed: #17

@github-actions

This comment has been minimized.

@xuechendi xuechendi force-pushed the wip_hashmap_cache_and_optimize branch from 8c42768 to 27aba87 Compare January 18, 2021 13:27
@github-actions
Copy link

Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
@xuechendi xuechendi force-pushed the wip_hashmap_cache_and_optimize branch from 27aba87 to 9ff1829 Compare January 19, 2021 05:11
@xuechendi
Copy link
Collaborator Author

@zhouyuan, verified with TPCH sf500 as well, I think we can merge it.

@zhouyuan zhouyuan merged commit a9ae3d8 into oap-project:master Jan 19, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

ColumnarWSCG further optimization
2 participants