Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

[NSE-254] remove arrow-data-source-common from jar with dependency #453

Merged
merged 1 commit into from
Aug 6, 2021

Conversation

zhouyuan
Copy link
Collaborator

@zhouyuan zhouyuan commented Aug 6, 2021

What changes were proposed in this pull request?

native sql engine is bundled with arrow data source now so
it should be safe to assume those dataset related class will
be 'pre-loaded'

with this fix the jar size is ~97MB(was ~147MB) on my local env

Signed-off-by: Yuan Zhou yuan.zhou@intel.com

How was this patch tested?

locally verified

native sql engine is bundled with arrow data source now so
it should be safe to assume those dataset related class will
be 'pre-loaded'

with this fix the jar size is ~97MB(was ~147MB) on my local env

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
@github-actions
Copy link

github-actions bot commented Aug 6, 2021

#254

@zhouyuan
Copy link
Collaborator Author

zhouyuan commented Aug 6, 2021

@weiting-chen please take a look

@weiting-chen weiting-chen self-requested a review August 6, 2021 03:23
@weiting-chen
Copy link
Collaborator

Looks good to me.

@weiting-chen
Copy link
Collaborator

BTW, have you tried any queries and pass the testing?

@zhouyuan
Copy link
Collaborator Author

zhouyuan commented Aug 6, 2021

@weiting-chen
yes jenkins passed TPC-DS test.
note we should be able to remove more arrow related classes in native sql dependency jar as those are also included in data source jar package. eventually we may just package them into one jar.

@weiting-chen weiting-chen merged commit b8aa398 into oap-project:master Aug 6, 2021
zhouyuan added a commit to zhouyuan/native-sql-engine that referenced this pull request Aug 8, 2021
…#453)

native sql engine is bundled with arrow data source now so
it should be safe to assume those dataset related class will
be 'pre-loaded'

with this fix the jar size is ~97MB(was ~147MB) on my local env

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
zhouyuan added a commit that referenced this pull request Aug 9, 2021
* [NSE-254]Fix redundant arrow library issue. (#452)

* [NSE-254]Fix redundant arrow library issue.

* remote the unneccessary marked code

* remove arrow-data-source-common from jar with dependency (#453)

native sql engine is bundled with arrow data source now so
it should be safe to assume those dataset related class will
be 'pre-loaded'

with this fix the jar size is ~97MB(was ~147MB) on my local env

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

Co-authored-by: Wei-Ting Chen <weiting.chen@intel.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants