Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: colsample by node #2315

Closed
BlindApe opened this issue Aug 7, 2019 · 2 comments
Closed

Feature request: colsample by node #2315

BlindApe opened this issue Aug 7, 2019 · 2 comments

Comments

@BlindApe
Copy link

BlindApe commented Aug 7, 2019

My experience with xgboost is adding colsample_bynode to colsample_bytree improves a lot the performance with high noise / low signal datasets.

Time ago, in #98 issue @guolinke said about the inclusion of colsample_bylevel:
#98 (comment)

Indeed I think the easiest way to do it is calculating the histogram as now (for all the features of the current tree) but then picking random a subset of features and only check the reduction for these features.

In this way the histogram computing will remains exactly as now and only a random selection of features is needed at node level.

@guolinke
Copy link
Collaborator

cool idea!

@StrikerRUS
Copy link
Collaborator

Closed via #2330.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants