Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve robustness in InteractionAnalysis #3407

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

mpolson64
Copy link
Contributor

Summary:
A number of features to improve reliablity of the InteractionAnalysis.

  • Hide OAK kernel behind a flag which defaults to False. When false, use the current GenerationNode's adapter
  • If ax_parameter_sens fails log an exception and fallback to the surrogate's feature_importances
  • Do not plot samples on the slice and countour plots if there are more than 50 samples (it gets too cluttered)
  • Changed the orange and blue colors on the importance bar chart to be in the plotly color scheme
  • Make plot not error out on unordered choice params
  • Improved subtitle

Differential Revision: D69993111

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Feb 21, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69993111

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 21, 2025
Summary:

A number of features to improve reliablity of the InteractionAnalysis.
* Hide OAK kernel behind a flag which defaults to False. When false, use the current GenerationNode's adapter
* If ax_parameter_sens fails log an exception and fallback to the surrogate's feature_importances
* Do not plot samples on the slice and countour plots if there are more than 50 samples (it gets too cluttered)
* Changed the orange and blue colors on the importance bar chart to be in the plotly color scheme
* Make plot not error out on unordered choice params
* Improved subtitle

Differential Revision: D69993111
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69993111

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 24, 2025
Summary:

A number of features to improve reliablity of the InteractionAnalysis.
* Hide OAK kernel behind a flag which defaults to False. When false, use the current GenerationNode's adapter
* If ax_parameter_sens fails log an exception and fallback to the surrogate's feature_importances
* Do not plot samples on the slice and countour plots if there are more than 50 samples (it gets too cluttered)
* Changed the orange and blue colors on the importance bar chart to be in the plotly color scheme
* Make plot not error out on unordered choice params
* Improved subtitle

Differential Revision: D69993111
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69993111

@codecov-commenter
Copy link

codecov-commenter commented Feb 24, 2025

Codecov Report

Attention: Patch coverage is 85.45455% with 8 lines in your changes missing coverage. Please review.

Project coverage is 95.97%. Comparing base (c64d122) to head (94f29ba).

Files with missing lines Patch % Lines
ax/analysis/plotly/interaction.py 61.90% 8 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3407      +/-   ##
==========================================
- Coverage   95.98%   95.97%   -0.02%     
==========================================
  Files         539      539              
  Lines       52791    52836      +45     
==========================================
+ Hits        50674    50711      +37     
- Misses       2117     2125       +8     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Summary: As titled. These are moderately useful here, but I really want to add them to the contour plot and I want the slice plot to match since theyre often displayed together.

Differential Revision: D69988707
Summary: As titled.

Differential Revision: D69989849
mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 24, 2025
Summary:

A number of features to improve reliablity of the InteractionAnalysis.
* Hide OAK kernel behind a flag which defaults to False. When false, use the current GenerationNode's adapter
* If ax_parameter_sens fails log an exception and fallback to the surrogate's feature_importances
* Do not plot samples on the slice and countour plots if there are more than 50 samples (it gets too cluttered)
* Changed the orange and blue colors on the importance bar chart to be in the plotly color scheme
* Make plot not error out on unordered choice params
* Improved subtitle

Differential Revision: D69993111
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69993111

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 24, 2025
Summary:

A number of features to improve reliablity of the InteractionAnalysis.
* Hide OAK kernel behind a flag which defaults to False. When false, use the current GenerationNode's adapter
* If ax_parameter_sens fails log an exception and fallback to the surrogate's feature_importances
* Do not plot samples on the slice and countour plots if there are more than 50 samples (it gets too cluttered)
* Changed the orange and blue colors on the importance bar chart to be in the plotly color scheme
* Make plot not error out on unordered choice params
* Improved subtitle

Differential Revision: D69993111
Summary:
Pull Request resolved: facebook#3407

A number of features to improve reliablity of the InteractionAnalysis.
* Hide OAK kernel behind a flag which defaults to False. When false, use the current GenerationNode's adapter
* If ax_parameter_sens fails log an exception and fallback to the surrogate's feature_importances
* Do not plot samples on the slice and countour plots if there are more than 50 samples (it gets too cluttered)
* Changed the orange and blue colors on the importance bar chart to be in the plotly color scheme
* Make plot not error out on unordered choice params
* Improved subtitle

Differential Revision: D69993111
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69993111

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants