Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tutorial for Robust Gaussian Processes via Relevance Pursuit #2707

Closed
wants to merge 1 commit into from

Conversation

SebastianAment
Copy link
Contributor

@SebastianAment SebastianAment commented Jan 28, 2025

Summary: This commit adds a tutorial of the robust Relevance Pursuit model, specifically using the RobustRelevancePursuitSingleTaskGP and the Twitter flash crash examples, as well as a synthetic regression example that showcases both usage patterns, as well as ways of analyzing the results of the model.

Twitter Flash Crash

Screenshot 2025-01-29 at 1 18 10 PM Screenshot 2025-01-29 at 1 18 24 PM

Synthetic Example

Screenshot 2025-01-29 at 1 19 01 PM Screenshot 2025-01-29 at 1 19 10 PM Screenshot 2025-01-29 at 1 19 22 PM

Differential Revision: D68353581

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Jan 28, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D68353581

Copy link

codecov bot commented Jan 28, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 99.98%. Comparing base (f463b52) to head (df3c714).
Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2707   +/-   ##
=======================================
  Coverage   99.98%   99.98%           
=======================================
  Files         202      202           
  Lines       18602    18602           
=======================================
  Hits        18600    18600           
  Misses          2        2           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@facebook-github-bot
Copy link
Contributor

@SebastianAment has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

1 similar comment
@facebook-github-bot
Copy link
Contributor

@SebastianAment has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

SebastianAment added a commit to SebastianAment/botorch that referenced this pull request Jan 29, 2025
…#2707)

Summary:
This commit adds a tutorial of the robust Relevance Pursuit model, specifically using the `RobustRelevancePursuitSingleTaskGP` and the Twitter flash crash examples, as well as a synthetic regression example that showcases both usage patterns, as well as ways of analyzing the results of the model.


Test Plan:
Ran the tutorial on an internal devserver, my local machine, and the smoke test passes in the [OSS test](https://github.com/pytorch/botorch/actions/runs/13021130751/job/36321841195?pr=2707):

```
Running tutorial relevance_pursuit_robust_regression.ipynb.
Running tutorial relevance_pursuit_robust_regression.ipynb took 7.77 seconds. Memory usage started at 47.5 MB and the maximum was 798.1875 MB.
```

## Twitter Flash Crash Example
{F1974794186}{F1974794179}

Reviewed By: Balandat

Differential Revision: D68353581

Pulled By: SebastianAment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D68353581

SebastianAment added a commit to SebastianAment/botorch that referenced this pull request Jan 29, 2025
…#2707)

Summary:
This commit adds a tutorial of the robust Relevance Pursuit model, specifically using the `RobustRelevancePursuitSingleTaskGP` and the Twitter flash crash examples, as well as a synthetic regression example that showcases both usage patterns, as well as ways of analyzing the results of the model.


Test Plan:
Ran the tutorial on an internal devserver, my local machine, and the smoke test passes in the [OSS test](https://github.com/pytorch/botorch/actions/runs/13021130751/job/36321841195?pr=2707):

```
Running tutorial relevance_pursuit_robust_regression.ipynb.
Running tutorial relevance_pursuit_robust_regression.ipynb took 7.77 seconds. Memory usage started at 47.5 MB and the maximum was 798.1875 MB.
```

## Twitter Flash Crash Example
{F1974794186}{F1974794179}

Reviewed By: Balandat

Differential Revision: D68353581

Pulled By: SebastianAment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D68353581

SebastianAment added a commit to SebastianAment/botorch that referenced this pull request Jan 29, 2025
…#2707)

Summary:
This commit adds a tutorial of the robust Relevance Pursuit model, specifically using the `RobustRelevancePursuitSingleTaskGP` and the Twitter flash crash examples, as well as a synthetic regression example that showcases both usage patterns, as well as ways of analyzing the results of the model.


Test Plan:
Ran the tutorial on an internal devserver, my local machine, and the smoke test passes in the [OSS test](https://github.com/pytorch/botorch/actions/runs/13021130751/job/36321841195?pr=2707):

```
Running tutorial relevance_pursuit_robust_regression.ipynb.
Running tutorial relevance_pursuit_robust_regression.ipynb took 7.77 seconds. Memory usage started at 47.5 MB and the maximum was 798.1875 MB.
```

## Twitter Flash Crash Example
{F1974794186}{F1974794179}

Reviewed By: Balandat

Differential Revision: D68353581

Pulled By: SebastianAment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D68353581

@facebook-github-bot
Copy link
Contributor

@SebastianAment has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

SebastianAment added a commit to SebastianAment/botorch that referenced this pull request Jan 29, 2025
…#2707)

Summary:
This commit adds a tutorial of the robust Relevance Pursuit model, specifically using the `RobustRelevancePursuitSingleTaskGP` and the Twitter flash crash examples, as well as a synthetic regression example that showcases both usage patterns, as well as ways of analyzing the results of the model.

## Twitter Flash Crash

<img width="1007" alt="Screenshot 2025-01-29 at 1 18 10 PM" src="https://github.com/user-attachments/assets/da292e69-eb67-4f49-b6c1-cfc1583a057a" />
<img width="1009" alt="Screenshot 2025-01-29 at 1 18 24 PM" src="https://github.com/user-attachments/assets/da3b578d-18e6-4889-ba4c-34828a152cc1" />

## Synthetic Example

<img width="990" alt="Screenshot 2025-01-29 at 1 19 01 PM" src="https://github.com/user-attachments/assets/cacb09ca-d2e3-448d-9715-bfc70fc6a41a" />
<img width="1010" alt="Screenshot 2025-01-29 at 1 19 10 PM" src="https://github.com/user-attachments/assets/020596cb-096d-4923-b405-93433f95bbf2" />
<img width="1000" alt="Screenshot 2025-01-29 at 1 19 22 PM" src="https://github.com/user-attachments/assets/0f968610-c2b2-421f-9dc6-16aebf68024d" />


Reviewed By: Balandat

Differential Revision: D68353581

Pulled By: SebastianAment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D68353581

…#2707)

Summary:
This commit adds a tutorial of the robust Relevance Pursuit model, specifically using the `RobustRelevancePursuitSingleTaskGP` and the Twitter flash crash examples, as well as a synthetic regression example that showcases both usage patterns, as well as ways of analyzing the results of the model.

## Twitter Flash Crash

<img width="1007" alt="Screenshot 2025-01-29 at 1 18 10 PM" src="https://github.com/user-attachments/assets/da292e69-eb67-4f49-b6c1-cfc1583a057a" />
<img width="1009" alt="Screenshot 2025-01-29 at 1 18 24 PM" src="https://github.com/user-attachments/assets/da3b578d-18e6-4889-ba4c-34828a152cc1" />

## Synthetic Example

<img width="990" alt="Screenshot 2025-01-29 at 1 19 01 PM" src="https://github.com/user-attachments/assets/cacb09ca-d2e3-448d-9715-bfc70fc6a41a" />
<img width="1010" alt="Screenshot 2025-01-29 at 1 19 10 PM" src="https://github.com/user-attachments/assets/020596cb-096d-4923-b405-93433f95bbf2" />
<img width="1000" alt="Screenshot 2025-01-29 at 1 19 22 PM" src="https://github.com/user-attachments/assets/0f968610-c2b2-421f-9dc6-16aebf68024d" />


Reviewed By: Balandat

Differential Revision: D68353581

Pulled By: SebastianAment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D68353581

@facebook-github-bot
Copy link
Contributor

@SebastianAment merged this pull request in 472de87.

@SebastianAment
Copy link
Contributor Author

@jduerholt in case you are still interested in trying the robust model out for your use case: this tutorial shows how to use the robust model in a very similar way to a canonical SingleTaskGP - same model API and optimization calls. Feel free to reach out if you have thoughts or questions about it!

@jduerholt
Copy link
Contributor

@SebastianAment: I assume you mean this one: #2707 (comment)

Honestly, this is exactly what I was waiting for, as I was looking to the raw implementation and it was not fully clear to me how to actually use it (without investing more time into it). Based on this tutorial, it is super easy to implement it into our workflows. Thank you very much!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants