Skip to content

Commit

Permalink
Update Katib document to describe algorithms and suggestions (#1907)
Browse files Browse the repository at this point in the history
  • Loading branch information
c-bata authored Jun 9, 2020
1 parent 8771e91 commit 65caeca
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 6 deletions.
11 changes: 6 additions & 5 deletions content/en/docs/components/hyperparameter-tuning/experiment.md
Original file line number Diff line number Diff line change
Expand Up @@ -155,7 +155,7 @@ descriptions on this page:
* [Random search](#random-search)
* [Bayesian optimization](#bayesian)
* [HYPERBAND](#hyperband)
* [Hyperopt TPE](#tpe-search)
* [Tree of Parzen Estimators (TPE)](#tpe-search)
* [NAS based on reinforcement learning](#nas)

More algorithms are under development. You can add an algorithm to Katib
Expand Down Expand Up @@ -188,7 +188,8 @@ sampling without replacement. Random search is therefore the best algorithm to
use when combinatorial exploration is not possible. If the number of continuous
variables is high, you should use quasi random sampling instead.

Katib uses the [hyperopt](http://hyperopt.github.io/hyperopt/) optimization
Katib uses the [hyperopt](http://hyperopt.github.io/hyperopt/) or
[Goptuna](https://github.com/c-bata/goptuna) optimization
framework for its random search.

Katib supports the following algorithm settings:
Expand Down Expand Up @@ -310,13 +311,13 @@ thus for maximizing the number of configurations that it can evaluate.
HYPERBAND also focuses on the speed of the search.

<a id="tpe-search"></a>
#### Hyperopt TPE
#### Tree of Parzen Estimators (TPE)

The algorithm name in Katib is `tpe`.

Katib uses the Tree of Parzen Estimators (TPE) algorithm in
[hyperopt](http://hyperopt.github.io/hyperopt/). This method provides a
[forward and reverse gradient-based](https://arxiv.org/pdf/1703.01785.pdf)
[hyperopt](http://hyperopt.github.io/hyperopt/) or [goptuna](https://github.com/c-bata/goptuna).
This method provides a [forward and reverse gradient-based](https://arxiv.org/pdf/1703.01785.pdf)
search.

<a id="nas"></a>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -114,7 +114,13 @@ All of these settings except **`image`** can be omitted. If you don't specify an

1. `image` - Docker image name for the `random` suggestion.

**Must be specified**.
**Must be specified**. You can specify one of the following images:

- `suggestion-chocolate`: [chocolate](https://github.com/AIworx-Labs/chocolate) based suggestion service which supports `grid`, `chocolate-random`, `chocolate-quasirandom`, `chocolate-bayesian-optimization` and `chocolate-mocmaes`.
- `suggestion-goptuna`: [Goptuna](https://github.com/c-bata/goptuna) based suggestion service which supports `cmaes`, `tpe` and `random`.
- `suggestion-hyperband`: [HpBandSter](https://github.com/automl/HpBandSter) based suggestion service which supports `hyperband`.
- `suggestion-hyperopt`: [hyperopt](https://github.com/hyperopt/hyperopt) based suggestion service which supports `tpe` and `random`.
- `suggestion-skopt`: [scikit-optimize](https://github.com/scikit-optimize/scikit-optimize) based suggestion service which supports `bayesianoptimization`.

1. `imagePullPolicy` - `Random` suggestion container [image pull policy](https://kubernetes.io/docs/concepts/configuration/overview/#container-images).

Expand Down

0 comments on commit 65caeca

Please sign in to comment.