Skip to content

Commit

Permalink
Updates configs/vit_i21k.py pydoc. (#61)
Browse files Browse the repository at this point in the history
  • Loading branch information
andsteing authored Nov 7, 2023
1 parent 9b32007 commit 5ef56fb
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion big_vision/configs/vit_i21k.py
Original file line number Diff line number Diff line change
Expand Up @@ -13,11 +13,14 @@
# limitations under the License.

# pylint: disable=line-too-long
r"""A config for pre-training BiT on ImageNet-21k.
r"""Pre-training ViT on ImageNet-21k as in https://arxiv.org/abs/2106.10270
This config relies on the Imagenet-21k tfds dataset, which is not yet
available publicly in TFDS. We intend to add the dataset to public TFDS soon,
and this config will then be runnable.
Note that regularization (dropout, stochastic depth) is not currently
implemented. This was not beneficial for ImageNet-21k pre-trainning.
"""

import big_vision.configs.common as bvcc
Expand Down

0 comments on commit 5ef56fb

Please sign in to comment.