Neptune: Grid Search

Neptune lets you perform grid search very easily. All you need to do is to specify appropriate values in the neptune_config.yaml file.

Regular configuration:

# Training schedule
  epochs_nr: 1000
  batch_size_train: 128
  batch_size_inference: 128
  lr: 0.01
  momentum: 0.9
  gamma: 0.97
  patience: 10

Grid Search configuration:

# Training schedule
  epochs_nr: 1000
  batch_size_train:
    values: [64, 128]
  batch_size_inference: 128
  lr:
    values: [0.01, 0.001]
  momentum: 0.9
  gamma: 0.97
  patience: 10

Notice the difference in batch_size_train and lr.