Discussions

• 1 You must be logged in to vote

  🤖

  DDP specifics: Single node function execution, test loss sync, num_workers, sync_batchnorm, precision

  ManiadisG asked Oct 27, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  1
• 1 You must be logged in to vote

  ⚡

  Does AccuracyMetric compute accumulated or mean values of each batch?

  xiadingZ asked Oct 26, 2020 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🤖

  Expectations for custom data parallel implementations

  ananthsub asked Sep 12, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  🤖

  why won't auto resubmit work?

  vr25 asked Sep 4, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  13
• 1 You must be logged in to vote

  ⚡

  Logging accuracy with batch accumulation

  sachinruk asked Aug 27, 2020 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🤖

  How to training on huge text dataset

  Limtle asked Oct 14, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ⚡

  Accuracy metric number of classes warning question

  Vichoko asked Oct 14, 2020 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🤖

  Test step with DDP

  david-waterworth asked Sep 24, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  3
• 1 You must be logged in to vote

  🤖

  replace_sampler_ddp + batch_sampler

  sshleifer asked Sep 11, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🤖

  Attribute is reset per batch in dp mode

  siahuat0727 asked Sep 1, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🤖

  extremely slow training with multiple GPUs

  pamparana34 asked Jun 3, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  

  

  4
• 0 You must be logged in to vote

  ⚡

  Correctly using IoU and ConfusionMatrix

  remisphere asked Jul 29, 2020 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  🤖

  Is Sync BatchNorm supported?

  nynyg asked Jul 5, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  8
• 1 You must be logged in to vote

  🤖

  How to get ddp working for custom collate functions

  edraizen asked Sep 9, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🤖

  Distributed Modes Speed Benchmark

  briankosw asked Sep 10, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  Multi-GPU "[LightningModule] object has no attribute [attribute]"

  andrewjong asked Aug 22, 2020 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  5
• 1 You must be logged in to vote

  🤖

  Multi-GPU Training GPU Usage

  zhenhuahu asked Jul 25, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  4
• 1 You must be logged in to vote

  🤖

  Does Pytorch-Lightning have a multiprocessing (or Joblib) module?

  leockl asked Jul 27, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  1
• 1 You must be logged in to vote

  🤖

  Custom Logger gather results for ddp?

  Data-drone asked May 26, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🤖

  What's the Correct Batch Size in Distributed Data Parallel Training?

  zhenhuahu asked Jul 24, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  2
• 1 You must be logged in to vote

  🤖

  version 0.7.6 is 2x faster than version 0.8.1

  ternaus asked Jun 19, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  🤖

  Multi-GPU when using Torchtext iterator for data loading

  aitor-garcia-p asked Sep 16, 2019 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  22
• 1 You must be logged in to vote

  🤖

  Bind a LightningModule to more than 1 GPU.

  lucadiliello asked Apr 14, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🤖

  Is it possible for SLURM auto submit to work on DP?

  philip30 asked Apr 11, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  3
• 1 You must be logged in to vote

  🤖

  How to use pytorch-lightning distributed training without SLURM?

  areshytko asked Apr 1, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  2