Don't import torch.distributed when it's not available#35777