This repository contains some PyTorch benchmarks used to check performance of PyTorch on NERSC systems.
The SLURM batch scripts for running the benchmarks are in the scripts/ folder.
Benchmark configurations are in the configs/ folder.
Benchmark results can be found in Jupyter notebooks in the notebooks/ folder.
We compare benchmark throughput performance on Haswell for several software installations of PyTorch. The Intel-optimized PyTorch v1.0.0 tends to be the fasted on our Intel-based machines.
You can see the comparisons at notebooks/SoftwareAnalysis.ipynb
We compare benchmark throughput on Cori Haswell, KNL, and GPU.
You can see the comparisons at notebooks/HardwareAnalysis.ipynb
Here we look at throughput scaling on Cori Haswell with Intel-optimized PyTorch v1.0.0 using the native PyTorch distributed library and MPI backend.
You can see the results at notebooks/ScalingAnalysis.ipynb