21.06
Commit used by the 21.06 TensorRT NGC container
Changelog
Added
- Add switch for batch-agnostic mode in NMS plugin
- Add missing model.py in
uff_custom_plugin
sample
Changed
- Update to Polygraphy v0.29.2
- Update to ONNX-GraphSurgeon v0.3.9
- Fix numerical errors for float type in NMS/batchedNMS plugins
- Update demoBERT input dimensions to match Triton requirement #1051
- Optimize TLT MaskRCNN plugins:
- enable fp16 precision in multilevelCropAndResizePlugin and multilevelProposeROIPlugin
- Algorithms optimization for NMS kernels and ROIAlign kernel
- Fix invalid cuda config issue when bs is larger than 32
- Fix issues found on Jetson NANO
Removed
- Removed fcplugin from demoBERT to improve inference latency on GA100/Turing