Skip to content

Release 3.2.0 corresponding to NGC container 20.07
Compare
Choose a tag to compare
@dzier dzier released this 30 Jul 16:15
v3.2.0
1670572

PyProf - PyTorch Profiler for GPUs

PyProf is a tool that profiles and analyzes the GPU performance of PyTorch models. PyProf aggregates kernel performance from Nsight Systems or NvProf. The tool can identify the layer that launched the kernel, identify the tensor dimensions and precision, perform forward-backward correlation, determine Tensor Core usage, and correlate the line in the user's code that launched a particular kernel.

What's New In 3.2.0

  • Monkey patch support for APEX, fused Adam, and Layer Norm functions

  • PyYAML requirement has been removed

  • Error handling for non-existent parse file arguments has been added

Known Issues

  • This software only supports PyTorch 1.6.

  • Forward-Backward kernel correlation heuristics do not work correctly with PyTorch 1.6. Recommended work arounds include:

    • Use with PyTorch 1.5
    • Use DLProf in the 20.078 NGC PyTorch container
    • Use the 20.03-py3 PyTorch NGC container
 $ docker pull nvcr.io/nvidia/pytorch:20.03-py3
Assets 2
Loading