Features & Improvements
New Features
- Vision Transformer backbone, see config in
configs/Market1501/bagtricks_vit.yml
- Self-Distillation with EMA update
- Gradient Clip
Improvements
- Faster dataloader with pre-fetch thread and cuda stream
- Impl
freezebackbone
function in step of optimizer - Optimize DDP training speed by removing
find_unused_parameters
in DDP