Update dependency deepspeed to v0.15.2 - autoclosed

[renovate-bot]

This PR contains the following updates:

Package	Change	Age	Adoption	Passing	Confidence
deepspeed (source)	==0.9.5 -> ==0.15.2

---

Release Notes

microsoft/DeepSpeed (deepspeed)

v0.15.2: Patch Release

Compare Source

What's Changed

• Update version.txt after 0.15.1 release by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6493
• HPU: add required ENV vars to acccelerator init by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/6495
• Op_builder->is_compatible quite warning by @​terry-for-github in https://github.com/microsoft/DeepSpeed/pull/6093
• fix pipeline eval_batch micro_batches argument for schedule by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/6484
• Fix the broken url link by @​rogerxfeng8 in https://github.com/microsoft/DeepSpeed/pull/6500
• fix environment variable export bug for MultiNodeRunner by @​TideDra in https://github.com/microsoft/DeepSpeed/pull/5878
• Revert "BF16 optimizer: Clear lp grads after updating hp grads in hook" by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/6508
• wrap include cuda_bf16.h with ifdef BF16_AVAILABLE by @​oelayan7 in https://github.com/microsoft/DeepSpeed/pull/6520
• Avoid security issues of subprocess shell by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/6498
• Add conditional on torch version for scaled_dot_product_attention by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6517
• Added Intel Gaudi to Accelerator Setup Guide by @​ShifaAbu in https://github.com/microsoft/DeepSpeed/pull/6543
• Skip failing newly added tests in accelerate by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6574
• Use msgpack for p2p comm by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/6547
• DeepNVMe perf tuning by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/6560
• [Accelerator] Cambricon MLU support by @​Andy666G in https://github.com/microsoft/DeepSpeed/pull/6472
• Fix gradient accumulation for Z2+offload by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/6550
• fix errors when setting zero3 leaf modules with torch.compile by @​NirSonnenschein in https://github.com/microsoft/DeepSpeed/pull/6564
• [XPU] Support DeepNVMe new code structure by @​Liangliang-Ma in https://github.com/microsoft/DeepSpeed/pull/6532
• Add APIs to offload states of model, optimizer, and engine by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/6011
• add bfloat16 to inference support dtypes by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/6528
• [COMPILE] workflow for deepspeed + torch.compile by @​YizhouZ in https://github.com/microsoft/DeepSpeed/pull/6570
• Fixes on the accelerate side mean we do not need to skip this test by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6583
• Fix torch include in op_builder/mlu/fused_adam.py and update no-torch workflow triggers by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6584
• [ROCm] Fix subprocess error by @​jagadish-amd in https://github.com/microsoft/DeepSpeed/pull/6587
• Cleanup CODEOWNERS file to be valid by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6603
• Add SSF Best practices badge by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6604
• Move V100 workflows from cuda 11.1/11.7 to 12.1 by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6607
• Fix SD workflow by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6609
• Pin accelerate to fix CI failures/issues by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6610
• Add llama3.2 vision autotp by @​Yejing-Lai in https://github.com/microsoft/DeepSpeed/pull/6577
• Improve DS logging control by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/6602
• Fix device selection using CUDA_VISIBLE_DEVICES by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/6530
• Handle when backend is also in compile_kwargs by @​oraluben in https://github.com/microsoft/DeepSpeed/pull/6502
• Rearrange inference OPS and stop using builder.load by @​oelayan7 in https://github.com/microsoft/DeepSpeed/pull/5490
• Unpin accelerate tests, update lightning with node16 removal. by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6611
• Enabled Qwen2-MoE Tensor Parallelism (TP) inference by @​gyou2021 in https://github.com/microsoft/DeepSpeed/pull/6551

New Contributors

• @​TideDra made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5878
• @​ShifaAbu made their first contribution in https://github.com/microsoft/DeepSpeed/pull/6543
• @​jagadish-amd made their first contribution in https://github.com/microsoft/DeepSpeed/pull/6587
• @​gyou2021 made their first contribution in https://github.com/microsoft/DeepSpeed/pull/6551

Full Changelog: microsoft/DeepSpeed@v0.15.1...v0.15.2

v0.15.1: Patch release

Compare Source

What's Changed

• Update version.txt after 0.15.0 release by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6403
• Fix Type Mismatch by @​jomayeri in https://github.com/microsoft/DeepSpeed/pull/6410
• Fix redundant seq data parallel grp argument in Z3/MiCS by @​samadejacobs in https://github.com/microsoft/DeepSpeed/pull/5352
• add Huawei Ascend NPU setup guide by @​xuedinge233 in https://github.com/microsoft/DeepSpeed/pull/6445
• Add documentation for launcher without SSH by @​dogacancolak-kensho in https://github.com/microsoft/DeepSpeed/pull/6455
• Dtype support check for accelerator in UTs by @​raza-sikander in https://github.com/microsoft/DeepSpeed/pull/6360
• Store/Load CIFAR from local/offline by @​raza-sikander in https://github.com/microsoft/DeepSpeed/pull/6390
• Add the accelerator setup guide link in Getting Started page by @​rogerxfeng8 in https://github.com/microsoft/DeepSpeed/pull/6452
• Allow triton==3.0.x for fp_quantizer by @​siddartha-RE in https://github.com/microsoft/DeepSpeed/pull/6447
• Change GDS to 1 AIO thread by @​jomayeri in https://github.com/microsoft/DeepSpeed/pull/6459
• [CCL] fix condition issue in ccl.py by @​YizhouZ in https://github.com/microsoft/DeepSpeed/pull/6443
• Avoid gds build errors on ROCm by @​rraminen in https://github.com/microsoft/DeepSpeed/pull/6456
• TestLowCpuMemUsage UT get device by device_name by @​raza-sikander in https://github.com/microsoft/DeepSpeed/pull/6397
• Add workflow to build DS without torch to better test before releases by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6450
• Fix patch for parameter partitioning in zero.Init() by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/6388
• Add default value to "checkpoint_folder" in "load_state_dict" of bf16_optimizer by @​ljcc0930 in https://github.com/microsoft/DeepSpeed/pull/6446
• DeepNVMe tutorial by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/6449
• bf16_optimizer: fixes to different grad acc dtype by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/6485
• print warning if actual triton cache dir is on NFS, not just for default by @​jrandall in https://github.com/microsoft/DeepSpeed/pull/6487
• DS_BUILD_OPS should build only compatible ops by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/6489
• Safe usage of popen by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/6490
• Handle an edge case where CUDA_HOME is not defined on ROCm systems by @​amorehead in https://github.com/microsoft/DeepSpeed/pull/6488

New Contributors

• @​xuedinge233 made their first contribution in https://github.com/microsoft/DeepSpeed/pull/6445
• @​siddartha-RE made their first contribution in https://github.com/microsoft/DeepSpeed/pull/6447
• @​ljcc0930 made their first contribution in https://github.com/microsoft/DeepSpeed/pull/6446
• @​jrandall made their first contribution in https://github.com/microsoft/DeepSpeed/pull/6487
• @​amorehead made their first contribution in https://github.com/microsoft/DeepSpeed/pull/6488

Full Changelog: microsoft/DeepSpeed@v0.15.0...v0.15.1

v0.15.0: DeepSpeed v0.15.0

Compare Source

What's Changed

• Update version.txt after 0.14.5 release by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5982
• move pynvml install to setup.py by @​Rohan138 in https://github.com/microsoft/DeepSpeed/pull/5840
• add moe topk(k>2) gate support by @​inkcherry in https://github.com/microsoft/DeepSpeed/pull/5881
• Move inf_or_nan_tracker to cpu for cpu offload by @​BacharL in https://github.com/microsoft/DeepSpeed/pull/5826
• Enable dynamic shapes for pipeline parallel engine inputs by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/5481
• Add and Remove ZeRO 3 Hooks by @​jomayeri in https://github.com/microsoft/DeepSpeed/pull/5658
• DeepNVMe GDS by @​jomayeri in https://github.com/microsoft/DeepSpeed/pull/5852
• Pin transformers version on nv-nightly by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6002
• DeepSpeed on Window blog by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/6364
• Bug Fix 5880 by @​jomayeri in https://github.com/microsoft/DeepSpeed/pull/6378
• Update linear.py compatible with torch 2.4.0 by @​terry-for-github in https://github.com/microsoft/DeepSpeed/pull/5811
• GDS Swapping Fix by @​jomayeri in https://github.com/microsoft/DeepSpeed/pull/6386
• Long sequence parallelism (Ulysses) integration with HuggingFace by @​samadejacobs in https://github.com/microsoft/DeepSpeed/pull/5774
• reduce cpu host overhead when using moe by @​ranzhejiang in https://github.com/microsoft/DeepSpeed/pull/5578
• fix fp16 Qwen2 series model to DeepSpeed-FastGen by @​ZonePG in https://github.com/microsoft/DeepSpeed/pull/6028
• Add Japanese translation of Windows support blog by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/6394
• Correct op_builder path to xpu files for trigger XPU tests by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6398
• add pip install cutlass version check by @​GuanhuaWang in https://github.com/microsoft/DeepSpeed/pull/6393
• [XPU] API align with new intel pytorch extension release by @​YizhouZ in https://github.com/microsoft/DeepSpeed/pull/6395
• Pydantic v2 migration by @​mrwyattii in https://github.com/microsoft/DeepSpeed/pull/5167
• Fix torch check by @​loadams in https://github.com/microsoft/DeepSpeed/pull/6402

New Contributors

• @​Rohan138 made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5840
• @​terry-for-github made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5811
• @​ranzhejiang made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5578

Full Changelog: microsoft/DeepSpeed@v0.14.5...v0.15.0

v0.14.5: Patch release

Compare Source

What's Changed

• Update version.txt after 0.14.4 release by @​mrwyattii in https://github.com/microsoft/DeepSpeed/pull/5694
• Fixed Windows inference build. by @​costin-eseanu in https://github.com/microsoft/DeepSpeed/pull/5609
• Fix memory leak from _hp_mapping by @​chiragjn in https://github.com/microsoft/DeepSpeed/pull/5643
• Bug fix for the "Link bit16 and fp32 parameters in partition" by @​U-rara in https://github.com/microsoft/DeepSpeed/pull/5681
• [CPU] add fp16 support to shm inference_all_reduce by @​delock in https://github.com/microsoft/DeepSpeed/pull/5669
• Universal checkpoint for zero stage 3 by @​xylian86 in https://github.com/microsoft/DeepSpeed/pull/5475
• inference unit test injectionPolicy split world_size to multiple tests by @​oelayan7 in https://github.com/microsoft/DeepSpeed/pull/5687
• ENV var added for recaching in INF Unit tests by @​raza-sikander in https://github.com/microsoft/DeepSpeed/pull/5688
• Disable nvtx decorator to avoid graph break by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/5697
• Add an argument to enable the injection of missing state during the conversion of universal checkpoints by @​xylian86 in https://github.com/microsoft/DeepSpeed/pull/5608
• Change source of CPUAdam for xpu accelerator by @​Liangliang-Ma in https://github.com/microsoft/DeepSpeed/pull/5703
• Add additional paths to trigger xpu tests by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5707
• Update XPU docker version by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5712
• update xpu fusedadam opbuilder for pytorch 2.3 by @​baodii in https://github.com/microsoft/DeepSpeed/pull/5702
• DeepSpeed Universal Checkpointing: Blog and Tutorial by @​samadejacobs in https://github.com/microsoft/DeepSpeed/pull/5711
• UCP Chinese Blog by @​HeyangQin in https://github.com/microsoft/DeepSpeed/pull/5713
• Fix tutorial links by @​samadejacobs in https://github.com/microsoft/DeepSpeed/pull/5714
• Update node16 check on self-hosted runners and remove python 3.6 by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5756
• fix the missing argument in test and typo by @​xylian86 in https://github.com/microsoft/DeepSpeed/pull/5730
• [INF] Enable torch compile for inference by @​oelayan7 in https://github.com/microsoft/DeepSpeed/pull/5612
• Update checkout action for nv-human-eval workflow by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5757
• Add Windows scripts (deepspeed, ds_report). by @​costin-eseanu in https://github.com/microsoft/DeepSpeed/pull/5699
• Unit Test: Add error handling for rate limit exceeded in model list by @​HeyangQin in https://github.com/microsoft/DeepSpeed/pull/5715
• Fix memory leak for pipelined optimizer swapper by @​mauryaavinash95 in https://github.com/microsoft/DeepSpeed/pull/5700
• Remove duplicated variable by @​xu-song in https://github.com/microsoft/DeepSpeed/pull/5727
• Fix phi3 mini 128k load error by @​Yejing-Lai in https://github.com/microsoft/DeepSpeed/pull/5765
• [CPU] Allow deepspeed.comm.inference_all_reduce in torch.compile graph by @​delock in https://github.com/microsoft/DeepSpeed/pull/5604
• Added wrappers for hpu tensors based on dtype by @​deepcharm in https://github.com/microsoft/DeepSpeed/pull/5771
• [bugfix] promote state in bf16_optimizer by @​billishyahao in https://github.com/microsoft/DeepSpeed/pull/5767
• Launcher mode with SSH bypass by @​dogacancolak-kensho in https://github.com/microsoft/DeepSpeed/pull/5728
• Update the list of supported models in the Chinese README of fastgen by @​beep-bebop in https://github.com/microsoft/DeepSpeed/pull/5773
• Add support for Microsoft Phi-3 model to DeepSpeed-FastGen by @​adk9 in https://github.com/microsoft/DeepSpeed/pull/5559
• Misplaced global variable warned by @​anferico in https://github.com/microsoft/DeepSpeed/pull/5725
• Fixes for latest Huggingface_hub changes on modelId -> id by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5789
• reduce all-to-all communication volume when both expert and non-expert are tensor-parallel by @​taozhiwei in https://github.com/microsoft/DeepSpeed/pull/5626
• Update Ubuntu version for running python tests by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5783
• fix: quantization with DeepSpeed HE by @​Atry in https://github.com/microsoft/DeepSpeed/pull/5624
• [INF] Add Qwen2RMSNorm to loaded layers in auto_tp by @​oelayan7 in https://github.com/microsoft/DeepSpeed/pull/5786
• Add chatglm2 & chatglm3 autotp by @​Yejing-Lai in https://github.com/microsoft/DeepSpeed/pull/5540
• Add new autotp supported model in doc by @​Yejing-Lai in https://github.com/microsoft/DeepSpeed/pull/5785
• Fix accuracy error of NPUFusedAdam by @​penn513 in https://github.com/microsoft/DeepSpeed/pull/5777
• Update torch version in cpu-torch-latest and nv-torch-latest-v100 tests to 2.4 by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5797
• move is_checkpointable call reducing torch.compile Graph breaks by @​NirSonnenschein in https://github.com/microsoft/DeepSpeed/pull/5759
• Unpin transformers version by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5650
• Update other workflows to run on Ubuntu 22.04 by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5798
• [XPU]Use host time to replace xpu time when IPEX version slower than 2.5. by @​ys950902 in https://github.com/microsoft/DeepSpeed/pull/5796
• Update MII tests to pull correct torchvision by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5800
• Add fp8-fused gemm kernel by @​sfc-gh-reyazda in https://github.com/microsoft/DeepSpeed/pull/5764
• Add doc of compressed backend in Onebit optimizers by @​Liangliang-Ma in https://github.com/microsoft/DeepSpeed/pull/5782
• fix: handle exception when loading cache file in test_inference.py by @​HeyangQin in https://github.com/microsoft/DeepSpeed/pull/5802
• Pin transformers version for MII tests by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5807
• Fix op_builder for CUDA 12.5 by @​keshavkowshik in https://github.com/microsoft/DeepSpeed/pull/5806
• Find ROCm on Fedora by @​trixirt in https://github.com/microsoft/DeepSpeed/pull/5705
• Fix CPU Adam JIT compilation by @​lekurile in https://github.com/microsoft/DeepSpeed/pull/5780
• GDS AIO Blog by @​jomayeri in https://github.com/microsoft/DeepSpeed/pull/5817
• [ROCm] Get rocm version from /opt/rocm/.info/version by @​rraminen in https://github.com/microsoft/DeepSpeed/pull/5815
• sequence parallel with communication overlap by @​inkcherry in https://github.com/microsoft/DeepSpeed/pull/5691
• Update to ROCm6 by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5491
• Add fp16 support of Qwen1.5MoE models (A2.7B) to DeepSpeed-FastGen by @​ZonePG in https://github.com/microsoft/DeepSpeed/pull/5403
• Use accelerator to replace cuda in setup and runner by @​Andy666G in https://github.com/microsoft/DeepSpeed/pull/5769
• Link GDS blog to site by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/5820
• Non-reentrant checkpointing hook fix by @​ic-synth in https://github.com/microsoft/DeepSpeed/pull/5781
• Fix NV references by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/5821
• Fix docs building guide by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/5825
• Update clang-format version from 16 to 18. by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5839
• Add Japanese translation of DeepNVMe blog by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/5845
• Fix the bug of deepspeed sequence parallel working with batch size larger than 1 by @​YJHMITWEB in https://github.com/microsoft/DeepSpeed/pull/5823
• Upgrade HPU image to v1.16.2. by @​vshekhawat-hlab in https://github.com/microsoft/DeepSpeed/pull/5610
• OptimizedLinear updates by @​jeffra in https://github.com/microsoft/DeepSpeed/pull/5791
• Log operator warnings only in verbose mode by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/5917
• Use torch.nan_to_num replace numpy wrapper one by @​jinyouzhi in https://github.com/microsoft/DeepSpeed/pull/5877
• [Zero2] Reduce the unnecessary all-reduce when tensor size is 0. by @​ys950902 in https://github.com/microsoft/DeepSpeed/pull/5868
• Update container version for Gaudi2 CI by @​raza-sikander in https://github.com/microsoft/DeepSpeed/pull/5937
• Fix missing ds_id bug by @​tjruwase in https://github.com/microsoft/DeepSpeed/pull/5824
• Update LR scheduler configuration by @​xiyang-aads-lilly in https://github.com/microsoft/DeepSpeed/pull/5846
• HPUAccelerator: remove support in set_visible_devices_envs by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/5929
• Z3: optimizations for grad norm calculation and gradient clipping by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/5504
• Update xpu-max1100.yml with new config and add some tests by @​Liangliang-Ma in https://github.com/microsoft/DeepSpeed/pull/5668
• Add accelerator setup guides by @​delock in https://github.com/microsoft/DeepSpeed/pull/5827
• Allow accelerator to instantiate the device by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/5255

New Contributors

• @​U-rara made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5681
• @​xylian86 made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5475
• @​mauryaavinash95 made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5700
• @​billishyahao made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5767
• @​dogacancolak-kensho made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5728
• @​beep-bebop made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5773
• @​anferico made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5725
• @​Atry made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5624
• @​sfc-gh-reyazda made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5764
• @​keshavkowshik made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5806
• @​trixirt made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5705
• @​Andy666G made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5769
• @​ic-synth made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5781
• @​xiyang-aads-lilly made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5846

Full Changelog: microsoft/DeepSpeed@v0.14.4...v0.14.5

v0.14.4: Patch release

Compare Source

What's Changed

• Update version.txt after 0.14.3 release by @​mrwyattii in https://github.com/microsoft/DeepSpeed/pull/5651
• [CPU] SHM based allreduce improvement for small message size by @​delock in https://github.com/microsoft/DeepSpeed/pull/5571
• _exec_forward_pass: place zeros(1) on the same device as the param by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/5576
• [XPU] adapt lazy_call func to different versions by @​YizhouZ in https://github.com/microsoft/DeepSpeed/pull/5670
• fix IDEX dependence in xpu accelerator by @​Liangliang-Ma in https://github.com/microsoft/DeepSpeed/pull/5666
• Remove compile wrapper to simplify access to model attributes by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/5581
• Fix hpZ with zero element by @​samadejacobs in https://github.com/microsoft/DeepSpeed/pull/5652
• Fixing the reshape bug in sequence parallel alltoall, which corrupted all QKV data by @​YJHMITWEB in https://github.com/microsoft/DeepSpeed/pull/5664
• enable yuan autotp & add conv tp by @​Yejing-Lai in https://github.com/microsoft/DeepSpeed/pull/5428
• Fix latest pytorch '_get_socket_with_port' import error by @​Yejing-Lai in https://github.com/microsoft/DeepSpeed/pull/5654
• Fix numpy upgrade to 2.0.0 BUFSIZE import error by @​Yejing-Lai in https://github.com/microsoft/DeepSpeed/pull/5680
• Update BUFSIZE to come from autotuner's constants.py, not numpy by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5686
• [XPU] support op builder from intel_extension_for_pytorch kernel path by @​YizhouZ in https://github.com/microsoft/DeepSpeed/pull/5425

New Contributors

• @​YJHMITWEB made their first contribution in https://github.com/microsoft/DeepSpeed/pull/5664

Full Changelog: microsoft/DeepSpeed@v0.14.3...v0.14.4

v0.14.3: Patch release

Compare Source

What's Changed

• Update version.txt after 0.14.2 release by @​mrwyattii in https://github.com/microsoft/DeepSpeed/pull/5458
• Add getter and setter methods for compile_backend across accelerators. by @​vshekhawat-hlab in https://github.com/microsoft/DeepSpeed/pull/5299
• Fix torch.compile error for PyTorch v2.3 by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/5463
• Revert "stage3: efficient compute of scaled_global_grad_norm (#​5256)" by @​lekurile in https://github.com/microsoft/DeepSpeed/pull/5461
• Update ds-chat CI workflow paths to include zero stage 1-3 files by @​lekurile in https://github.com/microsoft/DeepSpeed/pull/5462
• Update with ops not supported on Windows by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5468
• fix: swapping order of parameters in create_dir_symlink method. by @​alvieirajr in https://github.com/microsoft/DeepSpeed/pull/5465
• Un-pin torch version in nv-torch-latest back to latest and skip test_compile_zero tests on v100 by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5459
• re-introduce: stage3: efficient compute of scaled_global_grad_norm by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/5493
• Fix crash when creating Torch tensor on NPU with device=get_accelerator().current_device() by @​harygo2 in https://github.com/microsoft/DeepSpeed/pull/5464
• Fix compile wrapper by @​BacharL in https://github.com/microsoft/DeepSpeed/pull/5455
• enable phi3_mini autotp by @​Yejing-Lai in https://github.com/microsoft/DeepSpeed/pull/5501
• Fused adam for HPU by @​BacharL in https://github.com/microsoft/DeepSpeed/pull/5500
• [manifest] update mainfest to add hpp file in csrc. by @​ys950902 in https://github.com/microsoft/DeepSpeed/pull/5522
• enable phi2 autotp by @​Yejing-Lai in https://github.com/microsoft/DeepSpeed/pull/5436
• Switch pynvml to nvidia-ml-py by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5529
• Switch from double quotes to match single quotes by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5530
• [manifest] update mainfest to add hpp file in deepspeed. by @​ys950902 in https://github.com/microsoft/DeepSpeed/pull/5533
• New integration - CometMonitor by @​alexkuzmik in https://github.com/microsoft/DeepSpeed/pull/5466
• Improve _configure_optimizer() final optimizer log by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/5528
• Enhance testing: Skip fused_optimizer tests if not supported. by @​vshekhawat-hlab in https://github.com/microsoft/DeepSpeed/pull/5159
• Skip the UT cases that use unimplemented op builders. by @​foin6 in https://github.com/microsoft/DeepSpeed/pull/5372
• rocblas -> hipblas changes for ROCm by @​rraminen in https://github.com/microsoft/DeepSpeed/pull/5401
• Rocm warp size fix by @​rraminen in https://github.com/microsoft/DeepSpeed/pull/5402
• CPUAdam fp16 and bf16 support by @​BacharL in https://github.com/microsoft/DeepSpeed/pull/5409
• Optimize zero3 fetch params using all_reduce by @​deepcharm in https://github.com/microsoft/DeepSpeed/pull/5420
• Fix the TypeError for XPU Accelerator by @​shiyang-weng in https://github.com/microsoft/DeepSpeed/pull/5531
• Fix RuntimeError for moe on XPU: tensors found at least two devices by @​shiyang-weng in https://github.com/microsoft/DeepSpeed/pull/5519
• Remove synchronize calls from allgather params by @​BacharL in https://github.com/microsoft/DeepSpeed/pull/5516
• Avoid overwrite of compiled module wrapper attributes by @​deepcharm in https://github.com/microsoft/DeepSpeed/pull/5549
• Small typos in functions set_none_gradients_to_zero by @​TravelLeraLone in https://github.com/microsoft/DeepSpeed/pull/5557
• Adapt doc for #​4405 by @​oraluben in https://github.com/microsoft/DeepSpeed/pull/5552
• Update to HF_HOME from TRANSFORMERS_CACHE by @​loadams in https://github.com/microsoft/DeepSpeed/pull/4816
• [INF] DSAttention allow input_mask to have false as value by @​oelayan7 in https://github.com/microsoft/DeepSpeed/pull/5546
• Add throughput timer configuration by @​deepcharm in https://github.com/microsoft/DeepSpeed/pull/5363
• Add Ulysses DistributedAttention compatibility by @​Kwen-Chen in https://github.com/microsoft/DeepSpeed/pull/5525
• Add hybrid_engine.py as path to trigger the DS-Chat GH workflow by @​lekurile in https://github.com/microsoft/DeepSpeed/pull/5562
• Update HPU docker version by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5566
• Rename files in fp_quantize op from quantize.* to fp_quantize.* by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5577
• [MiCS] Remove the handle print on DeepSpeed side by @​ys950902 in https://github.com/microsoft/DeepSpeed/pull/5574
• Update to fix sidebar over text by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5567
• DeepSpeedCheckpoint: support custom final ln idx by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/5506
• Update minor CUDA version compatibility by @​adk9 in https://github.com/microsoft/DeepSpeed/pull/5591
• Add slide deck for meetup in Japan by @​tohtana in https://github.com/microsoft/DeepSpeed/pull/5598
• Fixed the Windows build. by @​costin-eseanu in https://github.com/microsoft/DeepSpeed/pull/5596
• estimate_zero2_model_states_mem_needs: fixing memory estiamtion by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/5099
• Fix cuda hardcode for inference woq by @​Liangliang-Ma in https://github.com/microsoft/DeepSpeed/pull/5565
• fix sequence parallel(Ulysses) grad scale for zero0 by @​inkcherry in https://github.com/microsoft/DeepSpeed/pull/5555
• Add Compressedbackend for Onebit optimizers by @​Liangliang-Ma in https://github.com/microsoft/DeepSpeed/pull/5473
• Updated hpu-gaudi2 tests content. by @​vshekhawat-hlab in https://github.com/microsoft/DeepSpeed/pull/5622
• Pin transformers version for MII tests by @​loadams in https://github.com/microsoft/DeepSpeed/pull/5629
• WA for Torch-compile-Z3-act-apt accuracy issue from the Pytorch repo by @​NirSonnenschein in https://github.com/microsoft/DeepSpeed/pull/5590
• stage_1_and_2: optimize clip calculation to use clamp by @​nelyahu in https://github.com/microsoft/DeepSpeed/pull/5632
• Fix overlap communication of ZeRO stage 1 and 2 by @​penn513 in https://github.com/microsoft/DeepSpeed/pull/5606
• fixes in _partition_par

---

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

This PR was generated by Mend Renovate. View the repository job log.