v0.17.4 Patch Release

What's Changed

• Update version.txt after 0.17.3 release. by @loadams in #7455
• Fix: UnboundLocalError for variable 'dim' about issue by @weeknan in #7449
• adding TiledFusedLogitsLoss by @stas00 in #7437
• TiledFusedLogitsLoss bug fix by @stas00 in #7459

New Contributors

• @weeknan made their first contribution in #7449

Full Changelog: v0.17.3...v0.17.4

v0.17.3 Patch Release

What's Changed

• [TiledMLP]: fix for bs>1 by @stas00 in #7412
• Update version.txt after v0.17.2 release. by @loadams in #7417
• Enable torch version dependent compilation of record_module and iter_params by @deepcharm in #7362
• [BUGFIX] Reset bucket.elements after reduction in ZeRO Stage 3 by @rahul713rk in #7418
• Align missing argument in AllReduceCoalescedHandle by @deepcharm in #7414
• Improvements to Communication Logger by @alexk101 in #7404
• trying to fix nv-accelerate-v100.yml CI job by @stas00 in #7424
• fix: Propagate strip_tensor_paddings by @saforem2 in #7426
• Use past_key_value when provided by @deepcharm in #7428
• set device_id in torch's init_process_group by @stas00 in #7266
• [Ulysses-ALST] add FA3 support by @stas00 in #7430
• TiledMLP + SequenceTiledCompute: improve the bs>1 use-case by @stas00 in #7422
• Remove unused yaml test configurations and update README by @loadams in #7441
• [ALST] fix typo in the url by @stas00 in #7444
• [ALST] fix typo in the url part2 by @stas00 in #7446
• Remove additional unused tests (human-eval) by @loadams in #7445
• Fix: Adapt Llama injection policy for newer transformers versions by @huanyuqu in #7443

New Contributors

• @rahul713rk made their first contribution in #7418
• @huanyuqu made their first contribution in #7443

Full Changelog: v0.17.2...v0.17.3

v0.17.2 Patch Release

What's Changed

• Update version after 0.17.1 release by @loadams in #7345
• s/UlyssesPlus/Arctic Long Sequence Training (ALST)/ by @stas00 in #7348
• Don't break set_start_method by @tjruwase in #7349
• Fix error of <glog/logging.h> by @Freed-Wu in #7351
• Improve padding util for compile by @tohtana in #7355
• Fix 404s by @tjruwase in #7363
• Fix tutorial title by @stas00 in #7365
• Restore real inputs for recompilation by @tohtana in #7356
• Fix(scheduler): WarmupLR inherits optimizer lr when not specified by @Flink-ddd in #7360
• sequence parallel default dtype by @stas00 in #7364
• Enable torch.autocast with ZeRO by @tohtana in #6993
• add Arctic Long Sequence Training paper reference by @stas00 in #7372
• Flops profiler support for F.interpolate by @sfc-gh-truwase in #7353
• Relax tolerances for FP8 unit test only for ROCm + FP16 by @rraminen in #7373
• Update latest news with DeepNVMe by @loadams in #7375
• Fix release of IPG buffer by @tohtana in #7376
• fix wandb.log() call by removing sync kwarg by @ned2 in #7383
• Fix dtype mismatch in TestParamPartitioningSkipInit by @tohtana in #7377
• Add support for ws=1 scenario by @NirSonnenschein in #7379
• fix(inference): Add missing dtype attribute to ParameterBase setter by @Flink-ddd in #7378
• add blog link by @stas00 in #7385
• fix broken url by @stas00 in #7390
• add support for CUDAtk12.9 by @loscrossos in #7394
• Fix unbound local error for return_val by @HollowMan6 in #7395
• Fix ZeRO stage 1 and add stage 2 support with DeepCompile by @tohtana in #7366
• Improve coverage of DeepCompile by @tohtana in #7386
• Added device detection to communication logging by @alexk101 in #7398
• fix: Add csrc/compile to include paths for DeepCompile builder by @HollowMan6 in #7401
• fix: DeepCompile for torch 2.8 by @HollowMan6 in #7402
• fix(comm): Expose GradBucket in deepspeed.comm API by @Flink-ddd in #7400
• fix: fix FileNotFoundError for build_win.bat by @gjj2828 in #7399
• fix: engine initializes optimizer attributes at the beginning by @HollowMan6 in #7410

New Contributors

• @Freed-Wu made their first contribution in #7351
• @Flink-ddd made their first contribution in #7360
• @ned2 made their first contribution in #7383
• @alexk101 made their first contribution in #7398
• @gjj2828 made their first contribution in #7399

Full Changelog: v0.17.1...v0.17.2

v0.17.1 Patch Release

What's Changed

• Update version.txt after v0.17.0 release by @loadams in #7326
• Ulysses Plus Docs by @stas00 in #7331
• UlyssesPlus Docs take 2 by @stas00 in #7332
• Improve Ulysses Plus Docs by @cynricfu in #7335
• Update config_utils.py by @qgallouedec in #7333
• Fix pytest version to 8.3.5 in hpu-gaudi actions by @raza-sikander in #7337
• Fix issue with symint input by @tohtana in #7243
• fp16 optimizer timers fix - TypeError: 'NoneType' object is not callable by @rraminen in #7330
• DeepNVMe update by @tjruwase in #7215
• fixed: Modified the topkgating function and modified the test_moe file for testing by @xiongjyu in #7163
• Fix LoRA arxiv reference by @emmanuel-ferdman in #7340
• Update folder name by @sfc-gh-truwase in #7343
• Improve overflow handling in ZeRO by @tjruwase in #6976
• Fix docs that are rendering Incorrectly by @felixgondwe in #7344
• Move pytest pinning from individual tests to requirements-dev.txt until fixed. by @loadams in #7327

New Contributors

• @cynricfu made their first contribution in #7335
• @xiongjyu made their first contribution in #7163
• @sfc-gh-truwase made their first contribution in #7343
• @felixgondwe made their first contribution in #7344

Full Changelog: v0.17.0...v0.17.1

DeepSpeed v0.17.0

What's Changed

• Update next version in version.txt after 0.16.9 release. by @loadams in #7306
• Update COMMITTERS.md by @PKUWZP in #7305
• Fix AutoTP gathering replaced layer params when bias is not None by @HollowMan6 in #7257
• Fix the GPU memory usage of ZeRO-Offload (only update stage_1_and_2.py) by @arminzhu in #7309
• Fix: Update grad norm calculation for CPU offload by @therealnaveenkamal in #7302
• CI: prefer bf16 over fp16 by @stas00 in #7304
• tests/conftest.py: automatically add local deepspeed repo when running tests by @stas00 in #7317
• Update gaudi2 nightly,ci to latest 1.21.0 build by @raza-sikander in #7313
• anchor transformers version by @stas00 in #7316
• fix asymmetric in dequantize by @pencil-hub in #7283
• Ulysses SP for HF Integration by @stas00 in #7268
• Fix ci hang in torch2.7& improve ut by @inkcherry in #7321
• Bump to v0.17.0 by @sfc-gh-mwyatt in #7324

New Contributors

• @PKUWZP made their first contribution in #7305
• @arminzhu made their first contribution in #7309
• @therealnaveenkamal made their first contribution in #7302
• @pencil-hub made their first contribution in #7283
• @sfc-gh-mwyatt made their first contribution in #7324

Full Changelog: v0.16.9...v0.17.0

v0.16.9 Patch Release

What's Changed

• Update patch version after 0.16.8 release by @loadams in #7296
• Avoid graph break by removing another redundant requires grad false by @deepcharm in #7263
• Add qwen3 meta loading for AutoTP by @delock in #7293
• Modernize system executable detection across components by @emmanuel-ferdman in #7290
• Enable ZeRO set/get APIs for NVMe offload by @tjruwase in #7046
• Add qwen3moe meta loading for AutoTP by @ranzhejiang in #7297
• disable license check until the new license situation has been sorted… by @stas00 in #7301
• Fix extra_repr_str when weight is None / in zero-3 by @HollowMan6 in #7254
• [XPU] Support XCCL on deepspeed side by @ys950902 in #7299

New Contributors

• @emmanuel-ferdman made their first contribution in #7290

Full Changelog: v0.16.8...v0.16.9

v0.16.8 Patch Release

What's Changed

• Update version.txt after 0.16.7 release by @loadams in #7232
• Recommend using latest by @tohtana in #7233
• [NFC] Fix comment related to SP group by @c8ef in #7234
• Add cpu accelerator fp16 dtype support by @Yejing-Lai in #7207
• Update CPU torch version to 2.7 by @loadams in #7241
• Update README.md by @jizhang02 in #7246
• Fix compile error for nv_bloat162 by @loscrossos in #7248
• add Makefile to ease maintenance by @stas00 in #7267
• Fix fp8 gemm by @RezaYazdaniAminabadi in #7265
• [XPU] update xpu-max1100 CI workflow to torch 2.7 by @Liangliang-Ma in #7284
• Fix issues XPU tests hit with extra-index-url by @loadams in #7291
• Temporarily skip AIO tests due to an issue with runners by @loadams in #7288
• rollback #6726 by @delock in #7258

New Contributors

• @jizhang02 made their first contribution in #7246
• @loscrossos made their first contribution in #7248

Full Changelog: v0.16.7...v0.16.8

v0.16.7 Patch Release

What's Changed

• Update version.txt after 0.16.6 release by @loadams in #7218
• Fix release links by @tjruwase in #7219
• Fix pass for z3 and profiler by @tohtana in #7222
• Fix build on AMD GPUs (related to DeepCompile) by @HollowMan6 in #7224
• Add defence for DeepCompile w/o optimizer by @HollowMan6 in #7225
• Pass with_cuda arg for jit_load in OpBuilder by @HollowMan6 in #7226
• Make sure it's not None before offloading contiguous_grad_buffer by @HollowMan6 in #7227

Full Changelog: v0.16.6...v0.16.7

v0.16.6 Patch Release

What's Changed

• Update version.txt after 0.16.5 release by @loadams in #7180
• Cross layer overlapping for domino by @hwchen2017 in #7178
• async tp allreduce by @inkcherry in #7115
• Fix issue #5242 grad_norm and loss is nan by @Glaceon-Hyy in #7171
• Add qwen3 autotp support by @Yejing-Lai in #7187
• Update to new torch grad hook API: BF16Optimizer and Stage2 by @deepcharm in #7189
• Reland perf fix for nan inf check by @nelyahu in #7184
• Update to fix pydantic warning by @loadams in #7193
• update dependencies version info by @inkcherry in #7206
• HPU accelerator memory mapping is broken because of torch fill uninit memory by @oelayan7 in #7209
• Support complicated use cases with TiedLayerSpec by @limjcst in #7208
• Add defence for offload_states and reload_states w/o optimizer by @HollowMan6 in #7211
• DeepCompile for enhanced compiler integration by @tohtana in #7154

New Contributors

• @Glaceon-Hyy made their first contribution in #7171
• @limjcst made their first contribution in #7208

Full Changelog: v0.16.5...v0.16.6

v0.16.5 Patch Release

What's Changed

• Update version.txt after 0.16.4 release by @loadams in #7063
• fix an outdated doc wrt CUDA_VISIBLE_DEVICES by @stas00 in #7058
• Tecorigin sdaa accelerator by @siqi654321 in #6903
• Handle special case of libuv for Windows by @loadams in #7064
• Bug Fix for offload_states API by @U-rara in #7050
• Update README with info on newest accelerator by @loadams in #7065
• Fix TOCTOU issues, switch to fstat by @loadams in #7067
• config torch to avoid graph breaks caused by logger by @ShellyNR in #6999
• Fix meta load tensor imcompatible issue by @Yejing-Lai in #7073
• Replace calls to python setup.py sdist with python -m build --sdist by @loadams in #7069
• Revert "Handle special case of libuv for Windows (#7064)" by @loadams in #7076
• Add DeepseekV3 AutoTP. by @Yejing-Lai in #7045
• Improve inference tutorial docs by @loadams in #7083
• Pin transformers version on tests that use latest. by @loadams in #7085
• Update README.md with ICS '23 MoE paper link by @siddharth9820 in #7087
• Update parallelism for nv-torch-latest/nightly tests due to more GPUs/runner by @loadams in #7086
• Remove workflows for very old torch versions by @loadams in #7090
• Use new dlpack api; Formatting fixes by @tjruwase in #7101
• Avoid graph breaks by disabling sourceless calls in instrument_w_nvtx by @deepcharm in #7081
• Avoid graph breaks in torch.compile caused by inner classes in the backward hooks by @deepcharm in #7062
• Only run pre-commit on the changes by @hwchen2017 in #7106
• Avoid graph break due to unsupported frozenset by @deepcharm in #7105
• Fix fused_qkv print model ValueError by @Yejing-Lai in #7109
• Update references to new X/Twitter handle by @loadams in #7110
• Update gaudi2 nightly,ci to latest 1.20.0 build by @raza-sikander in #7093
• fix keep_module_on_host by @inkcherry in #7112
• Add sequential pytest mark to TestNVMeCheckpointing to resolve pytest forked hangs by @loadams in #7131
• Training multiple models by @tjruwase in #7018
• Update CONTRIBUTING.md to reflect changes from CLA to DCO by @loadams in #7135
• Avoid missing attr error by @tjruwase in #7133
• Add conditional expression by @A-transformer in #7119
• Unpin transformers version for most workflows by @loadams in #7139
• Conditionally quote env vars by @saurabhkoshatwar in #7071
• Correct the BACKWARD_PREFETCH_SUBMIT mismatch by @A-transformer in #7120
• Enhance Gaudi2 CI/Nightly Coverage with Model Parallelism and Linear Tests by @raza-sikander in #7146
• Update container version that runs on A6000 tests. by @loadams in #7153
• hf tp+zero training doc. by @inkcherry in #7151
• Avoid graph break by removing redundant requires_grad attr change by @deepcharm in #7158
• Add destroy to tests to free memory by @tohtana in #7160
• [NFC] Typo fix in SP layer. by @c8ef in #7152
• Link AutoTP blog in the front page by @hwchen2017 in #7167
• fix seq_parallel_communication_data_type constant. by @stas00 in #7175
• Fix typos in GDS blog by @loadams in #7177
• Variable batch size and LR scheduler by @bm-synth in #7104

New Contributors

• @siqi654321 made their first contribution in #6903
• @A-transformer made their first contribution in #7119
• @saurabhkoshatwar made their first contribution in #7071
• @c8ef made their first contribution in #7152

Full Changelog: v0.16.4...v0.16.5