Skip to content

Pull requests: deepspeedai/DeepSpeed

New pull request New
129 Open 3,568 Closed
129 Open 3,568 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix zero 1 and 2 CPU-offloaded gradient norm
#7967 opened Apr 10, 2026 by alek6kun Loading…
5
Fix overlap-comm buffer lifetimes
#7965 opened Apr 9, 2026 by tohtana Collaborator Loading…
[Blog] Muon Optimizer Support in DeepSpeed
#7962 opened Apr 8, 2026 by delock Collaborator Loading…
1
Add Gram Newton-Schulz orthogonalization for Muon optimizer
#7953 opened Apr 3, 2026 by delock Collaborator Loading…
4
Fix DeepCompile+Z3 on PyTorch v2.9/2.10
#7951 opened Apr 3, 2026 by tohtana Collaborator Loading…
4
Fix/warnings stacklevel mvapich runner
#7949 opened Apr 2, 2026 by nathon-lee Contributor • Draft
2
Refactor/torch autocast encapsulate global state
#7946 opened Apr 2, 2026 by nathon-lee Contributor Loading…
3
feat(zero2): add CPU offload support for Muon optimizer
#7939 opened Mar 31, 2026 by delock Collaborator Loading…
7
Add AutoEP
#7938 opened Mar 31, 2026 by tohtana Collaborator • Draft
4
Fix ZeRO-3 optimizer initialization validation (#7844)
#7929 opened Mar 28, 2026 by amadhan882 Loading…
1
8
[Feature] Enable AutoEP Compatibility with ZeRO-3
#7928 opened Mar 28, 2026 by nathon-lee Contributor Loading…
11
Add torch_xla TPU support for ZeRO-1/2
#7917 opened Mar 21, 2026 by PKUWZP Collaborator Loading…
18
fix: add setup_context for torch.func compatibility
#7916 opened Mar 21, 2026 by roycho96 Loading…
1
26
doc: Remove suggestion to build extensions in parallel
#7899 opened Mar 12, 2026 by Flamefire Contributor Loading…
1
5
[Bugfix] Validate fp16.loss_scale is finite in DeepSpeedFP16Config
#7892 opened Mar 8, 2026 by s-zx Loading…
1
8
Fix Stage 0 + Ulysses crash: make bwc_tensor_model_parallel_rank() resilient to MP API absence
#7888 opened Mar 6, 2026 by nathon-lee Contributor Loading…
3
fix(zero): Ensure full gradient reduction for Muon optimizer with reduce_scatter
#7878 opened Feb 27, 2026 by nathon-lee Contributor Loading…
1
2
fix: correct DistributedAttention output shape and pad uneven sequence lengths (#7842)
#7868 opened Feb 22, 2026 by harshang03 • Draft
1
1
fix: keep fp32-pinned parameters out of the bf16 cast path in ZeRO-3 (#7747)
#7867 opened Feb 22, 2026 by harshang03 • Draft
1
Revert "fix: remove premature MPI environment variable check in OpenMPIRunner"
#7864 opened Feb 21, 2026 by mikloorbi-sys • Draft
1
Fix global .cuh ignore and enforce tracked CUDA headers
#7858 opened Feb 18, 2026 by harshang03 • Draft
1
Fix ZeRO legacy grad-hook crash when next_functions is missing
#7857 opened Feb 17, 2026 by harshang03 • Draft
1
Reject non-finite fp16 loss_scale across config and ZeRO paths
#7856 opened Feb 17, 2026 by harshang03 • Draft
1
Fix zero/division safety gaps in utility and inference paths
#7855 opened Feb 17, 2026 by harshang03 • Draft
Fix count_used_parameters_in_backward crash on PyTorch < 2.3 (#7756)
#7849 opened Feb 12, 2026 by harshang03 • Draft
1
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.