Search results

AttributeError: partially initialized module 'deepspeed' has no attribute 'init_inference'

bugSomething isn't workingSomething isn't working

inference

Status: Open.

#7121 In deepspeedai/DeepSpeed;

· JocelynPanPan opened on Mar 9, 2025

safe_get_full_grad & safe_set_full_grad

Status: Open.

#7117 In deepspeedai/DeepSpeed;

· ProjectDisR opened on Mar 9, 2025

[BUG] OOM when train 70B models using deepspeed 0.16.4

bugSomething isn't workingSomething isn't working

deepspeed-chatRelated to DeepSpeed-ChatRelated to DeepSpeed-Chat

Status: Open.

#7116 In deepspeedai/DeepSpeed;

· hijkzzz opened on Mar 8, 2025

Deepspeed on Power with CPU Acclerator and AuToTP

Status: Open.

#7108 In deepspeedai/DeepSpeed;

· vinithakv opened on Mar 4, 2025

[REQUEST] An option for SUM gradient allreduce instead of MEAN

enhancementNew feature or requestNew feature or request

Status: Open.

#7107 In deepspeedai/DeepSpeed;

· sfc-gh-lmerrick opened on Mar 4, 2025

Support DualPipe training

enhancementNew feature or requestNew feature or request

Status: Open.

#7100 In deepspeedai/DeepSpeed;

· ehartford opened on Mar 2, 2025

About delay param update of ZeRO Offload

Status: Open.

#7099 In deepspeedai/DeepSpeed;

· banzhijiangshan opened on Mar 2, 2025

[REQUEST] Proposal for Enhancing ChatGPT's Response Quality During Training

enhancementNew feature or requestNew feature or request

Status: Open.

#7097 In deepspeedai/DeepSpeed;

· sandyotic opened on Mar 1, 2025

LLama factory, quantized model and deepspeed compatibility

Status: Open.

#7096 In deepspeedai/DeepSpeed;

· richardPang517 opened on Mar 1, 2025

nv-nightly CI test failure

ci-failure

Status: Open.

#7095 In deepspeedai/DeepSpeed;

· github-actions opened on Mar 1, 2025

[BUG]Does MoQ mode deprecated in DeepSpeed? I run with MoQ config, but no quantization found in log

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7092 In deepspeedai/DeepSpeed;

· dujifeng opened on Feb 28, 2025

[BUG]error: the global scope has no "timespec_get" using ::timespec_get;

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7080 In deepspeedai/DeepSpeed;

· 9050350 opened on Feb 26, 2025

[BUG] Deepspeed does not update the model when using "Qwen/Qwen2.5-3B" and is fine with ""Qwen/Qwen2.5-1.%B""

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7077 In deepspeedai/DeepSpeed;

· MiladInk opened on Feb 25, 2025

The gradient cannot be modified under Stage3

Status: Open.

#7070 In deepspeedai/DeepSpeed;

· Hashmapw opened on Feb 22, 2025

[BUG?] zero++ init problem

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7066 In deepspeedai/DeepSpeed;

· cyr0930 opened on Feb 21, 2025

Ascend 910B: attributeerror: 'deepspeedcpuadam' object has no attribute 'ds_opt_adam'

Status: Open.

#7061 In deepspeedai/DeepSpeed;

· RyanOvO opened on Feb 20, 2025

[BUG] Question Regarding Weights After Reloading ZeroQuant Quantized W4A8 BERT Model

bugSomething isn't workingSomething isn't working

compression

Status: Open.

#7060 In deepspeedai/DeepSpeed;

· RealJustinNi opened on Feb 20, 2025

[REQUEST] Publish your Windows Wheels build workflow

enhancementNew feature or requestNew feature or request

Status: Open.

#7057 In deepspeedai/DeepSpeed;

· acidbubbles opened on Feb 20, 2025

About PipelineModule

Status: Open.

#7053 In deepspeedai/DeepSpeed;

· zsy0828 opened on Feb 19, 2025

[BUG] deepspeed zero2 training hangon and timeout after a fixed step

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7044 In deepspeedai/DeepSpeed;

· leeruibin opened on Feb 17, 2025

Getting requirements to build wheel: finished with status 'error'

windowsQuestions or PRs relating to running DeepSpeed on WindowsQuestions or PRs relating to running DeepSpeed on Windows

Status: Open.

#7043 In deepspeedai/DeepSpeed;

· Avroboros opened on Feb 17, 2025

[REQUEST] Runable solution of RTX 5090 GPU + Linux Driver version + Pytorch version + Deepspeed version for LLM finetuning?

enhancementNew feature or requestNew feature or request

Status: Open.

#7042 In deepspeedai/DeepSpeed;

· 0781532 opened on Feb 17, 2025

[REQUEST] activation checkpoint API should have parity with Pytorch, keywords arguments not supported

enhancementNew feature or requestNew feature or request

Status: Open.

#7038 In deepspeedai/DeepSpeed;

· AndreasMadsen opened on Feb 15, 2025

[REQUEST] Why is the column linear layer with all-gather not implemented in DeepSpeed Inference?

enhancementNew feature or requestNew feature or request

Status: Open.

#7037 In deepspeedai/DeepSpeed;

· zhangvia opened on Feb 14, 2025

Fix - Update DeepSpeed to be PEP517 compliant, update to pyproject.toml

buildImprovements to the build and testing systems.Improvements to the build and testing systems.

installInstallation and package dependenciesInstallation and package dependencies

Status: Open.

#7031 In deepspeedai/DeepSpeed;

· loadams opened on Feb 13, 2025