Skip to content

Commit f775d32

Browse files
committed
bump: try deepspeed >=0.14.1,<=0.15.0
1 parent 8d1a734 commit f775d32

File tree

3 files changed

+3
-7
lines changed

3 files changed

+3
-7
lines changed

requirements/fabric/strategies.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,5 +5,5 @@
55

66
# note: is a bug around 0.10 with `MPS_Accelerator must implement all abstract methods`
77
# shall be resolved by https://github.com/microsoft/DeepSpeed/issues/4372
8-
deepspeed >=0.9.3, <=0.9.3; platform_system != "Windows" and platform_system != "Darwin" # strict
8+
deepspeed >=0.14.1,<=0.15.0; platform_system != "Windows" and platform_system != "Darwin" # strict
99
bitsandbytes >=0.45.2,<0.47.0; platform_system != "Darwin"

requirements/pytorch/strategies.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,4 +3,4 @@
33

44
# note: is a bug around 0.10 with `MPS_Accelerator must implement all abstract methods`
55
# shall be resolved by https://github.com/microsoft/DeepSpeed/issues/4372
6-
deepspeed >=0.9.3, <=0.9.3; platform_system != "Windows" and platform_system != "Darwin" # strict
6+
deepspeed >=0.14.1,<=0.15.0; platform_system != "Windows" and platform_system != "Darwin" # strict

src/lightning/fabric/strategies/deepspeed.py

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,6 @@
4747
from torch.optim.lr_scheduler import _LRScheduler
4848

4949
_DEEPSPEED_AVAILABLE = RequirementCache("deepspeed")
50-
_DEEPSPEED_GREATER_EQUAL_0_14_1 = RequirementCache("deepspeed>=0.14.1")
5150

5251

5352
# TODO(fabric): Links in the docstrings to PL-specific deepspeed user docs need to be replaced.
@@ -503,10 +502,7 @@ def load_checkpoint(
503502
)
504503
engine = engines[0]
505504

506-
if _DEEPSPEED_GREATER_EQUAL_0_14_1:
507-
from deepspeed.runtime.base_optimizer import DeepSpeedOptimizer
508-
else:
509-
from deepspeed.runtime import DeepSpeedOptimizer
505+
from deepspeed.runtime.base_optimizer import DeepSpeedOptimizer
510506

511507
optimzer_state_requested = any(isinstance(item, (Optimizer, DeepSpeedOptimizer)) for item in state.values())
512508

0 commit comments

Comments
 (0)