Skip to content

unexpected keyword argument 'num_decay_steps' when using cosine or linear scheduler (sd3 branch) #1602

@Enyakk

Description

@Enyakk

This is in reference to:
bmaltais/kohya_ss#2812

using the latest sd3 branch and trying to train a FLUX1.dev LoRA using AdamW and a cosine or linear scheduler produces the error. See the attached config for complete details.

I believe starting from this change there has been a problem introduced with the cosine and linear schedulers. This is true at least for FLUX dev1 LoRA training using torch 2.4.0:
#1393

This is the config TOML that produces the error for me:
config_lora.zip

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions