Add LoRA+ support#1233

Merged

kohya-ss merged 5 commits intokohya-ss:lora-plusfrom

rockerBOO:lora-plus

Apr 29, 2024

Commits on Apr 1, 2024

Commits on Apr 3, 2024

Fix default_lr being applied
rockerBOO
committed

Commits on Apr 8, 2024

Fix default LR, Add overall LoRA+ ratio, Add log
rockerBOO
committed

Commits on Apr 11, 2024

Fix unset or invalid LR from making a param_group
rockerBOO
committed