Skip to content

[Flux LoRA] fix issues in flux lora scripts #11111

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 33 commits into from
Apr 8, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
298709e
remove custom scheduler
linoytsaban Mar 18, 2025
364f478
update requirements.txt
linoytsaban Mar 18, 2025
90e9517
log_validation with mixed precision
linoytsaban Mar 18, 2025
d90d7f0
Merge branch 'main' into flux_lora_advanced
linoytsaban Mar 18, 2025
bdd6cae
add intermediate embeddings saving when checkpointing is enabled
linoytsaban Mar 18, 2025
c8e165b
remove comment
linoytsaban Mar 18, 2025
d434db3
Merge remote-tracking branch 'origin/flux_lora_advanced' into flux_lo…
linoytsaban Mar 18, 2025
710fcae
fix validation
linoytsaban Mar 18, 2025
2d8ca60
Merge branch 'main' into flux_lora_advanced
linoytsaban Mar 19, 2025
0565932
add unwrap_model for accelerator, torch.no_grad context for validatio…
linoytsaban Mar 19, 2025
ba4dece
revert unwrap_model change temp
linoytsaban Mar 19, 2025
c155f22
add .module to address distributed training bug + replace accelerator…
linoytsaban Mar 19, 2025
9c4368d
changes to align advanced script with canonical script
linoytsaban Mar 19, 2025
7492e92
make changes for distributed training + unify unwrap_model calls in a…
linoytsaban Mar 19, 2025
0729c66
add module.dtype fix to dreambooth script
linoytsaban Mar 19, 2025
cc1d2ad
unify unwrap_model calls in dreambooth script
linoytsaban Mar 19, 2025
07c2974
Merge branch 'main' into flux_lora_advanced
linoytsaban Mar 19, 2025
603b57c
Merge branch 'main' into flux_lora_advanced
linoytsaban Mar 20, 2025
e5636f0
Merge branch 'main' into flux_lora_advanced
linoytsaban Mar 27, 2025
8bf49c7
fix condition in validation run
linoytsaban Mar 27, 2025
b211eea
Merge branch 'main' into flux_lora_advanced
linoytsaban Apr 2, 2025
9b2917f
mixed precision
linoytsaban Apr 3, 2025
22046d1
Merge branch 'main' into flux_lora_advanced
linoytsaban Apr 3, 2025
f1af7e2
Merge branch 'main' into flux_lora_advanced
linoytsaban Apr 4, 2025
8dc7005
Merge branch 'main' into flux_lora_advanced
linoytsaban Apr 4, 2025
d8ef75f
Merge branch 'main' into flux_lora_advanced
linoytsaban Apr 7, 2025
bfd8d45
Merge branch 'main' into flux_lora_advanced
linoytsaban Apr 8, 2025
5d249a7
Update examples/advanced_diffusion_training/train_dreambooth_lora_flu…
linoytsaban Apr 8, 2025
a4b1e7f
Merge branch 'main' into flux_lora_advanced
linoytsaban Apr 8, 2025
57ee3cf
smol style change
linoytsaban Apr 8, 2025
8b991a5
change autocast
linoytsaban Apr 8, 2025
bfd1df6
Apply style fixes
github-actions[bot] Apr 8, 2025
c978ca3
Merge branch 'main' into flux_lora_advanced
linoytsaban Apr 8, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 4 additions & 3 deletions examples/advanced_diffusion_training/requirements.txt
Original file line number Diff line number Diff line change
@@ -1,7 +1,8 @@
accelerate>=0.16.0
accelerate>=0.31.0
torchvision
transformers>=4.25.1
transformers>=4.41.2
ftfy
tensorboard
Jinja2
peft==0.7.0
peft>=0.11.1
sentencepiece
Loading
Loading