ComfyUI Node: Init Flux LoRA Training

Authored by kijai

Created

Updated

1157 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Category

FluxTrainer

Inputs

flux_models TRAIN_FLUX_MODELS
dataset JSON
optimizer_settings ARGS
output_name STRING
output_dir STRING
network_dim INT
network_alpha FLOAT
learning_rate FLOAT
max_train_steps INT
apply_t5_attn_mask BOOLEAN
cache_latents
  • disk
  • memory
  • disabled
cache_text_encoder_outputs
  • disk
  • memory
  • disabled
blocks_to_swap INT
weighting_scheme
  • logit_normal
  • sigma_sqrt
  • mode
  • cosmap
  • none
logit_mean FLOAT
logit_std FLOAT
mode_scale FLOAT
timestep_sampling
  • sigmoid
  • uniform
  • sigma
  • shift
  • flux_shift
sigmoid_scale FLOAT
model_prediction_type
  • raw
  • additive
  • sigma_scaled
guidance_scale FLOAT
discrete_flow_shift FLOAT
highvram BOOLEAN
fp8_base BOOLEAN
gradient_dtype
  • fp32
  • fp16
  • bf16
save_dtype
  • fp32
  • fp16
  • bf16
  • fp8_e4m3fn
  • fp8_e5m2
attention_mode
  • sdpa
  • xformers
  • disabled
sample_prompts STRING
additional_args STRING
resume_args ARGS
train_text_encoder
  • disabled
  • clip_l
  • clip_l_fp8
  • clip_l+T5
  • clip_l+T5_fp8
clip_l_lr FLOAT
T5_lr FLOAT
block_args ARGS
gradient_checkpointing
  • enabled
  • enabled_with_cpu_offloading
  • disabled
loss_args ARGS
network_config NETWORK_CONFIG

Outputs

NETWORKTRAINER

INT

KOHYA_ARGS

Extension: ComfyUI Flux Trainer

Currently supports LoRA training, and untested full finetune with code from kohya's scripts: a/https://github.com/kohya-ss/sd-scripts

Authored by kijai

View Nodes

Looking for a different node?

More nodes in ComfyUI Flux Trainer

Other FluxTrainer nodes

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Learn more