ComfyUI Node: Optimizer Config Adafactor

Authored by kijai

Created

Updated

1157 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Category

FluxTrainer

Inputs

max_grad_norm FLOAT
lr_scheduler
  • constant
  • cosine
  • cosine_with_restarts
  • polynomial
  • constant_with_warmup
  • adafactor
lr_warmup_steps INT
lr_scheduler_num_cycles INT
lr_scheduler_power FLOAT
relative_step BOOLEAN
scale_parameter BOOLEAN
warmup_init BOOLEAN
clip_threshold FLOAT
min_snr_gamma FLOAT
extra_optimizer_args STRING

Outputs

ARGS

Extension: ComfyUI Flux Trainer

Currently supports LoRA training, and untested full finetune with code from kohya's scripts: a/https://github.com/kohya-ss/sd-scripts

Authored by kijai

View Nodes

Looking for a different node?

More nodes in ComfyUI Flux Trainer

Other FluxTrainer nodes

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Learn more