ComfyUI Node: T5 Quantization Config 🐼
Run ComfyUI workflows without the setup
No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.
Category
fofo🐼/prompt
Inputs
quantization_mode
- none
- load_in_8bit
- load_in_4bit
llm_int8_threshold FLOAT
llm_int8_skip_modules STRING
llm_int8_enable_fp32_cpu_offload BOOLEAN
llm_int8_has_fp16_weight BOOLEAN
bnb_4bit_compute_dtype STRING
bnb_4bit_quant_type STRING
bnb_4bit_use_double_quant BOOLEAN
bnb_4bit_quant_storage STRING
Outputs
QUANTIZATIONCONFIG
Looking for a different node?
More nodes in Comfyui_image2prompt
Other fofo🐼/prompt nodes
Run ComfyUI workflows without the setup
No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.