ComfyUI Extension: Comfyui-Song-Generation-Suite

Authored by pmarmotte2

Created

Updated

0 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

SongGenerationSuite generates complete, structured songs (lyrics + music prompt) and converts them into conditioning compatible with ACE 1.5 audio generation workflows.

Looking for a different extension?

Custom Nodes (1)

README

🎡 SongGenerationSuite – AI Song Writer for ComfyUI (ACE 1.5)

SongGenerationSuite is a ComfyUI custom node designed to generate complete, structured songs (lyrics + music prompt) and convert them into conditioning compatible with ACE 1.5 audio generation workflows.

It allows you to go from a simple idea to a fully conditioned song ready to be sampled with a KSampler, without writing complex prompts or lyrics manually.


✨ What this node does

From a single node, SongGenerationSuite generates:

  • 🎼 A detailed music prompt (style, instruments, mood, structure)
  • ✍️ Fully structured lyrics with strict bracket tags
    ([Intro], [Verse], [Chorus], [Bridge], [Outro], etc.)
  • 🧠 Text conditioning compatible with ACE 1.5
  • πŸ§ͺ Debug outputs (full LLM output & prompt used)

All outputs are designed to plug directly into an ACE 1.5 + KSampler pipeline.


🧩 Workflow overview

SongGenerationSuite Workflow

Minimal graph:

  1. ACE 1.5 Checkpoint Loader
  2. SongGenerationSuite
  3. KSampler
  4. ConditioningZeroOut
  5. VAE Decode Audio / Save Audio

πŸ”Œ Inputs & Wiring (ACE 1.5)

CLIP input (required)

SongGenerationSuite does not load ACE by itself.

You must:

  • Load ACE 1.5 using a Checkpoint Loader
  • Connect the loader’s CLIP output to SongGenerationSuite β†’ clip

This ensures:

  • The generated conditioning uses the same text encoder
  • Full compatibility with the ACE pipeline
ACE 1.5 Checkpoint Loader
 β”œβ”€ MODEL β†’ KSampler (model)
 └─ CLIP  β†’ SongGenerationSuite (clip)

Conditioning output

The conditioning output from SongGenerationSuite must be connected to:

  • KSampler β†’ positive
  • ConditioningZeroOut β†’ conditioning

This is the recommended ACE wiring.


πŸŽ› User parameters

Core songwriting

  • song_topic – Main theme or story of the song
  • lead_singer_sex – Vocal profile used in the prompt
  • music_style – Base genre
  • music_style_custom – Optional detailed or hybrid style
  • lyrics – Optional user lyrics
  • strict_user_lyrics – Enforce lyrics exactly if enabled
  • lyrics_language – Language of the lyrics

Musical structure

  • bpm – Target tempo
  • duration – Target song length (seconds)
  • timesignature – Musical time signature
  • keyscale – Musical key
  • lyrics_strength – Conditioning strength

Generation

  • seed – Reproducibility
  • batch_size – Number of generations

LLM model & performance

  • model – Built-in or custom HF model
  • custom_model_repo_id – HuggingFace repo ID
  • quantization – FP16 / 8-bit / 4-bit
  • attention_mode – Attention backend
  • use_torch_compile – Optional optimization
  • device – auto / cuda / cpu
  • keep_model_loaded – Keep model in VRAM

Decoding controls

  • max_tokens – Maximum generated tokens
  • temperature – Creativity level
  • top_p – Nucleus sampling
  • num_beams – Beam search
  • repetition_penalty – Reduce repetition

πŸ“¦ Installation

cd ComfyUI/custom_nodes
git clone https://github.com/YOURNAME/SongGenerationSuite.git
pip install -r requirements.txt

Restart ComfyUI.


πŸ“ Notes

  • Prompts are written in English for LLM stability
  • Lyrics language is controlled independently
  • Designed for ACE 1.5
  • Ideal for music generation and creative pipelines

πŸš€ Use cases

  • AI song prototyping
  • Music prompt generation
  • ACE 1.5 audio experiments
  • Rapid creative iteration

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Learn more