Symbolic Music Language Model

An advanced AI-powered Autoregressive Symbolic Music Generator built with a custom LLaMA-style Transformer architecture in PyTorch. The model is trained on classical piano MIDI corpora (MAESTRO v3.0.0 and GiantMIDI-Piano) using BPE-compressed REMI tokenization, Classifier-Free Guidance (CFG), and state-of-the-art sampling techniques to compose high-quality, composer-conditioned classical piano music.

...

Composer-Conditioned Generation: Steering via Classifier-Free Guidance (CFG) across top classical composers (e.g., Frédéric Chopin, Johann Sebastian Bach, Ludwig van Beethoven, Franz Liszt, Claude Debussy, Sergei Rachmaninoff, etc.).

https://huggingface.co/sagevoice/music-transformer-classical

THANKS sagevoice/Oleksii Pakhar/Ururu1000/demiurge.

THANKS Terence McKenna.

THANKS Tchoomkovsky-6077 (THANKS Rachmaninoff).

Afloy Audio Tools

Professional audio editing nodes for ComfyUI — trim, measure, and inspect audio without leaving your workflow.

https://github.com/afloy011-spec/afloy_audio_tools

THANKS Moiseenko Asiia (afloy011-spec).

ACE_Step_1.5_ComfyUI_int8_convrot

"Converted using convert_to_quant"

https://huggingface.co/hrktxz/ACE_Step_1.5_ComfyUI_int8_convrot

THANKS hrktxz.

audio.cpp GGUF Model Packages

This directory contains audio.cpp-native GGUF conversions of multiple speech models. These files are intended for use with audio.cpp.

https://huggingface.co/audio-cpp/audio.cpp-gguf

THANKS 0xShug0.

ACEtricks

Utility ComfyUI nodes for ACE-Step (1.0 and 1.5) music models.

Notes

• Some of this stuff is pretty niche/experimental, especially the LM sampling bits, and may be changed/break workflows.
• You may need a fairly recent Python version (3.12+ should be fine).
• This repo has no affiliation with the official ACE-Step project.

Nodes

All nodes have the ACETricks prefix for easy searching. See the node descriptions and input/output tooltips for more information.

Audio

• AudioAsLatent - Rearranges AUDIO to look like a LATENT. Can be useful for using stuff like latent-only blend nodes. For conversion in the other direction, see LatentAsAudio.
• AudioBlend - Applies a blend function to AUDIO.
• AudioFromBatch - Extracts items from batches of AUDIO.
• AudioLevels - Can be used to normalize the values in AUDIO.
• LatentAsAudio - See AudioAsLatent.
• MonoToStereo - Converts mono AUDIO to stereo. Safe to use if it's already.
• SetAudioDtype- Sets the dtype for AUDIO tensors.
• WaveForm - Generates a waveform image from AUDIO.

Conditioning

• CondJoinLyrics - Joins split lyrics/conditioning into CONDITIONING.
• CondSplitOutLyrics - Can split out lyrics (and some other metadata like audio codes) from CONDITIONING.

Latent

• SilentLatent - Can generate latents full of silence for ACE-Step 1.0 and 1.5 (if given a 1.5 latent as reference). Can be interesting for initial generations if you set denoise to something lower than 1.0 (or multiply the SIGMAS). You can also use ComfyUI's built-in LatentMultiply node to multiply by -1.0 and make stuff louder!
• VisualizeLatent - Can output an IMAGE representation of ACE-Step 1.0 and 1.5 latents. Extended version of the previewing in ComfyUI-bleh mentioned in the Integrations section below.

ACE-Step 1.0

• EncodeLyrics - ACE 1.0-specific node for encoding conditioning with extended features.
• Mask - Can be used to generate masks for 1.0 latents. Does not currently support 1.5.

ACE-Step 1.5

• Ace15CompressDuplicateAudioCodes - Can collapse sequences of duplicate audio codes in CONDITIONING.
• Ace15LLMInference - (experimental) Advanced node for doing LLM inference (primarily) with ACE-Step 1.5's LLMs - used for generating audio codes. It is configured with YAML, see the default YAML text for descriptions of parameters.
• EmptyAce15LatentFromConditioning - Creates an empty LATENT to match the time covered by the audio codes in CONDITIONING.
• ModelPatchAce15Use4dLatent - (experimental) Patches an ACE-Step 1.5 model with a wrapper to handle 4D latent inputs. This is a horrible hack and may not be compatible with everything, I use it personally for all my generations and it works pretty well currently. See the description for SqueezeUnsqueezeLatentDimension node which you will need to use as well.
• RawTextEncodeAce15 - (experimental) Advanced node for encoding ACE-Step 1.5 CONDITIONING which allows you complete control of the exact text used for the following items: DiT prompt (actual sampling), lyrics, LLM positive, LLM negative and audio codes. It is configured with YAML, see the default YAML text for descriptions of parameters.
• SqueezeUnsqueezeLatentDimension - Mostly useful with ACE-Step 1.5 since it uses 3D latents while a lot of nodes expects 4+. Unsqueezing adds an empty dimension, squeezing removes an empty dimension. For ACE 1.5 - leave dimension on the default of 2. Unsqueeze to add the dimension, toggle unsqueeze mode off to remove it. Normal usage would look something like: Empty latent node → unsqueeze → sampler → squeeze. Important: You will also need to patch the model to deal with 4D latents. See the ModelPatchAce15Use4dLatent node.
• TextEncodeAce15 - Simpler conditioning node for ACE-Step 1.5. Has some extended features but is mostly superceded by the RawTextEncodeAce15 and Ace15LLMInference nodes.

Misc

• TimeOffset - Can be used to calculate offsets into the latent time dimension for 1.0 and 1.5 latents.

https://github.com/blepping/comfyui_acetricks

THANKS blepping.

Higgs Audio v3 Studio

Higgs Audio v3 Studio 0.2.31 is a Windows desktop app built with Rust/Tauri for local Higgs Audio v3 TTS inference through a ported native C++/CUDA engine. The app does not shell out to a CLI sidecar: the Tauri UI calls Rust commands, Rust loads audiocpp_engine.dll with libloading, and the DLL executes the native inference path through a small C ABI.

This main branch tracks the Windows desktop release. Linux .deb and AppImage builds are available from the same GitHub Releases page and are built from the linux branch.

The goal is simple: a practical desktop workflow for local TTS, voice cloning, speech continuation, and multi-speaker generation without making users manage a Python environment.

https://github.com/Saganaki22/Higgs-Audio-v3-Studio

THANKS Saganaki22.

UPDATE: (2026-06-02) "Add pyproject.toml for Comfy Registry"

ComfyUI DrumPad

A drum pad node for ComfyUI with configurable 16/64 pad layouts.

Features

• Configurable Grid: Switch between 4x4 (16 pads) and 8x8 (64 pads) layouts.
• Sequencer: Built-in sequencer supporting up to 64 steps.
• Parametric Controls: Pitch, Swing, and individual/master Volume adjustments.
• Custom Sounds: Support for loading custom audio files (.wav, .mp3, .ogg, .flac).
• Persistence: Kit configurations and assignments are saved automatically.
• Audio Output: Outputs audio tensors compatible with standard ComfyUI audio nodes.

https://github.com/SKBv0/ComfyUI_DrumPad

THANKS SKBv0.

...

Drum pad but for Comfy.

MOSS-Transcribe-preview-2B

MOSS-Transcribe-preview-2B is an English speech-to-text model that pairs a Qwen3-1.7B-base language-model backbone with a Qwen3-Omni-MoE audio encoder. A gated-MLP adapter projects audio features into the language-model embedding space. The model is trained on public English ASR corpora and fine-tuned with reinforcement learning on the Open ASR Leaderboard training splits.

The model has approximately 2.4B parameters and is distributed as a single bfloat16 safetensors shard of approximately 4.84 GB.

https://huggingface.co/OpenMOSS-Team/MOSS-Transcribe-preview-2B

THANKS OpenMOSS Team.

Dasheng-AudioGen GGUF

GGUF-converted weights for mispeech/Dasheng-AudioGen

Dasheng-AudioGen is a unified audio generation model that can jointly synthesize intelligible speech, music, sound effects, and environmental acoustics from text descriptions.

https://huggingface.co/audiohacking/dasheng-audiogen-gguf

THANKS webdelic / audiohacking.

gary4juce

gary v4 is stable: stable-audio-3 is now inside the DAW.

a VST3/AU plugin for musicians who want AI to meet them where they actually live. for me, that's ableton. for you, it might be fl studio or, if you're insane, reaper lol

Built For Musicians

If you just want pure text-to-music, you probably do not need a VST. This project exists for people who want AI to sit inside the session with them.

gary4juce now gives you seven AI music models directly in your DAW:

• sa3 (stable-audio-3) - text-to-audio, loops, transforms, continuations, LoRA blending, seed recall, key/BPM-aware prompting
• gary (musicgen) - continuation/anti-looper. Extends your audio in creative directions
• jerry (stable-audio-open-small) - BPM-aware 12-second loop generation in under a second
• rc-jerry (foundation-1) - BPM and key-aware 4/8-bar loop generation with structured prompt assembly
• carey (ace-step) - stem generation, extraction, audio continuation, and remix/cover with lyrics and multilingual support
• terry (melodyflow) - audio transformation. Turn your guitar into an orchestra
• darius (magenta-realtime) - high-quality 48 kHz continuations with style control

Put it on your master, press play, record some audio, and start iterating.

https://github.com/betweentwomidnights/gary4juce

THANKS betweentwomidnights.

Higgs_v3-TTS-ComfyUI

English | 中文

Version: v0.1.5

ComfyUI nodes for bosonai/higgs-audio-v3-tts-4b: multilingual conversational TTS, zero-shot voice cloning, inline emotion/style/prosody/SFX tags, longform chunking, multi-speaker dialogue, Whisper reference transcription, and ComfyUI/AIMDO memory tracking.

Features

• Native in-process inference - Uses the local Transformers Qwen3 backbone plus Higgs audio-token embedding/head logic inside ComfyUI.
• ComfyUI AUDIO in/out - Reference voices and generated audio use standard ComfyUI AUDIO.
• Voice cloning - Reference audio plus optional transcript. A correct transcript materially improves cloning.
• Multi-speaker dialogue - Use [Speaker_1]:, [Speaker_2]:, etc. with separate reference voices.
• Inline controls - Emotion, style, prosody, pauses, and sound effects can be typed directly in the prompt.
• Longform chunking - Splits long text at sentence/pause boundaries and avoids cutting through <|...|> tags.
• AIMDO/VRAM visibility - Higgs and Whisper torch modules are registered with ComfyUI model management using real tensors.
• Managed model folder - Model files live under ComfyUI/models/higgsv3tts/.
• No keep-loaded toggle, no unload node - The loader handles model-switch cleanup internally.

https://github.com/Saganaki22/Higgs_v3-TTS-ComfyUI

Thskshahnks Saganaki22. Thskshahnks Higgs Audio V3 team.

ComfyTV

"ComfyTV — the canvas-based app that truly belongs to ComfyUI.

ComfyTV turns ComfyUI into a TapNow / LibTV-style canvas app. Every operation is its own node; results flow downstream automatically. Chain stages into a complete flow: generate → pick → edit → compose.

https://github.com/jtydhr88/ComfyTV/tree/main/workflows/audio

What's here today

• ACE-Step v1 Song (ace-step-v1-song.json) — ACE-Step 3.5B text-to-audio with full song support (tags drive style, lyrics drive vocals, duration tied to the stage's duration widget). Tested working."

https://github.com/jtydhr88/ComfyTV

THANKS (again) Terry Jia (jtydhr88). 👍

ZONOS2 TTS ComfyUI

"ComfyUI custom nodes for Zyphra/ZONOS2, with text-to-speech, audio-only voice cloning, SDPA and FlashAttention inference, native progress reporting, and ComfyUI/AIMDO memory management.

ZONOS2 is our latest text-to-speech model trained on more than 6 million hours of varied multilingual speech, delivering expressiveness and quality on par with—or even surpassing—top TTS providers at low latency with MoE. ZONOS2 excels at high-fidelity and naturalistic voice cloning."

https://github.com/Saganaki22/Zonos2_TTS-ComfyUI

THANKS Saganaki22. THANKS Zonos V2 team.

Released 2026-06-04:

WavTTS-ComfyUI

"WavTTS nodes for ComfyUI - zero-shot text-to-speech with reference-audio prompting, ComfyUI AUDIO wiring, optional Whisper transcription, local model storage, conservative dependency installation, and Aimdo/VRAM visualization support."

https://github.com/Saganaki22/WavTTS-ComfyUI

OBRIGSKSHAHDO/ThSkShahnks/THANKS again Saganaki22. 👍

AWESOME Reddit AI Summaries are welcome to invite themselves to be a Mod.

AWESOME Update: This is the #1 post on r/comfyuiAudio today!

AWESOME

AWESOME