6 phút đọc
timoncool/YuE2-Studio: Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, – Repository timoncool/YuE2-Studio. Mô tả: Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.. 543 stars, 54 forks, ngôn ngữ chính TypeScript, cập nhật 2026-10-11.
1. Repository làm gì?
Full songs with an editable score, generated on your own GPU. One executable — no Python, no Node.js, no launcher.
English · Русский · 中文 · 日本語 · 한국어
YuE2 Studio is a desktop studio for YuE2, the open song model from M-A-P that writes a score before it sings. Describe a style, write the lyrics, and the model composes a melody with chords as sheet music, then performs it as a full song with vocals. The score comes back with the track: read it, edit it, and render the same composition again with a different sound. Windows installer with auto-update or a portable folder, runs offline on an NVIDIA card with 6 GB of VRAM or more; AMD and Intel cards through Vulkan are experimental.
It is built on yue2.cpp, the native C++/CUDA port of YuE2. The studio around it is Rust and React in a Tauri window — nothing in the runtime path is Python.
Given this repository, an agent can set everything up and drive the studio by itself:
llms.txt says the same for tools that look for it. To keep the skill in Claude Code, save docs/mcp-skill.md as ~/.claude/skills/yue2-studio/SKILL.md.
2. Dữ liệu và cấu trúc đáng chú ý
The embedded Signal editor has multiple tracks, instruments, drums, MIDI keyboard recording, tempo changes, editable chord symbols and section markers. Save a new composition as MIDI and rendered audio in the library, or update an existing track’s MIDI. SoundFonts are bundled locally; the editor sends no analytics.
In YuE2, the same editor opens ABC scores and applies notes, chords and sections back to the create form. The visual editor replaces the older separate score editor. Use Apply to update the ABC score, or send a library MIDI track to cover mode.
The same screens in the language you read: Русский, 中文, 日本語, 한국어 — on the project page, or in docs/screenshots.
Made in the released build on an RTX 4090 with the recommended BF16 set, nothing edited afterwards. Listen in the browser on the project page or download the MP3s from docs/samples.
The .deb and the AppImage for Linux x86-64 are experimental. They come from the same code with the Linux build of the same engine (Vulkan, and the processor), but the author works on Windows and has not run them on a real Linux desktop. If you live on Linux, it would be great if you polished them and sent the fixes back as a pull request. The studio keeps its data in ~/.local/share/yue2-studio ($XDG_DATA_HOME).
The paths for AMD and Intel cards (Vulkan, DirectML) and work on the processor are experimental: they exist for computers where the studio would not run at all otherwise. The main, tested path is an NVIDIA card.
Everything the studio owns stays in its own folder: models, songs, settings, logs, temporary files and the WebView2 profile, beside YuE2-Studio.exe. That holds for the portable archive and for an installation into any folder the studio can write to; deleting the folder removes the studio. Only an installation into a read-only location such as Program Files falls back to %LOCALAPPDATA%\YuE2 Studio. The installed version updates itself: a new release is offered inside the studio and installed in place.
3. Khả năng ứng dụng và giới hạn
If the installer stops on WebView2. The studio's window runs on Microsoft Edge WebView2, and the installer fetches it when Windows lacks it. On a blocked or unsteady connection, or on Windows 10 builds that refuse Microsoft's small bootstrapper (error 0x80040902), that fetch fails and the installer says so. Install WebView2 from Microsoft's standalone installer, Evergreen Standalone x64, then run the studio's installer again.
While the studio is open it serves MCP at http://127.0.0.1:8791/mcp: an agent such as Claude Code, Claude Desktop or Cursor does everything the page does, through the same code – songs and scores, the library, covers, stems, MIDI, karaoke, processing, video clips, the player, LoRA, and a LoRA from a folder of songs end to end – and sees and works the window itself: a screenshot, its controls, clicks and typing. 162 tools, grouped by area. The model's writing rules and official examples come with the server, so the agent writes the styles, lyrics and lyric layouts itself instead of the studio's small assistant.
With Agent (MCP) chosen as the writing assistant (Settings, Models), the connected agent also answers the studio's own write buttons and dataset preparation. Settings, Agent (MCP) shows whether an agent is connected and what to paste into the client.
docs/mcp-skill.md is the skill an agent reads: every tool, what the model expects, and step-by-step recipes.
A runnable YuE2 installation is a backbone (the 3B model that writes the score and the audio codes) and the VAE (turns them into 48 kHz stereo). SheetSage2 is optional: without it the studio generates, but cannot transcribe recordings for covers.
Every set also carries the decoder companion, 134 MB: Mothersuperior's decoder adapter, published as the pair of the tokenizer head the LoRA trainer turns songs into codes with. The trainer keeps it frozen under every LoRA, so a LoRA is trained on the decoder it is heard through. A render merges it on Auto (Advanced – output) only under a LoRA trained in the studio; otherwise the song is decoded by the YuE2 checkpoint alone, as its authors, audio.cpp and ComfyUI render it. On and Off force it either way. In HOT-Step's round trip of six real songs the decoder without it narrowed the stereo (left/right correlation 0.78–0.92 against the originals' ~0.65), with it 0.57–0.72.
Sizes include SheetSage2 with the MERT-v2 encoder it reads (Q8_0, F32 in the native set) and the decoder companion. The studio detects your card and preselects the set, but the download is always your decision; the model manager also builds a custom mix role by role. Q5_K_M is the lightest quantisation published for YuE2.
The GGUF files come from Serveurperso/YuE2-GGUF, pinned to revision e630f2b, the decoder companion from Mothersuperior/yue2-mothersuperior-realaudio-tokenizer-v4, pinned to revision e2e63d8; all are checked by size and SHA-256. They are written to, and can be dropped into by hand at:
A file placed by hand with the exact catalogue name is recognised and never downloaded again.
Số liệu repository có thể thay đổi; nên mở liên kết nguồn để kiểm tra README, giấy phép và trạng thái phát hành.
Nguồn tham khảo: Xem bài gốc
