MSST Bible

Speech

Page 38 of 228 · Open the original GDoc ↗

“There isn't one specifically trained for anime, try your luck with the current available models”

The list by Musicalman (mostly from before the Gabox models release, check newer vocal models too)

“Any vocal model in the past few years should work for speech separation. My favorites at the moment are:

- MDX23C Inst-Voc HQ

- other similar MDX models for least aggressive, but bleedy, only really useful for denoising

- Unwa's Mel-Roformer big beta 4 or beta 5e vocal models - for less bleed. Atm, 5e is my go-to as it sounds less filtered.

~ I've heard people praise BS-Roformers a lot, haven't really tested those much, though.

- Becruily's vocal model [that old one] can also be better at SFX separation, but can overestimate reverb in the vocal stem sometimes.

- Mel-Roformer Karaoke by viperx and aufr33 - for more aggressive separation (removes a bit more SFX)

- And the most aggressive are Bandit models and the DNR v3 models on MVSEP, though they tend to be a bit too aggressive for my taste, so I only use them selectively.

This is just my own opinions though, subject to change at a moment's notice lol”

[you’ll find them in SFX section]

- clearvoice - it's a set of speech enhancement/separation models. My favorite model of the set is MossFormer2_SE_48K. Its dialog extraction seems to be similar to Bandit v2, though clearervoice sounds fuller to me, and separation is usually a bit better. Might be especially good in an ensemble with Bandit or vocal sep models eg. unwa, gabox etc.

- BS-Roformer 2025.06 on MVSEP - “handle speech very well. Most models get confused by stuff like birds chirping (they put it in the vocal stem), but this model keeps them out of the vocal stem way more than most. I love it!”

- https://voice-isolate-pro.vercel.app/app/

 

- bs_karaoke_3stem_giantailab (model | yaml | for use with this bs_roformer.py file for MSST | mvsepless: HF 

Works people talking over vocals where karaoke models failed and only extracted backing and lead vocals where the speech landed in the latter.

 

- Sometimes where the speech landed e.g. in the LVs, you might just repeat separation of some other karaoke model than the 3 stem

 

- iZotope Dialogue Isolate (in RX 10, and esp. 11, 12)

- iZotope RX 12 Scene Rebalance (paid; dialogue, music and effects stems)

- Acon Digital Extract:Dialogue 2

 

- Accentize VoiceGate and

- Acon Extract Dialogue

(to debleed dialogues from SFX models)

 

See also:

- Various speakers isolation 

- Harmonies

- Two singers isolation 

- Karaoke