Training models guides
1. Read mesk’s guide (new link #2), then proceed below for arch explanations and more details.
2. More thorough training guide (just not that step-by-step, condensed form, all the training content was moved from here, there, to avoid 1.02M character limitation of Google Documents)
3. Bas made a training guide in the form of a structured web page with proper formatting based on the mesk's guide.
(it doesn't mention ROCm and AMD GPUs yet and instructions from MSST section yet, so might be a subject to change, I let him know already).
As for a training code for Roformers and MDX23C, SCNet or adding new archs, most people use MSST by ZFTurbo. It’s also provided with a bunch of documentation.
“You can start with Sucial MSST WebUI (link). I use that to train all my models” - Gabox
For weird errors with depth and stuff like:
Wrong shape: expected 4 dims. Received 3-dim tensor:
ZFTurbo "has been testing some things with Roformers lately, I already notified him that the Rofos have bugs.
You'll have to use an older version of mel_band_roformer.py, for example 1-2 months ago" - becruily
https://github.com/ZFTurbo/Music-Source-Separation-Training/tree/v.1.0.4
An old ass one, it doesn't even have sage attention, LoRA and all that shit - mesk
But probably you won’t need LoRA anyway.