Other ensembles for UVR5

Page 95 of 228 · Open the original GDoc ↗

Best newer ensembles on the list at the top of the doc. Older configurations follow after the listed hidden results below.

For reference, read MVSEP’s SDR evaluation chart (UVR ensembles will appear later in the chart).

Be aware that some of the results on the chart above at the top are not from UVR5 or use different methods and code to achieve better results and might be not public/still WiP, e.g. the following:

Hidden leaderboard results (all SDR results provided for instrumentals,
Discord links below are dead, but at least some can be found by the search on Discord and by verifying the opened link address which initial URL hasn’t changed):

- Bas’ unreleased fullband vocal model epoch 299 + voc_ft - SDR 16.32)

- this older viperx’ unreleased custom weights code (newer one is up already), besides, “instrumental vX” entries are his ones (it rather utilizes public models with his own non-public weighted inference, and he gatekeeps it for more than since MDX23 results were published).

BTW. ebright is probably the 2nd place in MDX23, at least the result appeared in similar time like ByteDance. 2nd place decided not to publish their work.

- 32-bit higher SDR result of original multisong dataset uploaded as output (opposed to the previous 16-bit currently on top). “Multisong dataset | Original stems | bass/drums/other joined” is not a model!

- Bytedance v.0.2 - inst. SDR 17.26, now it’s outperformed by v.0.3 and is 17.28, now called 1.0),

-"MSS" - is probably ByteDance 2.0, not multi source stable diffusion, as BD's test files which were published were starting with MSS name before, but the first doesn't necessarily contradict the latter, although they said to use novel arch - SDR 18.13, and probably another one by ByteDance - SDR 18.75, let's call it 2.1, but seeing inconsistent vocal result vs previous one here, we have some suspicions that the result was manipulated at least for vocals (or stems were given from different model).

- Ripple app/SAMI-Bytedance on the chart is 16.59, also input files weren't lossless.

- BS-Roformer results by viperx posted in Training

BTW. model_mel_band_roformer_ep_617_sdr_11.5882 is Bas Curtiz model trained purely on multisong dataset as an experiment, and won’t give good results outside multisong dataset.

mel_band_roformer_ep_125_sdr_11.2069 is Bas Curtiz fine-tune model trained from ZFTurbo checkpoint, and it was shared with him under condition it will remain non-public/MVSEP exclusive.

____

Some of these models in the download center are visible after using the VIP code.

Older the best ensembles for UVR by SDR :

(some newer/better ones than these located at the top of the doc)

For 28.07.23

Kim Vocal 2 + MDX23C_D1581 + Inst HQ3 + Voc FT | Avg/Avg

For 28.07.23 (#4563)

Kim Vocal 1 + Kim Vocal 2 + MDX23C_D1581 + Inst HQ3 + Voc FT + htdemucs_ft | Avg/Avg

For 27.07.23 (#4561)

Kim Vocal 1 + Kim Vocal 2 + Kim Inst + MDX23C_D1581 + Inst HQ3 + Voc FT + htdemucs_ft | Avg/Avg (beta UVR)

For 24.06.23 (#3842)

Kim Vocal 1 + 2 + Kim Inst + HQ3 + Voc FT + htdemucs_ft | Avg/Avg | Chunks: ON

(but for ensembles instead of single models it can score better with chunks disabled)

[Consider using MDX23C_D1581 vocal model above as well, if ensemble in this arch works correctly, if not, perform manual ensemble, not sure here)

As for the very big ensemble from older synth leaderboard (2023-04-30):
MDX-Net: 292, 496, 406, 427, Kim Vocal 1, Kim Inst + Demucs ft

Optionally, with later released models - voc_ft and Kim Vocal 2 -

It doesn't score too good SDR-wise on newer synth dataset, since it uses older models which have better counterparts already. Synth dataset is not used for evaluations for a long time.

For 13.06.23 (#3322)

Inst HQ2 + 427 + Inst Main + Kim Inst + Kim Vocal 1 + 2 + Demucs FT | Avg/Avg | Chunks Batch | Spectral inversion OFF

Most probably you can safely replace Inst HQ2 with HQ3 and 4 (better SDR) getting a slightly better SDR in ensemble (it’s just not tested in ensemble yet).

But be aware that “The moment you introduce Instrumental models, there will be a bit of residue in the vocal output.

However, the SDR scores higher.

I'd say go with Vocal models only, if you care about your vocal output.”

The same is vice versa for instrumentals.

- Older ensemble configurations or custom settings with lower SDR

(but might be useful for some specific songs or genres if further info is given)

From public models, the best SDR on 14.04.23:

For instrumentals

And

For vocals

As of 01.01.23 the best SDR for vocals/instrumentals has:

-UVR-MDX-NET INST MAIN + UVR-MDX-NET Inst 3` + `kim vocal model fine tuned (old)` + `Demucs: v4 | htdemucs_ft - Shifts: 2 - Ensemble Algorithm: Avg/Avg`, chunk margin: 44100 (better SDR compared to 22050), denoise output on (-||- off), spectral inversion off (-||- on)

- MDX-Net: Kim vocal model fine-tuned (old) + UVR-MDX-NET_Main_427 + Demucs: v4 | htdemucs_ft - Ensemble Algorithm: Avg/Avg, Volume Compensation: Auto

(it sets `1.035` - the best for Kim (old) model vs other options)

Shifts: 10 - Overlap: 0.25

- a bit worse ensemble settings than both ensemble settings above SDR-wise:

UVR-MDX-NET Inst 3 (464) and “UVR-MDX-NET_Main_438” vocal model (main) and htdemucs_ft - Ensemble Algorithm: Average/Average

- Also good combo (for instrumentals, vocals in half of the cases):

MDX-Net: UVR-MDX-NET Inst Main

VR Arc: 7_HP2_UVR

Demucs: v4 | htdemucs_ft

Max Spec/Max Spec

- UVR-MDX-NET Inst 3 as a main model and 7_HP2-UVR as a secondary with the scale set to 75%

(Anjok 21.12.22: Personally, I found that using [it] produces the cleanest instrumental."

“It means the final track will be 25% hp2 model and 75% inst 3 (similar to ensemble feature, but you have more control over how strong you want the secondary model to be)”

- MDX-NET inst3 model (464) with secondary model 9_HP2_UVR 71% (hendrysetiadi: seems to get the best results with e.g. disco songs).

- Inst Main + 427 + Net 1 (CyPha-SaRin: was a pretty good combo. One big model, one medium, one small, pretty decent results across the board. If a song going to have problematic parts, it's going to have regardless of what combo you picked, it seems.)

- kim vocal 1 + instr 3 + full 403 + inst HQ 1 + full 292 + instr main with MAX/MAX (hendrysetiadi: i think that's the best combination of ensemble that i found)

- For Rock/Metal - The MDX-Net/VR Architecture ensemble with the Noise Reduction set between 5-10 (depending on the track) and Aggression to 10.

- For Pop - The MDX-Net/VR Architecture ensemble with the Noise Reduction set between 0-4 and Aggression to 10. (Anjok, 13.05.22)

- Here is another ensemble that I have tried myself "VR Arc: 1_HP-UVR x MDX-Net: Kim Vocal 1 x MDX-Net: UVR-MDX-NET: Inst HQ 1 x MDX-Net: UVR-MDX-NET: Inst HQ 2" All with the average/average ensemble (Mikey/K-Pop Filters)

- Inst HQ 1 & Main 427 are best for India

-VR: 7_HP2-UVR, MDX: Kim vocal 1, Inst 3, Inst Main, Main, htdemucs_ft

Max/Max, main pair: vocals/instrumental

"Instrumentals sound so good using these settings also. I can’t believe this is possible. What an amazing software. Thank you to whoever made this." StepsFan

- I got an ensemble that works well for loud and crazy tracks (this instance it's dariacore lol) - by knock:

Models: Inst HQ 3, Main, Voc FT

Ensemble Algorithm: Avg/Avg

MDX-Net settings:

Vol Comp: Auto

Segment Size: 4096 (you can go up to 6144 if you want to wait longer, 4096 has seemed to be perfect for me)

Overlap: Default (which I believe is 0.5)

Shift Conversion Pitch: -6 (semitones)

Match Freq Cut-off: Off

Denoise Output: Yes

Spectral Inversion: No