Karaoke / Backing Vocals

Page 97 of 228 · Open the original GDoc ↗

(more up-to date, but less descriptive list at the top)

check MDX-UVR Karokee 2 model (available on MVSEP, UVR 5 GUI)

TL;DR - "Usually MDX B Karaoke has really good lead vocals and UVR Karaoke has really good backing vox”

"There are 3 good karaoke models (the ones I'm referring to are on mvsep.com [they seem to be no longer available there]). "MDX B (Karaoke)" seems to be the best at getting lead vocals from karaoke while "karokee_4band_v2_sn" (UVR) and "HP_KAROKEE-MSB2-3BAND-3090" (UVR) seem to be best for backing vocals. I recommend using a mix of the 3 to get as many layers as possible, and then use Melodyne to extract layers as best as possible. Then combine the filter results and Melodyne and you should have smthn that sounds pretty good" karokee_4band_v2_sn model might be not compatible with Colab (check mvsep or UVR5 GUI)

- Demix Pro may do a better job in B.V. than models on x-minus.

Even than the new model on x-minus since 01.02.23, but might be worth trying out on some songs (the problem is probably bound to MDX architecture itself).

"MDX in its pure form is too aggressive and removes a lot of backing vocals. However, if we apply min_mag_k processing, the results become closer to Demix Pro"

- Medley Vox

(installation tutorial)

For separating different voices, including harmonies or backing vocals check out this vocal separator, the demos sound quite good and Cyrus model has pretty similar results.

It's for already separated or original acapellas. Sometimes it gives better results than BVE models. Output sample rate is 24kHz, but it can be easily upscaled by AudioSR well.

Org. repository

https://github.com/jeonchangbin49/medleyvox

Old info (dead link):

https://media.discordapp.net/attachments/900904142669754399/1050444866464784384/Screenshot_81.jpg

How to get vocals stems by using specific models:

Song -> vocal model -> Voc & Inst

Vocal model -> Karaoke model -> Lead_Voc & Backing_Voc

Lead_Voc + Inst = Lead_Inst

- How to get backing vocals using x-minus

https://x-minus.pro/page/bv-isolation?locale=en_US

“Method two is terrible and I do not recommend it” - Aufr33

-If you have x-minus subscription, you can use chain mode for Karaoke as it currently gives the best results

How it probably works under the hood?

"On sitting down and reading https://discord.com/channels/708579735583588363/900904142669754399/1071599186350440540

It's a multistep process where it mixes a little bit from MDX's split vocals and instruments.

Then passes that mixture through the UVR v2 karaoke/backing vocals model.

Then with those results, it inverts the separated lead vocal, and adds it to the instrumental result"

- As for 4 stem separation, check GSEP or Demucs 4 (now check better MDX23 Colab by jarredou)

(other stem is usually the best in GSEP, bass in Demucs 4, rest depends also on a song, and as for drums, if you further process them in DAW using plugins, then Demucs 4 is usually better as it's lossless and supports up to 32-bit float output).

Demucs 4 has also experimental 6 stem feature. Guitar (can give good results) and piano (it's bad and worse than GSEP).

- As for free electric guitar and piano stems, currently GSEP and MVSEP models are the best, but paid Audioshake provides better results than GSEP. Also in GSEP "when the guitar model works (and it grabs the electric), the remaining 'other' stem often is a great way to hear acoustic guitar layers that are otherwise hidden.". LALAL.AI also has piano model and is “drastically” better than Demucs.

- From paid solutions for separating drums' sections, there are FactorSynth, UnmixingStation, or free Drumsep (but rather use MDX23C model).

- As for specific sounds separation, check Zero Shot Audio.

______

Cutoffs examination with spectrograms for various models and AIs, available in UVR5 GUI, along with examined times needed for each model to process on CPU or GPU (1700x/1080 Ti) by Bas Curtiz (cutoffs examination not applicable for MDX Colab where there is none unlike in UVR [it's to prevent noise]):
https://docs.google.com/spreadsheets/d/1R_pOURv8z9GmVkCt-x1wwApgAnplM9SHiPO_ViHWl1Q/edit#gid=23473506

Spreadsheet of songs that use Vocals as a melody with snippets how they separate on various models/AIs

http://vocalisolationtesting.x10.mx/

___

In below sections you’ll find more details, links, Colabs, all tools/AIs listed, more information about specific models as alternatives to experiment further (mostly MDX-UVR instrumental and vocal models available in UVR5 GUI and https://x-minus.pro/ai and MVSEP). I also provide some technicalities/troubleshooting everywhere when necessary.

_________________________________________________________________________