Blending with RVC model

(by Gabox & dubpluris a.k.a. Mark | Avalaunch - text)

 

“My use Case:

Restoring older, lower-quality vocal recordings (e.g., camcorder recordings from the 90s) using RVC models trained on clean studio vocals from the same artist.

 

Practical Workflow for Using RVC in Vocal Restoration

 

The idea is not to replace old performances entirely, but to enhance them. A few key points came out of the discussion:

 

- Blending, not replacing: Using only the RVC output will usually sound artificial. The better approach is to run the old vocal stems through the trained RVC model and then blend the AI-generated stem with the original. This preserves natural performance qualities while adding clarity.

 

- Input quality matters: Even “decent but rough” camcorder audio can work. Extremely degraded sources, however, will still produce artifacts (“bad input = bad output”).

 

Complementary tools:

 

FlashSR – an audio super-resolution method that restores high frequencies and improves fidelity before running RVC. (https://mvsep.com/en/demo?algorithm_id=60)
[AudioSR might potentially give better results, but it’s much slower;
“Imo much better candidates are: AP-BWE (Colab | new repo [old]) and Clearer-Voice-Studio's Clear Voice (my favorite is the 2nd one - codename0; more simplified version by codename0 - DL”]

Matchering – matches EQ/tonal balance of rough recordings to studio references, either standalone or integrated into UVR5. Using a clean studio version of the artist as the reference and the old performance as the target is recommended.

(https://sergree.github.io/matchering / online) - Available on UVR

[You can also try out https://masterknecht.klangknecht.com/]

 

General workflow:

   

1. (Optional) Pre-process low-quality audio with FlashSR.

2. Train RVC on clean studio stems.

3. Run inference on the old stems with the trained model (i.e., feed the cleaned original vocal through the trained RVC model to get a converted stem.)

4. Blend, align and mix original + RVC stem (RVC as enhancement, not replacement) until it feels natural.

5. Use Matchering or other mastering techniques to polish.

 

For a comprehensive remastering workflow, see How to make your own remaster.

 

The overall takeaway: RVC can be used for restoration, but it works best as part of a chain of tools (super-resolution, EQ matching, mastering), with the human performance always kept at the center through blending rather than full replacement.”