De-noising (vinyl noise/white noise/general)
Faster/quicker/not so efficient
- Denoise standard in UVR serving mainly for MDX v2 noise (like in HQ_1-5, iirc it uses HV code; how it works: it separates "twice, with the second try inverted, after separation reinverted, to amplify the result, but remove the noise introduced by MDX, and then deamplified by 6dB, so it still the same volume, just without MDX noise.”
- Denoise model in UVR (it’s using VR’s UVR-DeNoise-Lite, 20kHz cutoff)
(Options>Choose Advanced Menu>Advanced MDX-Net Options>Denoise output)
model dedicated also for filtering noise existing in almost all MDX-Net v2 models in silent or quiet parts, but potentially also for more applications
- Min Spec ensemble of denoise model and denoise disabled results in Advanced MDX-Net Options (Audio Tools>Manual ensemble>Min Spec)
Filters more MDX noise in quieter parts than the denoise standard and the denoise model dedicated option in UVR.
Optimal, all-arounders. for any application, slower
- Phase-corrected de-noise method by n0blink/hitto1st (MVSep paid preset | workflow) - iirc it uses the model below, with phase from the Aufr’s model aggressive variant
- Gabox Mel denoise/debleed model | yaml | Colab | MVSEP
For noise from fullness models (tested on v5n) - it can't remove the vocal residues - try out denoising on mixture first, then use fullness model.
“It can preserve slightly more high-frequency content in speech [than Aufr33 Mel model]” - Musicalman. “Quite a bit slower”. Impressive “ability to clean up noisy vinyl or cassettes” (padybu), “from my testing it's been better than aufr33's [Mel]” (pipedream, _0nshuk)
It can remove drums in some specific cases - then isolate drums first.
It might remove claps from live videos.
- Mel-Roformer Denoise by Aufr33 | Colab | MVSEP | links later below
a) minimum aggressiveness model called “27.9959” a.k.a. “1”
- good for white noise/static noise
b) average “27.9768” a.k.a. model “2” or a.k.a. “aggressive”
- works for footsteps, crunches, rustling, sound of cars, helicopters, VHS rips
Some people like to use overlap 10 with these models.
minimum - removes fewer effects such as thunder rolls, scratching or sweeping surfaces. It’s not as good at removing louder MDX noise when using AMD GPU instead of CPU on older system’s DirectML.dll in UVR
average a.k.a. aggressive - usually removes more noise than minimum, and also occasionally slight reverb/echo from room in vocals
“The Mel-RoFormer denoise model is amazing at removing 78 RPM record crackle”
It’s much better at higher frequencies than the VR model below (it doesn’t damage them that bad, it's less destructive, but also less aggressive).
~”Incredibly useful as mixing tools, it can pull all kinds of hum out of raw vocals, guitars, room mic's, bass, etc. before mixing with zero artifacts left over”.
If it’s not available for paid users of uvronline.app, use this link | model files:
Less aggressive & More aggressive | yaml file | works with UVR Roformer patch | MSST
For UVR - use Install model option in MDX-Net, or copy ckpt files to models\MDX-Net folder and yaml to model_data\mdx_c_configs subfolder. Choose the new model, press yes to set parameters, enable Roformer option, pick the config file corresponding with the copied yaml name. In case of “use_amp” error (e.g. in MSST), add “use_amp: true” in the yaml under optimizer and other_fix lines.
“From most aggressive to least:
VR Denoise
VR Denoise Lite
[Aufr’s] Mel-Rofo Denoise Aggr(essive)
[Aufr’s] Mel-Rofo Denoise”
- Bas Curtiz
Rather RX11 Spectral Denoise can be more aggressive than all of them at certain settings, and RX12 might be even better at certain cases.
- Apollo Lew Uni model - tends to smooth out some even consistent noise in e.g. higher frequencies, making the spectrum more even there “tends to "clean" audio noise and flatten the sound a bit.” - CC Karaoke/DtN
- UVR De-Noise by aufr33 “minimum aggressiveness” on x-minus.pro/uvronline.app (for premium or using this link)
(less aggressive than denoise model in UVR,
“The (...) model is designed mainly to remove hiss, such as preamp noise. For vocals that have pops or clipping crackles or other audio irregularities, use the old denoise model“. Grabs “sound effects in old recordings (radio drama”, might make “soft voices sound weak”).
- UVR De-Noise by aufr33 “medium aggressiveness” on x-minus (same as default for free users) - it seems to be even less aggressive than UVR-DeNoise-Lite in UVR
- Mel-Roformer De-Crowd by Aufr33/viperx (x-minus.pro/UVR/DL/yaml)
(“to remove background noise when denoise models were failing [not sure if it was rain or wind”, can remove vinyl noises])
For UVR, change the model name to the one from the attached yaml, copy chkpt to models\MDX_Net_Models, and yaml to model_data subfolder, then set overlap 2 or use ZFTurbo inference script] - more effective than MDX below at times)
- yxlllc’s harmonic noise separation VR model (can be used in UVR: rename “model” to some model name, and pt extension to pth, then use Install model option and set config settings to: VR 5.1, 32/128, 1band_sr44100_hl512; “very good at further remove the noise from a dereverbed vocal yet it is mono. (...) it did have two channels on export but both of them have audible information except one has only some noise that can be easily removed then mix the other channel up to stereo” - mohammedmehditber. Maybe attached CLI code will have better mono model handling)
- mel_band_roformer/mbr_denoise_yuluoye (yaml)
- denoise children phaedrus33 model | yaml
- Mel Rifforge by mesk model final | Colab (might potentially serve also as denoiser, because it can pick up original mixture noise, and filter it out along with vocals)
- Sam Audio by Meta - Iirc, on mid side processed files, it got rid of some noise and knocking when separating SFX and instrumental with a prompt “music” and later with a prompt “knocking” on the result file “and selected the part at 0:35 and 0:36 for span prompting” - nicov_na
- Using de-limiter on mixture before separation with multiband gating with sidechain “and also by using Unchirp and some Accentize denoise plugin proactively” and later you can use RX Spectral Denoise as a finisher (method by mohammedmehditber)
(alleviates noise in Suno songs - ~“the trick is handful in proactive gating (...) current denoise models don't seem to track it. it only removes resonance and sometimes important frequencies”
“The problem is that Accentize plugin distorts the vocals no matter what model you choose
you can further enforce it now with Spectral Denoise”
“Unchirp works like de-limiter as well yet it may further remove the compression after separation. However this is more of a mixing/mastering than restoring trick so it may need some unmasking reverb and delay and so on because AI songs are built already on noise interpretation or should be muddy theoretically in the first place. therefore, de-compression could reveal more noise that you need to adapt to.” - mohammedmehditber)
- minimax-music3-latent-refiner-v0.10
“it's meant to improve the quality of minimax music 3 generations (...) this does a pretty good job with cleaning up outputs from Gabox v10 Flowers Melband Roformer model” - pitbulldale305
- cathar by vbasky (separate modules for denoise, decrackle, declick, derustle (e.g. of lavalier), declip, dewind, vocals background noise)
Vocal models as denoisers
- Unwa BigBeta 5e and 6 (5e “good when your mic/pc makes a lot of noise. All the denoise models are a bit too harsh for ASMR” - gilliaan, both “for denoising a conversation, was better than: UVR Denoise, MDX23cInstVocHQ, HQ5, KimVocal2, VocFT, Apollo, MelRof-aufr33-Denoise, GaboxDenoise, BanditV2cinematic, ViperX-BSrof-1297” - mixamillion) | Colab | MVSEP | Colab | MSST-GUI | UVR instruction | Model | yaml: big_beta5e.yaml | fixed yaml for AttributeError in UVR
- MVSep PolarFormer 124 bands (“It picks up microphone noises very well” - pezz23)
- BS-Roformer viperx 1296 / MVSEP BS-Roformer 04.24 / Gabox BS_ResurrectioN (denoising and derumbling working the most efficiently on vocals here too) x-minus/Colab/UVR/MVSEP
- Kim Mel-Roformer (works for denoising and debleeding vocals well)
- Vocal model like Voc_FT or Unwa’s ft2 bleedless (“it can sometimes isolate the vocals without the noise. And has a better result than a normal denoiser model” - Kashi)
- Mel-Roformer Karaoke (by aufr33 & viperx) (to remove noise from a dialogue, mostly rustling in the background)
x-minus.pro / uvronline.app / mvsep
model file (UVR instruction)
- Mel-Roformer Duality model (excellent for pops and clicks in mixture to get clean vocals out of 45 RPM vinyl mixture - bratmix)
Other tools
- resemble-enhance (available on x-minus, but only as denoiser for voice/vocals, and on HuggingFace, site; works good for wind/outside noise)
- tape.it/denoiser - (“great tool for removing tape hiss. Seems to be free without limitation at this point in time, though it seems to have issues with very large files [20 mins etc])”
- github.com/eloimoliner/denoising-historical-recordings (mono, old 78rpm vinyls, fixed Colab, sometimes deletes SFX, but not as much as UVR De-Noise by aufr33 in old recordings)
- audo.ai
- github.com/Rikorose/DeepFilterNet | Huggingface (for speech)
- studio.gaudiolab.io (new Noise Reduction feature)
- possibly USS-Bytedance (when similar sample provided)
- Various AI tools - list by FORARTfe/HyMPS | #2
Older models
- UVR-DeNoise (trained by FoxJoy) - DeNoise-lite above is less aggressive
You can use negative values in UVR for that model. -20/-25 - for cleaning vocals
-10/-15 - when some vocals are gone - Gabox
“It's decent, but it needs a little work compared to" RX 10 spectral denoise.
- voc_ft - works as a good denoiser for old vocal recordings
- GSEP 4-6 stem ("noise reduction is too damn good. It's on by default, but it's the best I've heard every other noise reduction algorithm makes the overall sound mushier", it’s also good when GSEP gives too noisy instrumentals with 2 stem option, it can even cancel some louder vocal residues completely)
- UVR-MDX-NET Crowd HQ 1 (UVR/x-minus)
- This VR ensemble in Colab (for creaking sounds, process your separation output more than once till you get there)