Tune pitch and audio quality
Pick a short excerpt that contains the problem. Make a reference conversion and compare it with one changed setting at a time. Listen at similar levels so a louder result does not win the comparison by volume alone. For music, compare the converted vocal alone first and then in the mix.
Pitch, range, and resonance
Pitch measures how high or low a voiced sound is. F0, or fundamental frequency, is the periodic part of the signal from which a pitch extractor estimates the contour. A pitch-guided model uses that contour when it synthesizes the output.
Pitch shifts that contour by semitones. Positive values raise it and negative values lower it. Each octave has 12 semitones. For example, applying +12 to a voiced note at 220 Hz gives 440 Hz. A setting of zero keeps the pitch reference from the recording.
For speech, start at zero. If the clip sits far outside the target model's comfortable range or sounds strained, compare with a small shift up or down. For singing over an existing instrumental, compare zero first. A shift that changes the key of the vocal can clash with the backing track. Octave shifts keep the note names, though the model still needs to handle the resulting range. Compare the lowest and highest exposed notes before committing to a whole song.
Formants describe resonances that help distinguish vowels and voice character. Use formant processing only after the pitch contour is working. Pitch and resonance can need different adjustments. In builds with both inference pitch and a pitch-shift effect, the former changes the extracted pitch before synthesis and the latter acts on the resulting audio. Applio architecture reference
Compare pitch extractors
Start with RMVPE, the default for current Ilaria RVC inference. If the pitch is unstable, test another extractor available in your build, such as FCPE or Swift. Keep the same input, pitch shift, index ratio and output format for each run.
- For a held note, listen for sudden doubling or halving of the pitch. If several extractors fail at the same timestamp, check for another singer, an instrument in the vocal stem, or severe clipping.
- For quiet speech, make sure the input contains a clear voiced vowel. Increasing the level of a clip that contains mostly noise can make it harder to diagnose.
- For a large batch, compare an excerpt from the lowest and highest source voices first. Benchmark processing time with the same file and settings on the intended machine.
Pitch extraction and content extraction are separate stages. Changing the F0 extractor estimates a different pitch contour from the same audio. The content embedder still needs to match the model. Ilaria RVC inference notes
Make targeted adjustments
Avoid changing the embedder to chase a sound. It must match the feature representation the model was trained on. Index Ratio blends features retrieved from a matching training index into the conversion. It does not provide a generic quality boost. A high blend can make pronunciation less distinct, especially on an unfamiliar source.
In Applio's file engine, a Volume Envelope setting nearer zero follows the source dynamics more closely. For Protect Voiceless Consonants, values below 0.5 strengthen protection and 0.5 disables it in that engine. Check your app's tooltip and release notes before carrying those numbers to another fork. Applio's inference setting reference · AI Hub's inference settings
Diagnose by ear and with the analyzer
- Mark the timestamp of the issue. Check whether it appears in the source, the separated vocal, or only the converted result.
- If it is in the source, fix the input first. Compare an alternate take before using heavy denoising. Lowering the volume of a clipped recording cannot restore the missing peaks.
- If it appears in the conversion, compare effects off, index off, and a compatible pitch extractor in separate passes. Verify the embedder and model package before assuming the checkpoint is poor.
- Use Ilaria RVC's Audio Analyzer, where available, to compare waveforms, pitch estimates, spectra, and levels. A pitch plot can point you to a suspicious jump, and the source audio tells you whether it was part of the performance.
- Confirm the improvement on a second excerpt. Keep the setting only if it works across the material you plan to export.
For singing, test breaths, consonants, vibrato, and held notes. For speech, test quiet and loud phrases and at least one sentence with sharp consonants. If the output still fails, send a short permitted sample and your settings with a troubleshooting report. Ilaria RVC Audio Analyzer