Sidon Vocoder Variants

Our from-scratch ESPnet Sidon: stage-5 w2v-BERT 2.0 LoRA predictor (30 epochs, 639 h English) with each vocoder, on 5 LibriTTS-R test-clean utterances x 6 degradations from the dsidon study. DAC stage 7 at epoch 47 (best valid) and epoch 70; DAC stage 7+8 at epoch 19 and epoch 48; stage 8 from the official decoder at epoch 18; HiFi-GAN stage 7 at epoch 31 and stage 7+8 at epoch 6; PeriodWave (flow matching) stage 7 at epoch 14 (best valid) and epoch 18 (last). Official Sidon v0.1 and our predictor with the official decoder for reference. All clips peak-normalised to 0.9.

predictor 30epoch.pthvocoder pin_48epoch.pthgit b55ff934804pack pack_vocoders_v4

Clean

Undistorted LibriTTS-R test-clean input. Restoration should leave it alone and add the 24 to 48 kHz band.

1089_134691_000007_000000

The pride of that dim image brought back to his mind the dignity of the office he had refused.

same as input
4992_41806_000020_000002

Grant that trust and peace and comfort may abide within, and that love and light and usefulness may go out from this house forever.

same as input
3729_6852_000041_000001

Well, sir, we never make coffee but in the afternoon. Would you like a good bavaroise, or a decanter of orgeat?"

same as input
5142_33396_000010_000000

"But others jumped to their feet with their mead horns in their hands. Thirty men, one after another, raised their horns and said:

same as input
5639_40744_000024_000003

They added that Rodolfo told them, on the following day, that he had carried the girl to his own apartment; and this was all they knew of the matter.

same as input

Band-limited 3.6 kHz

8th-order low-pass at 3.6 kHz: telephone bandwidth. Everything above 3.6 kHz must be invented.

1089_134691_000007_000000

The pride of that dim image brought back to his mind the dignity of the office he had refused.

4992_41806_000020_000002

Grant that trust and peace and comfort may abide within, and that love and light and usefulness may go out from this house forever.

3729_6852_000041_000001

Well, sir, we never make coffee but in the afternoon. Would you like a good bavaroise, or a decanter of orgeat?"

5142_33396_000010_000000

"But others jumped to their feet with their mead horns in their hands. Thirty men, one after another, raised their horns and said:

5639_40744_000024_000003

They added that Rodolfo told them, on the following day, that he had carried the girl to his own apartment; and this was all they knew of the matter.

Clipped

Hard clipping at a fixed threshold; the waveform peaks are flattened.

1089_134691_000007_000000

The pride of that dim image brought back to his mind the dignity of the office he had refused.

4992_41806_000020_000002

Grant that trust and peace and comfort may abide within, and that love and light and usefulness may go out from this house forever.

3729_6852_000041_000001

Well, sir, we never make coffee but in the afternoon. Would you like a good bavaroise, or a decanter of orgeat?"

5142_33396_000010_000000

"But others jumped to their feet with their mead horns in their hands. Thirty men, one after another, raised their horns and said:

5639_40744_000024_000003

They added that Rodolfo told them, on the following day, that he had carried the girl to his own apartment; and this was all they knew of the matter.

MP3 16 kbit/s

MP3 at 16 kbit/s: coding artefacts and a narrowed band.

1089_134691_000007_000000

The pride of that dim image brought back to his mind the dignity of the office he had refused.

4992_41806_000020_000002

Grant that trust and peace and comfort may abide within, and that love and light and usefulness may go out from this house forever.

3729_6852_000041_000001

Well, sir, we never make coffee but in the afternoon. Would you like a good bavaroise, or a decanter of orgeat?"

5142_33396_000010_000000

"But others jumped to their feet with their mead horns in their hands. Thirty men, one after another, raised their horns and said:

5639_40744_000024_000003

They added that Rodolfo told them, on the following day, that he had carried the girl to his own apartment; and this was all they knew of the matter.

Reverb T60 0.3 s

Shoebox room (8 x 6 x 3 m), measured T60 0.29 s.

1089_134691_000007_000000

The pride of that dim image brought back to his mind the dignity of the office he had refused.

4992_41806_000020_000002

Grant that trust and peace and comfort may abide within, and that love and light and usefulness may go out from this house forever.

3729_6852_000041_000001

Well, sir, we never make coffee but in the afternoon. Would you like a good bavaroise, or a decanter of orgeat?"

5142_33396_000010_000000

"But others jumped to their feet with their mead horns in their hands. Thirty men, one after another, raised their horns and said:

5639_40744_000024_000003

They added that Rodolfo told them, on the following day, that he had carried the girl to his own apartment; and this was all they knew of the matter.

Reverb T60 1.5 s

Same room geometry, absorption set for T60 1.48 s.

1089_134691_000007_000000

The pride of that dim image brought back to his mind the dignity of the office he had refused.

4992_41806_000020_000002

Grant that trust and peace and comfort may abide within, and that love and light and usefulness may go out from this house forever.

3729_6852_000041_000001

Well, sir, we never make coffee but in the afternoon. Would you like a good bavaroise, or a decanter of orgeat?"

5142_33396_000010_000000

"But others jumped to their feet with their mead horns in their hands. Thirty men, one after another, raised their horns and said:

5639_40744_000024_000003

They added that Rodolfo told them, on the following day, that he had carried the girl to his own apartment; and this was all they knew of the matter.