lucataco/xtts-v2 📝🖼️❓✓ → 🖼️

▶️ 4.4M runs 📅 Nov 2023 ⚙️ Cog 0.8.6 🔗 GitHub 📄 Paper ⚖️ License
multilingual text-to-speech voice-cloning

About

Coqui XTTS-v2: Multilingual Text To Speech Voice Cloning

Example Output

Output

Example output

Performance Metrics

2.49s Prediction Time
2.50s Total Time
All Input Parameters 
{
  "text": "Hi there, I'm your new voice clone. Try your best to upload quality audio",
  "speaker": "https://replicate.delivery/pbxt/Jt79w0xsT64R1JsiJ0LQRL8UcWspg5J4RFrU6YwEKpOT1ukS/male.wav",
  "language": "en",
  "cleanup_voice": false
}
Input Parameters
text Type: stringDefault: Hi there, I'm your new voice clone. Try your best to upload quality audio
Text to synthesize
speaker (required) Type: string
Original speaker audio (wav, mp3, m4a, ogg, or flv)
language Default: en
Output language for the synthesised speech
cleanup_voice Type: booleanDefault: false
Whether to apply denoising to the speaker audio (microphone recordings)
Output Schema

Output

Type: string • Format: uri

Example Execution Logs 
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 70.100 / 56. 70.100
libavcodec     58.134.100 / 58.134.100
libavformat    58. 76.100 / 58. 76.100
libavdevice    58. 13.100 / 58. 13.100
libavfilter     7.110.100 /  7.110.100
libswscale      5.  9.100 /  5.  9.100
libswresample   3.  9.100 /  3.  9.100
libpostproc    55.  9.100 / 55.  9.100
Guessed Channel Layout for Input Stream #0.0 : mono
Input #0, wav, from '/tmp/tmp4fsqhtw9male.wav':
Metadata:
encoder         : Lavf58.29.100
Duration: 00:00:08.64, bitrate: 705 kb/s
Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, mono, s16, 705 kb/s
Stream mapping:
Stream #0:0 -> #0:0 (pcm_s16le (native) -> pcm_s16le (native))
Press [q] to stop, [?] for help
Output #0, wav, to '/tmp/speaker.wav':
Metadata:
ISFT            : Lavf58.76.100
Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, mono, s16, 705 kb/s
Metadata:
encoder         : Lavc58.134.100 pcm_s16le
size=       4kB time=00:00:00.00 bitrate=N/A speed=N/A
size=     744kB time=00:00:08.63 bitrate= 705.9kbits/s speed=1.33e+03x
video:0kB audio:744kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.010236%
> Text splitted to sentences.
["Hi there, I'm your new voice clone.", 'Try your best to upload quality audio']
> Processing time: 2.0034399032592773
> Real-time factor: 0.34572885257690855
Version Details
Version ID
684bc3855b37866c0c65add2ff39c78f3dea3f4ff103a436465326e0f438d55e
Version Created
November 28, 2023
Run on Replicate →