bzikst/xtts-v2-fork 📝🖼️❓ → 🖼️

▶️ 451 runs 📅 Jan 2025 ⚙️ Cog 0.13.6 🔗 GitHub 📄 Paper ⚖️ License
multilingual text-to-speech voice-cloning

About

2025 fork of closed Coqui XTTS-v2: Multilingual Text To Speech Voice Clone

Example Output

Output

Example output

Performance Metrics

1.09s Prediction Time
1.10s Total Time
All Input Parameters 
{
  "text": "Hi there. This is forked Coqui XTTS-2 model with 17 languages supported.",
  "speaker": "https://replicate.delivery/pbxt/Jt79w0xsT64R1JsiJ0LQRL8UcWspg5J4RFrU6YwEKpOT1ukS/male.wav",
  "language": "en"
}
Input Parameters
text Type: stringDefault: Hi there! This is forked Coqui XTTS-2 model with 17 languages supported.
Text to synthesize
speaker (required) Type: string
Original speaker audio (wav, mp3, m4a, ogg, or flv). Duration should be at least 6 seconds.
language Default: en
Output language for the synthesised speech
Output Schema

Output

Type: string • Format: uri

Example Execution Logs 
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 70.100 / 56. 70.100
libavcodec     58.134.100 / 58.134.100
libavformat    58. 76.100 / 58. 76.100
libavdevice    58. 13.100 / 58. 13.100
libavfilter     7.110.100 /  7.110.100
libswscale      5.  9.100 /  5.  9.100
libswresample   3.  9.100 /  3.  9.100
libpostproc    55.  9.100 / 55.  9.100
Guessed Channel Layout for Input Stream #0.0 : mono
Input #0, wav, from '/tmp/tmprpc5jro2male.wav':
Metadata:
encoder         : Lavf58.29.100
Duration: 00:00:08.64, bitrate: 705 kb/s
Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, mono, s16, 705 kb/s
Stream mapping:
Stream #0:0 -> #0:0 (pcm_s16le (native) -> pcm_s16le (native))
Press [q] to stop, [?] for help
Output #0, wav, to '/tmp/speaker.wav':
Metadata:
ISFT            : Lavf58.76.100
Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, mono, s16, 705 kb/s
Metadata:
encoder         : Lavc58.134.100 pcm_s16le
size=       4kB time=00:00:00.00 bitrate=N/A speed=N/A
size=     744kB time=00:00:08.63 bitrate= 705.9kbits/s speed=1.47e+03x
video:0kB audio:744kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.010236%
Version Details
Version ID
35f3f05f8ed49b1808760f01caeb85a78b7b8967b838f0e4021e75a3e621fc8d
Version Created
January 10, 2025
Run on Replicate →