cuuupid/seamless_expressive 🖼️❓🔢 → ❓
About
Translate audio while keeping the original style, pronunciation and tone of your original audio.
Example Output
Output
{"text_out":"Por favor, mantén el volumen bajo. Acabamos de dormir al bebé.","audio_out":"https://replicate.delivery/pbxt/l8QZv5IL75YxDV3X0IaRMyKdhwyXx2ICZf7sOnOnGQgQdwfRA/pred.wav"}
Performance Metrics
13.06s
Prediction Time
13.09s
Total Time
All Input Parameters
{
"audio_in": "https://replicate.delivery/pbxt/K08cm1YdIpqwlMi6U8qE4nSgG9gGHs26x5VirD1GkVHUC7SB/sample.mp3",
"source_lang": "English",
"target_lang": "Spanish",
"duration_factor": 1
}
Input Parameters
- audio_in
- Provide your input audio in your original language.
- source_lang
- Provide the original language of the input audio.
- target_lang
- Provide the target language for your output audio.
- duration_factor
- Recommended: 1.0 for English, Mandarin, Spanish; 1.1 for German; 1.2 for French.
Output Schema
Output
Example Execution Logs
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers built with gcc 11 (Ubuntu 11.2.0-19ubuntu1) configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared libavutil 56. 70.100 / 56. 70.100 libavcodec 58.134.100 / 58.134.100 libavformat 58. 76.100 / 58. 76.100 libavdevice 58. 13.100 / 58. 13.100 libavfilter 7.110.100 / 7.110.100 libswscale 5. 9.100 / 5. 9.100 libswresample 3. 9.100 / 3. 9.100 libpostproc 55. 9.100 / 55. 9.100 [mp3 @ 0x558193e816c0] Estimating duration from bitrate, this may be inaccurate Input #0, mp3, from '/tmp/tmp_e6h7z9ksample.mp3': Metadata: title : AlexWhisper-Eng-11.15 iTunPGAP : 0 encoded_by : Music 1.4.1.29 iTunNORM : 0000002A 0000002A 0000015D 0000015D 00000AF8 00000AF8 0000129C 0000129C 00000AF8 00000AF8 iTunSMPB : 00000000 00000210 0000083C 0000000000028B34 00000000 000104A0 00000000 00000000 00000000 00000000 00000000 00000000 Duration: 00:00:03.53, start: 0.000000, bitrate: 164 kb/s Stream #0:0: Audio: mp3, 48000 Hz, stereo, fltp, 160 kb/s Stream mapping: Stream #0:0 -> #0:0 (mp3 (mp3float) -> pcm_f32le (native)) Press [q] to stop, [?] for help Output #0, wav, to 'tmp_e6h7z9ksample.wav': Metadata: INAM : AlexWhisper-Eng-11.15 iTunPGAP : 0 ITCH : Music 1.4.1.29 iTunNORM : 0000002A 0000002A 0000015D 0000015D 00000AF8 00000AF8 0000129C 0000129C 00000AF8 00000AF8 iTunSMPB : 00000000 00000210 0000083C 0000000000028B34 00000000 000104A0 00000000 00000000 00000000 00000000 00000000 00000000 ISFT : Lavf58.76.100 Stream #0:0: Audio: pcm_f32le ([3][0][0][0] / 0x0003), 16000 Hz, mono, flt, 512 kb/s Metadata: encoder : Lavc58.134.100 pcm_f32le size= 2kB time=00:00:00.00 bitrate=N/A speed= 0x size= 221kB time=00:00:03.52 bitrate= 512.5kbits/s speed= 494x video:0kB audio:220kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.074405% Preparing to convert from eng to spa Available langs: dict_keys(['cmn', 'deu', 'eng', 'fra', 'ita', 'spa']) Por favor, mantén el volumen bajo. Acabamos de dormir al bebé.
Version Details
- Version ID
8442b10af7429cff505eb22234cb0ff8abce3016328963ef8e3022c80eb48dbf- Version Created
- December 6, 2023