retrocirce/zero_shot_audio_source_separation 🖼️ → 🖼️

▶️ 60.3K runs 📅 Apr 2022 ⚙️ Cog 0.3.0 🔗 GitHub 📄 Paper ⚖️ License
audio-to-audio music-source-separation

Performance

33.4sTypical run time
~247sCold start (first call)
60.3KTotal runs

About

Zero shot Sound separation by arbitrary query samples

Example Output

Output

Example output

Performance Metrics

33.37s Prediction Time
246.61s Total Time
All Input Parameters
{
  "mix_file": "https://replicate.delivery/mgxm/37dba301-948f-493d-89d6-7adacb8160ad/SevenNationArmy_trimmed.mp3",
  "query_file": "https://replicate.delivery/mgxm/2362d82d-d016-445d-b9e2-b99f3e3f70ac/bass.wav"
}
Input Parameters
mix_file (required) Type: string
Reference sound to extract source from
query_file (required) Type: string
Query sound to be searched and extracted from mix
Output Schema

Output

Type: stringFormat: uri

Example Execution Logs
/root/.pyenv/versions/3.8.13/lib/python3.8/site-packages/librosa/core/audio.py:162: UserWarning: PySoundFile failed. Trying audioread instead.
  warnings.warn("PySoundFile failed. Trying audioread instead.")
GPU available: True, used: True
TPU available: False, using: 0 TPU cores
IPU available: False, using: 0 IPUs
/root/.pyenv/versions/3.8.13/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py:679: LightningDeprecationWarning: `trainer.test(test_dataloaders)` is deprecated in v1.4 and will be removed in v1.6. Use `trainer.test(dataloaders)` instead.
  rank_zero_deprecation(
LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
/root/.pyenv/versions/3.8.13/lib/python3.8/site-packages/pytorch_lightning/trainer/data_loading.py:105: UserWarning: The dataloader, test dataloader 0, does not have many workers which may be a bottleneck. Consider increasing the value of the `num_workers` argument` (try 8 which is the number of cpus on this machine) in the `DataLoader` init to improve performance.
  rank_zero_warn(

Testing: 0it [00:00, ?it/s]
Testing: 100%|██████████| 1/1 [00:01<00:00,  1.05s/it](1, 2048)
(2048,)
--------------------------------------------------------------------------------
DATALOADER:0 TEST RESULTS
{}
--------------------------------------------------------------------------------

Testing: 100%|██████████| 1/1 [00:01<00:00,  1.13s/it]
LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]

Testing: 0it [00:00, ?it/s]

0 {'query_name': 0.0}

Testing:   0%|          | 0/1 [00:01<?, ?it/s]
Testing: 100%|██████████| 1/1 [00:01<00:00,  1.09s/it]

median_sdr: {'query_name': 0.0}

Testing: 100%|██████████| 1/1 [00:01<00:00,  1.09s/it]

max: {'query_name': 0.0}

Testing: 100%|██████████| 1/1 [00:01<00:00,  1.09s/it]

min: {'query_name': 0.0}

Testing: 100%|██████████| 1/1 [00:01<00:00,  1.09s/it]--------------------------------------------------------------------------------
DATALOADER:0 TEST RESULTS
{}
--------------------------------------------------------------------------------

Testing: 100%|██████████| 1/1 [00:01<00:00,  1.17s/it]
Version Details
Version ID
4accc6885290aa9d1503a0d1d5c3a86e1917c076475357c87343eb6481be4bdf
Version Created
April 26, 2022
Run on Replicate →