arielreplicate/gscorecam-clip-analyzer ✓🔢📝🖼️❓ → 🖼️

▶️ 762 runs 📅 Jan 2023 ⚙️ Cog 0.6.1 🔗 GitHub 📄 Paper ⚖️ License
clip image-analysis saliency-map

About

Shows what CLIP looks at in an image given text

Example Output

Output

Example output

Performance Metrics

22.67s Prediction Time
113.64s Total Time
All Input Parameters 
{
  "drop": true,
  "topk": 300,
  "input_text": "background fence",
  "input_image": "https://replicate.delivery/pbxt/IAa6qtgBBpgrG7xEqYd7aQRTnS4hfnXzGYqhK1MS3OTICtBm/apple-ipod.jpg",
  "clip_version": "RN50x16",
  "overly_output": true
}
Input Parameters
drop Type: booleanDefault: true
Use only part of the channels
topk Type: integerDefault: 300Range: 1 - 3072
Number of channels used by gscorecam (ignored when drop=False)
input_text Type: stringDefault: An object
What to look for in the image
input_image (required) Type: string
Path to an image to investigate clip on
clip_version Default: RN50x16
Name of the clip model
overlay_output Type: booleanDefault: true
Show the output heatmap on-top of the input
Output Schema

Output

Type: string • Format: uri

Example Execution Logs 
0%|          | 0/5 [00:00<?, ?it/s]
 20%|██        | 1/5 [00:01<00:04,  1.04s/it]
 40%|████      | 2/5 [00:02<00:03,  1.02s/it]
 60%|██████    | 3/5 [00:03<00:02,  1.02s/it]
 80%|████████  | 4/5 [00:04<00:01,  1.02s/it]
100%|██████████| 5/5 [00:04<00:00,  1.11it/s]
100%|██████████| 5/5 [00:04<00:00,  1.05it/s]
Version Details
Version ID
414953a78bfd5f84c7db7ee5c3eac5cd74473698780c4fb1c1da52058b48ce31
Version Created
January 29, 2023
Run on Replicate →