justmalhar/flux-sketchnotes 🖼️🔢❓📝✓ → 🖼️

▶️ 6.1K runs 📅 Aug 2024 ⚙️ Cog 0.9.14

About

Generates hand-drawn sketchnotes with great detail. Prompt Prefix: “A sketchnote in the style of TOK”

Example Output

Prompt:

"A sketchnote in the style of TOK with man explaining supervised vs unsupervised machine learning algorithms, arrows, green black tone, white background "

Output

Performance Metrics

41.06s Prediction Time

91.24s Total Time

All Input Parameters

{
  "model": "dev",
  "width": 1080,
  "height": 1080,
  "prompt": "A sketchnote in the style of TOK with man explaining supervised vs unsupervised machine learning algorithms, arrows, green black tone, white background ",
  "lora_scale": 1,
  "num_outputs": 4,
  "aspect_ratio": "1:1",
  "output_format": "jpg",
  "guidance_scale": 3.5,
  "output_quality": 100,
  "num_inference_steps": 28
}

Input Parameters

mask Type: string: Image mask for image inpainting mode. If provided, aspect_ratio, width, and height inputs are ignored.
seed Type: integer: Random seed. Set for reproducible generation
image Type: string: Input image for image to image or inpainting mode. If provided, aspect_ratio, width, and height inputs are ignored.
model Default: dev: Which model to run inference with. The dev model performs best with around 28 inference steps but the schnell model only needs 4 steps.
width Type: integerRange: 256 - 1440: Width of generated image. Only works if `aspect_ratio` is set to custom. Will be rounded to nearest multiple of 16. Incompatible with fast generation
height Type: integerRange: 256 - 1440: Height of generated image. Only works if `aspect_ratio` is set to custom. Will be rounded to nearest multiple of 16. Incompatible with fast generation
prompt (required) Type: string: Prompt for generated image. If you include the `trigger_word` used in the training process you are more likely to activate the trained object, style, or concept in the resulting image.
go_fast Type: booleanDefault: false: Run faster predictions with model optimized for speed (currently fp8 quantized); disable to run in original bf16
extra_lora Type: string: Load LoRA weights. Supports Replicate models in the format <owner>/<username> or <owner>/<username>/<version>, HuggingFace URLs in the format huggingface.co/<owner>/<model-name>, CivitAI URLs in the format civitai.com/models/<id>[/<model-name>], or arbitrary .safetensors URLs from the Internet. For example, 'fofr/flux-pixar-cars'
lora_scale Type: numberDefault: 1Range: -1 - 3: Determines how strongly the main LoRA should be applied. Sane results between 0 and 1 for base inference. For go_fast we apply a 1.5x multiplier to this value; we've generally seen good performance when scaling the base value by that amount. You may still need to experiment to find the best value for your particular lora.
megapixels Default: 1: Approximate number of megapixels for generated image
num_outputs Type: integerDefault: 1Range: 1 - 4: Number of outputs to generate
aspect_ratio Default: 1:1: Aspect ratio for the generated image. If custom is selected, uses height and width below & will run in bf16 mode
output_format Default: webp: Format of the output images
guidance_scale Type: numberDefault: 3Range: 0 - 10: Guidance scale for the diffusion process. Lower values can give more realistic images. Good values to try are 2, 2.5, 3 and 3.5
output_quality Type: integerDefault: 80Range: 0 - 100: Quality when saving the output images, from 0 to 100. 100 is best quality, 0 is lowest quality. Not relevant for .png outputs
prompt_strength Type: numberDefault: 0.8Range: 0 - 1: Prompt strength when using img2img. 1.0 corresponds to full destruction of information in image
extra_lora_scale Type: numberDefault: 1Range: -1 - 3: Determines how strongly the extra LoRA should be applied. Sane results between 0 and 1 for base inference. For go_fast we apply a 1.5x multiplier to this value; we've generally seen good performance when scaling the base value by that amount. You may still need to experiment to find the best value for your particular lora.
replicate_weights Type: string: Load LoRA weights. Supports Replicate models in the format <owner>/<username> or <owner>/<username>/<version>, HuggingFace URLs in the format huggingface.co/<owner>/<model-name>, CivitAI URLs in the format civitai.com/models/<id>[/<model-name>], or arbitrary .safetensors URLs from the Internet. For example, 'fofr/flux-pixar-cars'
num_inference_steps Type: integerDefault: 28Range: 1 - 50: Number of denoising steps. More steps can give more detailed images, but take longer.
disable_safety_checker Type: booleanDefault: false: Disable safety checker for generated images.

Output Schema

Output

Type: array • Items Type: string • Items Format: uri

Example Execution Logs

Using seed: 35184
Prompt: A sketchnote in the style of TOK with man explaining supervised vs unsupervised machine learning algorithms, arrows, green black tone, white background
txt2img mode
Using dev model
Loading LoRA weights
Ensuring enough disk space...
Free disk space: 9586469498880
Downloading weights
2024-08-19T12:44:50Z | INFO  | [ Initiating ] chunk_size=150M dest=/src/weights-cache/93f5ad2c6b2326fe url=https://replicate.delivery/yhqm/e9sBWcEWKkWrJaXImYHkCeKiFc5hwn2HrWBY1a4gedY9FcomA/trained_model.tar
2024-08-19T12:44:51Z | INFO  | [ Complete ] dest=/src/weights-cache/93f5ad2c6b2326fe size="172 MB" total_elapsed=1.441s url=https://replicate.delivery/yhqm/e9sBWcEWKkWrJaXImYHkCeKiFc5hwn2HrWBY1a4gedY9FcomA/trained_model.tar
b''
Downloaded weights in 1.469226598739624 seconds
LoRA weights loaded successfully
  0%|          | 0/28 [00:00<?, ?it/s]
  4%|▎         | 1/28 [00:01<00:27,  1.02s/it]
  7%|▋         | 2/28 [00:01<00:23,  1.12it/s]
 11%|█         | 3/28 [00:02<00:23,  1.05it/s]
 14%|█▍        | 4/28 [00:03<00:23,  1.02it/s]
 18%|█▊        | 5/28 [00:04<00:22,  1.00it/s]
 21%|██▏       | 6/28 [00:05<00:22,  1.01s/it]
 25%|██▌       | 7/28 [00:06<00:21,  1.01s/it]
 29%|██▊       | 8/28 [00:07<00:20,  1.02s/it]
 32%|███▏      | 9/28 [00:08<00:19,  1.02s/it]
 36%|███▌      | 10/28 [00:10<00:18,  1.02s/it]
 39%|███▉      | 11/28 [00:11<00:17,  1.02s/it]
 43%|████▎     | 12/28 [00:12<00:16,  1.03s/it]
 46%|████▋     | 13/28 [00:13<00:15,  1.03s/it]
 50%|█████     | 14/28 [00:14<00:14,  1.03s/it]
 54%|█████▎    | 15/28 [00:15<00:13,  1.03s/it]
 57%|█████▋    | 16/28 [00:16<00:12,  1.03s/it]
 61%|██████    | 17/28 [00:17<00:11,  1.03s/it]
 64%|██████▍   | 18/28 [00:18<00:10,  1.03s/it]
 68%|██████▊   | 19/28 [00:19<00:09,  1.03s/it]
 71%|███████▏  | 20/28 [00:20<00:08,  1.03s/it]
 75%|███████▌  | 21/28 [00:21<00:07,  1.03s/it]
 79%|███████▊  | 22/28 [00:22<00:06,  1.03s/it]
 82%|████████▏ | 23/28 [00:23<00:05,  1.03s/it]
 86%|████████▌ | 24/28 [00:24<00:04,  1.03s/it]
 89%|████████▉ | 25/28 [00:25<00:03,  1.03s/it]
 93%|█████████▎| 26/28 [00:26<00:02,  1.03s/it]
 96%|█████████▋| 27/28 [00:27<00:01,  1.03s/it]
100%|██████████| 28/28 [00:28<00:00,  1.03s/it]
100%|██████████| 28/28 [00:28<00:00,  1.02s/it]

Version Details

Version ID: 749e44eb2d6a1f19a965cb48aba61ec131a8dc42e4d71759d462686aaf41c429
Version Created: August 19, 2024

Run on Replicate →