fofr/flux-condensation 🖼️🔢❓📝✓ → 🖼️

▶️ 1.2K runs 📅 Dec 2024 ⚙️ Cog 0.11.1

About

Flux fine-tuned to write and draw in condensation

Example Output

Prompt:

"the words "condensation lora" written in CONDENSATION on a window"

Output

Performance Metrics

8.35s Prediction Time

8.48s Total Time

All Input Parameters

{
  "model": "dev",
  "prompt": "the words \"condensation lora\" written in CONDENSATION on a window",
  "go_fast": false,
  "lora_scale": 1,
  "megapixels": "1",
  "num_outputs": 1,
  "aspect_ratio": "3:2",
  "output_format": "jpg",
  "guidance_scale": 3,
  "output_quality": 80,
  "prompt_strength": 0.8,
  "extra_lora_scale": 1,
  "num_inference_steps": 28
}

Input Parameters

mask Type: string: Image mask for image inpainting mode. If provided, aspect_ratio, width, and height inputs are ignored.
seed Type: integer: Random seed. Set for reproducible generation
image Type: string: Input image for image to image or inpainting mode. If provided, aspect_ratio, width, and height inputs are ignored.
model Default: dev: Which model to run inference with. The dev model performs best with around 28 inference steps but the schnell model only needs 4 steps.
width Type: integerRange: 256 - 1440: Width of generated image. Only works if `aspect_ratio` is set to custom. Will be rounded to nearest multiple of 16. Incompatible with fast generation
height Type: integerRange: 256 - 1440: Height of generated image. Only works if `aspect_ratio` is set to custom. Will be rounded to nearest multiple of 16. Incompatible with fast generation
prompt (required) Type: string: Prompt for generated image. If you include the `trigger_word` used in the training process you are more likely to activate the trained object, style, or concept in the resulting image.
go_fast Type: booleanDefault: false: Run faster predictions with model optimized for speed (currently fp8 quantized); disable to run in original bf16
extra_lora Type: string: Load LoRA weights. Supports Replicate models in the format <owner>/<username> or <owner>/<username>/<version>, HuggingFace URLs in the format huggingface.co/<owner>/<model-name>, CivitAI URLs in the format civitai.com/models/<id>[/<model-name>], or arbitrary .safetensors URLs from the Internet. For example, 'fofr/flux-pixar-cars'
lora_scale Type: numberDefault: 1Range: -1 - 3: Determines how strongly the main LoRA should be applied. Sane results between 0 and 1 for base inference. For go_fast we apply a 1.5x multiplier to this value; we've generally seen good performance when scaling the base value by that amount. You may still need to experiment to find the best value for your particular lora.
megapixels Default: 1: Approximate number of megapixels for generated image
num_outputs Type: integerDefault: 1Range: 1 - 4: Number of outputs to generate
aspect_ratio Default: 1:1: Aspect ratio for the generated image. If custom is selected, uses height and width below & will run in bf16 mode
output_format Default: webp: Format of the output images
guidance_scale Type: numberDefault: 3Range: 0 - 10: Guidance scale for the diffusion process. Lower values can give more realistic images. Good values to try are 2, 2.5, 3 and 3.5
output_quality Type: integerDefault: 80Range: 0 - 100: Quality when saving the output images, from 0 to 100. 100 is best quality, 0 is lowest quality. Not relevant for .png outputs
prompt_strength Type: numberDefault: 0.8Range: 0 - 1: Prompt strength when using img2img. 1.0 corresponds to full destruction of information in image
extra_lora_scale Type: numberDefault: 1Range: -1 - 3: Determines how strongly the extra LoRA should be applied. Sane results between 0 and 1 for base inference. For go_fast we apply a 1.5x multiplier to this value; we've generally seen good performance when scaling the base value by that amount. You may still need to experiment to find the best value for your particular lora.
replicate_weights Type: string: Load LoRA weights. Supports Replicate models in the format <owner>/<username> or <owner>/<username>/<version>, HuggingFace URLs in the format huggingface.co/<owner>/<model-name>, CivitAI URLs in the format civitai.com/models/<id>[/<model-name>], or arbitrary .safetensors URLs from the Internet. For example, 'fofr/flux-pixar-cars'
num_inference_steps Type: integerDefault: 28Range: 1 - 50: Number of denoising steps. More steps can give more detailed images, but take longer.
disable_safety_checker Type: booleanDefault: false: Disable safety checker for generated images.

Output Schema

Output

Type: array • Items Type: string • Items Format: uri

Example Execution Logs

2024-12-14 14:35:57.841 | DEBUG    | fp8.lora_loading:apply_lora_to_model:574 - Extracting keys
2024-12-14 14:35:57.842 | DEBUG    | fp8.lora_loading:apply_lora_to_model:581 - Keys extracted
Applying LoRA:   0%|          | 0/304 [00:00<?, ?it/s]
Applying LoRA:  91%|█████████▏| 278/304 [00:00<00:00, 2747.72it/s]
Applying LoRA: 100%|██████████| 304/304 [00:00<00:00, 2631.54it/s]
2024-12-14 14:35:57.958 | SUCCESS  | fp8.lora_loading:unload_loras:564 - LoRAs unloaded in 0.12s
free=28809760784384
Downloading weights
2024-12-14T14:35:57Z | INFO  | [ Initiating ] chunk_size=150M dest=/tmp/tmparzl_chr/weights url=https://replicate.delivery/xezq/wWOi9g1VN6JfJiBNP6gf8GSR6zCLmi1GwgD62YMIeMTg3o1nA/trained_model.tar
2024-12-14T14:36:00Z | INFO  | [ Complete ] dest=/tmp/tmparzl_chr/weights size="172 MB" total_elapsed=2.339s url=https://replicate.delivery/xezq/wWOi9g1VN6JfJiBNP6gf8GSR6zCLmi1GwgD62YMIeMTg3o1nA/trained_model.tar
Downloaded weights in 2.36s
2024-12-14 14:36:00.325 | INFO     | fp8.lora_loading:convert_lora_weights:498 - Loading LoRA weights for /src/weights-cache/f631c9d78c385d83
2024-12-14 14:36:00.398 | INFO     | fp8.lora_loading:convert_lora_weights:519 - LoRA weights loaded
2024-12-14 14:36:00.398 | DEBUG    | fp8.lora_loading:apply_lora_to_model:574 - Extracting keys
2024-12-14 14:36:00.399 | DEBUG    | fp8.lora_loading:apply_lora_to_model:581 - Keys extracted
Applying LoRA:   0%|          | 0/304 [00:00<?, ?it/s]
Applying LoRA:  91%|█████████▏| 278/304 [00:00<00:00, 2747.16it/s]
Applying LoRA: 100%|██████████| 304/304 [00:00<00:00, 2631.01it/s]
2024-12-14 14:36:00.514 | SUCCESS  | fp8.lora_loading:load_lora:539 - LoRA applied in 0.19s
Using seed: 47170
0it [00:00, ?it/s]
1it [00:00,  8.95it/s]
2it [00:00,  6.24it/s]
3it [00:00,  5.68it/s]
4it [00:00,  5.45it/s]
5it [00:00,  5.35it/s]
6it [00:01,  5.25it/s]
7it [00:01,  5.20it/s]
8it [00:01,  5.18it/s]
9it [00:01,  5.16it/s]
10it [00:01,  5.16it/s]
11it [00:02,  5.14it/s]
12it [00:02,  5.14it/s]
13it [00:02,  5.14it/s]
14it [00:02,  5.14it/s]
15it [00:02,  5.14it/s]
16it [00:03,  5.13it/s]
17it [00:03,  5.12it/s]
18it [00:03,  5.14it/s]
19it [00:03,  5.13it/s]
20it [00:03,  5.13it/s]
21it [00:04,  5.12it/s]
22it [00:04,  5.11it/s]
23it [00:04,  5.12it/s]
24it [00:04,  5.12it/s]
25it [00:04,  5.12it/s]
26it [00:04,  5.10it/s]
27it [00:05,  5.10it/s]
28it [00:05,  5.09it/s]
28it [00:05,  5.20it/s]
Total safe images: 1 out of 1

Version Details

Version ID: 7d174a0ee7e9769758117762f7069646b3478e09cca605c2c2284b349af84f2d
Version Created: December 14, 2024

Run on Replicate →