luma/modify-video ❓🖼️📝🎥 → 🖼️

⭐ Official ▶️ 6.0K runs 📅 Jul 2025 ⚙️ Cog 0.16.8

About

Modify a video with style transfer and prompt-based editing

Example Output

Prompt:

"make it anime"

Output

Performance Metrics

184.64s Prediction Time

184.66s Total Time

All Input Parameters

{
  "mode": "flex_1",
  "prompt": "make it anime",
  "video_url": "https://replicate.delivery/pbxt/NHXa8wBNdkuezb6D4K930uTE1GxQEdavDzPE85Iz0LEX5S6j/A_ferrari_f40_202506211556_4g8tu.mp4",
  "first_frame_url": "https://replicate.delivery/xezq/7e5CfHf76AXHSpMHn7r8SNN65Fw0Nu4Gxrsp9a5HryPsww4pA/tmpia3hkkv5.png"
}

Input Parameters

mode Default: adhere_1: How closely the output should follow the source video. Adhere: very close, for subtle enhancements. Flex: allows more stylistic change while keeping recognizable elements. Reimagine: loosely follows the source, for dramatic or transformative changes.
video Type: string: The video to modify. Maximum video size is 100mb. Maximum video duration is 30 seconds.
prompt Type: string: A prompt to guide the video modification
video_url Type: string: Deprecated: Use video instead.
first_frame Type: string: An optional first frame of the video to modify. This should be a modified version of the original first frame, it will be used to guide the video modification.
first_frame_url Type: string: Deprecated: Use first_frame instead.

Output Schema

Output

Type: string • Format: uri

Example Execution Logs

Running prediction...
Generating video...
Generation parameters:
- generation_type: modify_video
- media: {'url': 'https://replicate.delivery/pbxt/NHXa8wBNdkuezb6D4K930uTE1GxQEdavDzPE85Iz0LEX5S6j/A_ferrari_f40_202506211556_4g8tu.mp4'}
- model: ray-2
- mode: flex_1
- first_frame: {'url': 'https://replicate.delivery/xezq/7e5CfHf76AXHSpMHn7r8SNN65Fw0Nu4Gxrsp9a5HryPsww4pA/tmpia3hkkv5.png'}
- prompt: make it anime
Dreaming...
Completed...
Generated video in 183.29sec
VIDEO_GENERATION_ID: 9421da7b-963f-49ee-ae42-f02a4d0d3670
Downloading 6367138 bytes
Downloaded 6.07MB in 0.73sec
Output video duration: 8.00s, resolution: 1280x720, total frames: 192, total pixels: 176947200 (176.95 million)

Version Details

Version ID: de2d85dcc392377a811cf6cda8f2b2b862548954363551b9cf27383ba04aed94
Version Created: November 7, 2025

Run on Replicate →