pku-yuangroup/llava-cot 🖼️🔢📝 → 📝

▶️ 50 runs 📅 Dec 2024 ⚙️ Cog 0.9.23 🔗 GitHub 📄 Paper ⚖️ License
image-analysis image-captioning image-to-text

About

Let Vision Language Models Reason Step-by-Step

Example Output

Prompt:

"how to make this pastry"

Output

To solve the problem, I will analyze the image to identify the key characteristics of the pastry, then describe how to make it by following standard steps for preparation. The image shows a tray of baklava, a pastry made with layers of phyllo dough, filled with chopped nuts, and topped with a sweet syrup. The pastry is golden brown, indicating it's been baked. To make baklava, start by preparing the nuts by roasting them. Then, assemble the layers by placing phyllo dough sheets in a tray, brushing them with butter. Spread the nut mixture evenly over the phyllo layers. Repeat this process until the layers are complete. Cut the baklava into diamond shapes and bake until golden. Finally, drizzle with syrup. To make this delicious baklava, follow these steps:

  1. Begin by preparing the nuts. You can use either walnuts, pistachios, or a combination of both. Roast the nuts in a 350°F oven for about 10 minutes until they are fragrant and slightly toasted. Let them cool down.

  2. In a large bowl, combine the cooled nuts with the sugar and cinnamon. Mix well until the nuts are evenly coated with the sugar and cinnamon mixture.

  3. To assemble the baklava, preheat your oven to 350°F. Take a rectangular tray or baking dish and line the bottom with a sheet of phyllo dough. Brush the phyllo with melted butter, then repeat this process until you have about 8-10 layers of phyllo dough.

  4. Once you've assembled the phyllo dough layers, spread the nut mixture evenly over the top layer of phyllo.

  5. Carefully roll the baklava tightly from one end of the tray to the other, applying gentle pressure to ensure it's compact. Use a knife or sharp object to cut the baklava into diamond shapes.

  6. Place the baklava in the preheated oven and bake for about 45 minutes, or until the phyllo is golden brown and crisp.

  7. Remove the baklava from the oven and let it cool for a few minutes. While it's still warm, drizzle the honey syrup evenly over the top of the baklava.

  8. Let the baklava cool completely before serving. This will allow the flavors to meld together and the pastry to absorb the honey syrup.

Enjoy your delicious homemade baklava!

Performance Metrics

25.45s Prediction Time
62.09s Total Time
All Input Parameters 
{
  "image": "https://replicate.delivery/pbxt/M4VFa6E18it1vazUahiTB5RjNjDoajLbHcpMgMFBhJvmgGdh/Baklava%281%29.png",
  "top_p": 0.95,
  "prompt": "how to make this pastry",
  "temperature": 0.9,
  "max_new_tokens": 1024
}
Input Parameters
image (required) Type: string
Grayscale input image
top_p Type: numberDefault: 0.95Range: 0 - 1
When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens, used when temperature > 0
prompt Type: stringDefault: If I had to write a haiku for this one, it would be:
Text prompt
temperature Type: numberDefault: 0.9Range: 0 - 5
Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
max_new_tokens Type: integerDefault: 1024
Max number of generated tokens
Output Schema

Output

Type: array • Items Type: string

Version Details
Version ID
40c17578a6b98679fc08e1a92fcef1b8000f857bf300a381091a13a67c28754d
Version Created
December 2, 2024
Run on Replicate →