Structured Output

Use Case: Structured Output

This example demonstrates how our software takes a video input along with a given prompt and generates structured output.

Video Input:

Prompt:

Analyze the provided video and generate a single,
valid JSON object describing its content.
Use the following structure and data types precisely.

{
  "title": "String",
  "description": "String",
  "setting": {
    "type": "String",
    "ambiance": "String",
    "features": ["String"]
  },
  "people": [
    {
      "role": "String", // e.g., 'Barista', 'Customer'
      "description": "String", // Appearance, clothing
      "actions": ["String"] // Key actions performed
    }
  ],
  "timeline": [
    {
      "time": "String", // "MM:SS - MM:SS"
      "event": "String" // What happens in this interval
    }
  ],
  "objects": ["String"], // Important inanimate objects
  "tags": ["String"] // Relevant lowercase keywords
}

Structured Output:

{
  "title": "Barista Preparing Coffee in a Coffee Shop",
  "description": "A barista is seen preparing coffee in a coffee shop, with another barista in the background. The barista is focused on her task, carefully measuring and pouring coffee grounds into a coffee grinder. The coffee shop has a modern and cozy ambiance, with shelves of coffee beans and other coffee-related items in the background.",
  "setting": {
    "type": "Coffee Shop",
    "ambiance": "Modern and Cozy",
    "features": [
      "Shelves of Coffee Beans",
      "Coffee Grinder",
      "Coffee Shop Equipment"
    ]
  },
  "people": [
    {
      "role": "Barista",
      "description": "A woman with long brown hair, wearing a black t-shirt and a gray apron with brown straps.",
      "actions": [
        "Measuring Coffee Grounds",
        "Pouring Coffee Grounds into a Coffee Grinder",
        "Filling a Coffee Cup with Coffee"
      ]
    },
    {
      "role": "Barista",
      "description": "A man with short brown hair, wearing a white t-shirt and a gray apron.",
      "actions": [
        "Organizing Coffee Beans on Shelves",
        "Preparing Coffee in the Background"
      ]
    }
  ],
  "timeline": [
    {
      "time": "0.0 - 1.0 seconds",
      "event": "The barista is seen preparing coffee in the coffee shop."
    },
    {
      "time": "1.0 - 5.0 seconds",
      "event": "The barista measures and pours coffee grounds into a coffee grinder."
    },
    {
      "time": "5.0 - 10.0 seconds",
      "event": "The barista fills a coffee cup with coffee."
    },
    {
      "time": "10.0 - 21.6 seconds",
      "event": "The barista continues to prepare coffee, with another barista in the background."
    }
  ],
  "objects": [
    "Coffee Grinder",
    "Coffee Cup",
    "Coffee Beans",
    "Shelves",
    "Coffee Shop Equipment"
  ],
  "tags": [
    "Barista",
    "Coffee Shop",
    "Coffee Preparation",
    "Modern Ambiance",
    "Cozy Atmosphere"
  ]
}