Summarize Video

Summarize video, extract key information, and organize them in structured output.

You can query a model directly and test the results returned when using different parameter values with the Cloud console, or by calling the Vertex AI API directly.

Prompt Freeform

You are given a video about "the most searched something" on Google Search. Please watch the video and generate structured description of it. The description should include a short summary no more than 100 words, followed by descriptions for each most searched something mentioned in the video. Use a time-dependent JSON format for the description as follows:

{
  "Summary": <summary of the video, less than 100 words>,
  "Details": [ 
    { 
      "MM:SS~MM:SS": {
        "the most searched first step in history": "Moon landing by Neil Armstrong"
      }
    },
    {
      "MM:SS-MM:SS": {
        "the most searched sport": "soccer" 
      },
    }
  ]
}

Response

Of course, here is a structured description of the video.

{
  "Summary": "This video celebrates Google's 25th anniversary by showcasing the 'most searched' topics, people, and moments over the years. It highlights a wide range of categories, from historical events like the moon landing and scientific breakthroughs to pop culture icons like Taylor Swift and Beyoncé. The video covers sports, entertainment, social movements, and moments of human resilience and inspiration, culminating in a tribute to those who set records and the next generation who will surpass them.",
  "Details": [
    {
      "00:09-00:18": {
        "the most searched first step in history": "The moon landing by Neil Armstrong."
      }
    },
    {
      "00:18-00:28": {
        "the most searched decade": "The 1980s."
      }
    },
    {
      "00:28-00:35": {
        "the most searched sport": "Soccer (Football)."
      }
    },
    {
      "00:35-00:42": {
        "the most searched athlete": "Cristiano Ronaldo."
      }
    },
    {
      "00:42-00:47": {
        "the most searched mvp": "LeBron James."
      }
    },
    {
      "00:47-00:52": {
        "the most searched cricketer": "Virat Kohli."
      }
    },
    {
      "00:52-00:57": {
        "the most searched pokémon": "Pikachu."
      }
    },
    {
      "00:57-01:01": {
        "the most searched cast": "The cast of Harry Potter."
      }
    },
    {
      "01:01-01:06": {
        "the most searched simpsons character": "Homer Simpson."
      }
    },
    {
      "01:06-01:08": {
        "the most searched movie genre": "Bollywood."
      }
    },
    {
      "01:08-01:11": {
        "the most searched boy band": "BTS."
      }
    },
    {
      "01:11-01:14": {
        "the most searched girl band": "Blackpink."
      }
    },
    {
      "01:14-01:24": {
        "the most searched performance": "Beyoncé's Coachella (Beychella) performance."
      }
    },
    {
      "01:24-01:25": {
        "the most searched emoji": "The red heart emoji."
      }
    },
    {
      "01:25-01:35": {
        "the most searched toy": "Barbie."
      }
    },
    {
      "01:35-01:47": {
        "the most searched songwriter": "Taylor Swift."
      }
    },
    {
      "01:47-01:53": {
        "the most searched cartoon": "SpongeBob SquarePants."
      }
    },
    {
      "01:53-02:01": {
        "the most searched breakthrough": "Nuclear fusion."
      }
    },
    {
      "02:01-02:04": {
        "the most searched superhero": "Spider-Man."
      }
    },
    {
      "02:04-02:11": {
        "the most searched heroes": "Frontline workers (nurses, firefighters, rescue teams)."
      }
    },
    {
      "02:11-02:20": {
        "the most searched moment of silence": "The 9/11 memorial."
      }
    },
    {
      "02:28-02:38": {
        "the most searched how to help": "Searches for how to help during natural disasters and crises."
      }
    },
    {
      "02:38-02:42": {
        "the most searched challenge": "The ALS Ice Bucket Challenge."
      }
    },
    {
      "02:42-02:48": {
        "the most searched parade": "Pride parades."
      }
    },
    {
      "02:48-02:52": {
        "the most searched movement": "The Black Lives Matter movement."
      }
    },
    {
      "02:52-02:59": {
        "the most searched queen of rock and roll": "Tina Turner."
      }
    },
    {
      "02:59-03:02": {
        "the most searched fashion icon": "Rihanna."
      }
    },
    {
      "03:02-03:03": {
        "the most searched scientist": "Albert Einstein."
      }
    },
    {
      "03:03-03:06": {
        "the most searched world record": "Usain Bolt's 100m world record."
      }
    },
    {
      "03:06-03:08": {
        "the most searched goat": "Tom Brady, Billie Jean King, Serena and Venus Williams."
      }
    },
    {
      "03:27-03:37": {
        "Here's to the ones who set the bar and the ones who'll raise it": "A tribute to record-setters like Coco Gauff and the next generation of achievers."
      }
    }
  ]
}
Model: gemini-2.5-pro
Temperature: 0.2
Max output tokens: 8192
TopK: 40.0
TopP: 0.95