Audio diarization

Segment an audio record by speaker labels.

You can query a model directly and test the results returned when using different parameter values with the Cloud console, or by calling the Vertex AI API directly.

Prompt Freeform

Generate audio diarization for this interview. Use JSON format for the output, with the following keys: "speaker", "transcription". If you can infer the speaker, please do. If not, use speaker A, speaker B, etc.

Response

[
  {
    "speaker": "Karen",
    "transcription": "Well, hello everyone. Helpfulness has always been at the heart of Google's mission and so since the outbreak of the COVID-19 pandemic, we want to share some of the ways that we've been helping. We have launched more than 200 products and features and contributed more than a billion dollars in resources to help our users, our partners, everyone to get through this pandemic. I want to highlight a few of the areas we've been focused on before we broaden the conversation. You've probably heard the news about Google's collaboration with Apple. We announced this last April and it's a combined effort using Bluetooth technology to help government and health agencies slow the spread of the virus. That partnership resulted in exposure notification apps that are used to alert you if you've been in contact with someone who's tested positive for COVID. These apps are available in more than 50 countries and the research is showing that it's helping to save lives. Over the past year, we've been working closely with the World Health Organization, the CDC and others to provide trusted authoritative information for the public. When you search on COVID-19, you'll see official information from these public health entities about symptoms, prevention, treatments and references like maps and graphs to orient you to the state of the pandemic. Last September, we released the COVID-19 search trends symptoms data set, which includes search trends for more than 400 symptoms. This data has been helping researchers and public health study the link between symptom related searches and the spread of COVID-19. And finally, the community mobility reports use the same type of anonymized aggregated insights we use in products like Google Maps and these reports help chart movement trends over time. We've made them available in 135 countries and 64 languages and they're helping researchers and public health to better understand and forecast the impact of the pandemic on a global stage. We know your privacy is essential and our technology allows us to share trends and insights without sharing personal information. This is just a bit of what we're doing across Google in response to the pandemic and there's plenty more that we'd like to share. So I want to open up the conversation. Today I've invited my colleagues and friends, Doctors Garth Graham and Rob Califf to talk about our health initiatives in the pandemic that YouTube and another part of the Alphabet company Verily have been engaged in. They're two of my favorite people and I hope you enjoy hearing from them this today. So let's start with Garth. Um, what's happening over there with you all at YouTube? How are you getting accurate and up-to-date information to users?"
  },
  {
    "speaker": "Garth",
    "transcription": "Thank you, Karen. And we really have come together across the enterprise to tackle the very serious issues with the pandemic. YouTube, as you know, has become one of the most important sources of information for the public with two billion monthly users. It's really important to sort fact from fiction. That's why when the pandemic happened, we moved quickly to update our policies so we could remove false content like claims that COVID is a hoax or things along those lines. In fact, we've removed more than 700,000 videos related to dangerous or misleading COVID-19 medical information. We've also gone beyond that. We're partnering with trusted sources in the medical and public health community like the Harvard School of Public Health, the American Public Health Association, the National Academies of Medicine and Mayo Clinic to get the latest information out to users. We're putting this authoritative content on COVID-19 information panels that you'll find on the YouTube homepage, on videos and in search results. But would you like to guess how many times these panels have been viewed? Over 400 billion times so far."
  },
  {
    "speaker": "Karen",
    "transcription": "That number is amazing every time I hear it. Garth, you have devoted so much of your career to creating parity in health and healthcare and among your many influential roles, you orchestrated the US government's very first national health disparities plan. So I want you to tell us how you're doing work at YouTube that will allow you to connect with audiences that are historically hard to reach, including communities of color. Maybe you could start with an example of how you've been working with Dr. Fauci."
  },
  {
    "speaker": "Garth",
    "transcription": "That's an area that um you've pushed us a lot, you know, in terms of making sure we're reaching underserved communities and communities overall. And we've actually managed to pull off a lot of unlikely pairing of bedfellows, um, to use the terminology. And one of those examples is we paired Trevor Noah from the Daily Show, who has a very popular audience, a very popular voice and we paired him with Dr. Fauci as a source of science. And it worked really well because Trevor asked the tough questions that his fans, his audience were um thinking and really got got an idea of just how effective these types of interviews can be. The Trevor Noah Fauci interview actually got close to 12 million views. So we know that these uh personalities um are trusted voices um for um for their communities and um it's really important for YouTube to connect these known personalities with leading health experts to reach people where they are at. And I really consider this public health 101."
  },
  {
    "speaker": "Karen",
    "transcription": "Yes, indeed. Thank you so much, Garth. You and your team are doing really important work for the public's health. Rob, I I'd like to turn to you now so you can tell us about the work that Verily's Project Baseline has been doing during the pandemic. It's certainly in the beginning and even now not easy for everyone to get a COVID test and you've partnered with some pretty big names to test millions of people. So can you tell us more about that?"
  },
  {
    "speaker": "Rob",
    "transcription": "Thanks, Karen. It's been great working with you, Garth and the whole Google Health team. This has really been a tremendous effort. Verily has been able to use this baseline platform to test millions of people in community testing clinics and we've done this across 16 states in partnership with organizations like Rite Aid. More than 100,000 people have opted into our COVID-19 research and we've been able to recruit participants for research on therapies and vaccines to address the critical issues about the pandemic."
  },
  {
    "speaker": "Karen",
    "transcription": "Yeah, you know, Rob, you and the team at Verily are often three steps ahead of everybody else and um your testing programs are a good example of that because even as uh you have been developing individual testing, Verily has stepped up to develop reopening strategies. So can you tell us how that evolved and how you plan to use it in the future?"
  },
  {
    "speaker": "Rob",
    "transcription": "Well, Karen, a great byproduct of our work in COVID-19 testing and screening is that we gained valuable insights and data were collected that we used to develop operations and predictive models to help employers and university presidents open their um institutions. Now we're using those tools to work with these businesses and universities to see if we can help them uh in this next phase of the pandemic as they gradually reopen and deal with vaccination. This is called our Healthier at Work program, which now has about 20 customers including several Fortune 500 employers and major universities. We've made great progress with this first batch of businesses, their workforce and student force and we've got more planned launches coming this year."
  },
  {
    "speaker": "Karen",
    "transcription": "It's great to hear, Rob. When you talk about COVID-19 testing, um, sometimes people hear high sensitivity and pooled testing is kind of some of the characteristics or methods that are important to use. Could you explain in layman's terms what those mean and how they're helping Verily to get more accurate tests and also how to cut costs?"
  },
  {
    "speaker": "Rob",
    "transcription": "Sure, let me break it down this way. Pooled testing is simply taking samples like nasal swabs or blood draws from dozens to hundreds of people and only running a single test instead of individual tests. We can then use mathematical algorithms to give us the ability to run many fewer assays and still decipher who is infected out of a group of people. High sensitivity tests are basically more accurate tests, which help to reduce the number of false positives. Together, these approaches reduce costs and make better use of supplies. This has all been published in the med archives and is publicly available in blogs."
  },
  {
    "speaker": "Karen",
    "transcription": "That's fantastic. Thank you, Rob and and congratulations to the team. You guys should be really proud. So I want to take a shift and talk about vaccines, which is on the top of the mind for just about everybody. Um, Google recently announced an investment of $150 million to promote education and equity in access to vaccines for everyone and we want to make it easier for people to find vaccine sites on search and maps and we're making our own office spaces available as vaccination sites across the country and across the world if that's useful. So Rob and Garth, um, in in the topic of vaccines, I want to come back to the both of you so we can hear more about what your teams have been doing uh in regards to vaccinations for the US and the world. Garth, let me start with you."
  },
  {
    "speaker": "Garth",
    "transcription": "Thanks, Karen. And again, this is an area that you have pushed us on to make sure we're dealing appropriately with issues around equity. And one of the biggest challenges with the vaccine is getting the word out to underserved communities. And to do that, we're partnering with public health agencies and community-based organizations including HBCUs like Morehouse School of Medicine and organizations like the CDC Foundation. These organizations are helping people and communities, particularly underserved communities, including people of color and people living in rural America, get access to the vaccine in the same way as everyone else and educating folks along the way. I think it's really important to recognize the team effort that you and others as part of the Google Health family have assembled here to really tackle some of these very important issues around equity and helping people find accurate and timely information on vaccines. Karen, did you want to share more about that from your end?"
  },
  {
    "speaker": "Karen",
    "transcription": "I do. Thank you, Garth. Our team looked at Google search trends and found that searches for vaccine near me have been increasing by five times since the beginning of the year. So to answer that need, we're focusing on making it easier for people to find when they're eligible to receive a vaccine. To do this, we've expanded information panels on search to more than 40 countries and we're adding local distribution information in search and maps and we've just launched the Get the Facts initiative. Get the Facts is all about getting authoritative evidence-based information out to the world via Google and YouTube. And I'm grateful to partners like vaccinefinder.org and Boston Children's Hospital, government agencies and retail pharmacies who are helping us get the authoritative piece right. So Rob, um, Google's technology, specifically AI, is being used for some pretty important steps throughout the supply chain process for vaccines. Um, this includes everything from traffic and weather forecasting as well as ensuring safe delivery of the vaccine. Could you give us some more details on that kind of work?"
  },
  {
    "speaker": "Rob",
    "transcription": "You bet, Karen. We all know how important logistics are for getting more vaccines into arms. You could say we're obsessed with it now. Google Cloud has developed sophisticated supply chain systems to help states and counties deliver vaccines more efficiently. When better supply logistics are coupled with the kind of information you and Garth have described, it's a big help uh in this overwhelming time."
  },
  {
    "speaker": "Karen",
    "transcription": "Thanks, Rob. Um, so listen, one of the joys of my career um is to work with brilliant people like the both of you and the many people on our teams and I just want to say how grateful I am that we can contribute our skills, our experience um and other assets of our company to help bring an end to this pandemic. I want to thank all of the essential workers on the front lines every day, uh those in hospitals, in grocery stores, schools and research labs and many more. We're all in this together and we want you to know that you're on our minds as we do our work."
  }
]
Model: gemini-1.5-flash-002
Temperature: 0.2
Max output tokens: 8192
TopK: 40.0
TopP: 0.95