Kakao Healthcare logo

Kakao Healthcare: Providing faster, smarter, Gemini-powered personalized healthcare

Google Cloud Results
  • Deployed Agentic AI Chatbot in just a few weeks

  • Integrated flexible agents using multiple LLMs

  • Deliver faster, more accurate healthcare-related answers to the users

  • Improved security guardrails for healthcare-related answers

Kakao Healthcare delivers faster, smarter, and more personalized quality care with its agentic-AI powered healthcare app, PASTA.

PASTA AI chatbot

Scaling AI and data infrastructure to empower patients with personalized care

We initially built PASTA to help patients with diabetes, but as we expanded to support more users facing other healthcare challenges where lifestyle modifications are crucial, we realized we also needed to embed more complex AI capabilities.

Kyungdoc Kim

Director, AI Transformation, Kakao Healthcare

For Kakao Healthcare, delivering accessible, user-friendly, and smart healthcare services and managing a complex technical infrastructure are deeply intertwined. The company aims to accomplish the goal by developing new solutions that help make hyper-personalized recommendations drawn from large datasets and embedding that data into AI-powered platforms. 

Solutions such as the company's data platform (built with AlloyDB) to add value to existing hospital clinical data, and research portal HAYCORN to provide healthcare data services to consumers like pharmaceutical companies, were designed to help healthcare professionals make more informed decisions faster. Furthermore, Kakao Healthcare debuted its AI-based, mobile chronic disease management platform, PASTA (Personalized, Accessible, Supportive, Tech-enabled, and Affordable), to more directly support patients and users in their individual healthcare journeys.

The app understands each user and their unique health context to provide tailored health advice and help answer questions. It includes features such as Vision AI-powered food and nutrition recognition through camera interface, Speech-to-Text health logs, and a notification tool that suggests lifestyle changes based on factors such as blood sugar levels, meal history, lifestyle practices, and more. The company wanted to use its AI-centric approach to care to build an even more personal application for a wider range of users. This forward-thinking patient experience strategy led the team to Google Cloud Consulting to accelerate the evolution of their AI infrastructure.

PASTA AI Chatbot

Implementing multimodal AI agents to deliver faster, more accurate care suggestions

The team's vision for PASTA has driven its growth from a diabetes care-focused app into "a super-smart health management platform that uses AI to understand people and help them make more informed choices," says Kyungdoc Kim, director, AI Transformation at Kakao Healthcare. At the heart of this evolution is the app's AI-powered chatbot. Whether users have health-related questions or simply need tech support, the team wanted to expand the chatbot's capabilities with a multi-layered agentic AI system. 

Working with Google Cloud Consulting, Kakao Healthcare was able to draw on foundational AI models on Model Garden to quickly iterate and develop a more accurate chatbot. By building on top of existing models, the company was able to deploy a more accurate agentic AI chatbot in just a few weeks.

Preparing clean, well-organized data is the only way we can take advantage of our architecture. Connecting Gemini and Vertex AI to our 280 FAQs, 190 reference documents, 58 expert source sites, and 94 evaluative datasets means we can deliver the best possible service to our users.

Soo-Yong Shin

Chief Research Officer, Kakao Healthcare

This process started by designing classification modules that could understand and act on user intent. To be useful, the bot had to be able to distinguish between a simple exploratory question and one that required expert-level information. Next, through a rewrite module, natural language questions are translated into clearer, computer language requests (Example: "What did I eat yesterday?" becomes "access restaurant records from July 1"). Relevant information is then retrieved by a combination of Vertex AI for internal data and Gemini Flash for publicly available datasets. Lastly, a reranker module chooses the answer that most accurately matches the user's original intent from the pool of data surfaced by Vertex AI and Gemini.

The team combined these infrastructure updates with another new information source: a context cache that stores user chat history in Firestore. By retaining information from previous conversations and accessing information from an FAQ database, users get answers to their most important questions faster.

PASTA AI Chatbot architecture
To make people healthy with technology

Securing sensitive data while delivering accurate answers fast

PASTA now has richer context, and by leveraging multimodal data, its chat feature can access a wider range of sources. In addition, our Gemini-powered prompt tool has proven highly effective at mitigating prompt jailbreaking and hijacking attempts to keep our data safe.

Soo-Yong Shin

Chief Research Officer, Kakao Healthcare

To strengthen the guardrails, Kakao Healthcare built in protections against prompt breaking (attempting to induce the AI to generate restricted content or respond to non-compliant questions) and prompt hijacking (exploiting the chatbot to uncover security vulnerabilities in the system or manipulating app functions). 

These security precautions are part of several layers of easily customizable agents built into PASTA that run simultaneously: a health QA agent, an app QA agent, a website agent, and a security-focused agent. This ensures that no matter what question a user poses, there will be an expert agent ready to address their needs.

Standardized code designs also allow the team to adjust which datasets are drawn on by which agents. For example, simple questions may be handled by Gemini Flash to better manage cloud costs, while more complex ones are routed to Gemini Pro.

Moving forward, the company plans to design a broader pool of specialized agents to deliver even more granular responses. By continuing to collaborate with Google Cloud Consulting to refine its AI architecture, Kakao Healthcare also sees new opportunities to personalize the PASTA user experience. Part of this customization journey involves integrating new ways to interact with personal data, including voice conversations with the app’s agents, so users have greater control over their own care journey. 

"As the PASTA AI agents become more advanced, the platform will truly be fulfilling Kakao Healthcare's mission to make people healthy with technology whenever and wherever our users need help," says Kim.

Kakao Healthcare seeks to "make people healthy with technology." Achieving this mission involves using cloud computing, data analytics, and AI to deliver personalized care to all patients and users everywhere.

Industry: Healthcare

Location: South Korea

Products: Google Cloud, Firestore, Gemini Flash, Gemini Pro, Generative AI on Google Cloud, Model Garden, Vertex AI