Leveraging Gemini AI model to build AI Recording Summary and AI Toolbox
Vertex AI was used to quickly build AI models to analyze and process user feedback, reducing the overall labor workload 30%
Optimized by Vertex AI, a 7 billion token LLM was deployed and run on mobile phones for the first time, reducing the power consumption by 27% and the computing latency by 40%
OPPO is collaborating with Google Cloud to implement AI functions in its overseas mobile phones. These AI functions enhance user experience, convenience, and work efficiency, giving OPPO a competitive advantage. OPPO's AI mobile phone is among the first to adopt the Gemini AI model.
OPPO is a well-known mobile phone manufacturer in the industry. As of August 31, 2024, it has about 700 million monthly active users worldwide. OPPO has been committed to using technology innovation to create a wonderful user experience for users, and launched an AI mobile phone in early 2024. As an advocate of AI mobile phones, OPPO believes that AI mobile phones must have four characteristics: efficient computing, ability of self-learning, perception of the real world, content generation. In order to achieve these goals, OPPO has reconstructed the hardware platform, operating system, and third-party service ecosystem of AI mobile phones, embedded AI agents and multi-modal interaction capabilities in the AI operating system, and integrated the services provided by third-party partners in a more flexible way.
OPPO is an important global partner of Google's Android platform. Through long-term cooperation, OPPO has established full confidence on Google's technology, and Google’s technologies such as Google Android and Google Cloud also bring OPPO a total solution. Google Cloud has a wealth of product technologies and solutions in AI. Many AI technologies, including large language models and AI model optimization, are world wide leading, making it an ideal partner for OPPO on AI phones. Google Cloud also treated the cooperation with OPPO in the highest priority, and invested a lot of resources to support the development of OPPO AI phone.
In order to launch the AI phone, OPPO has done a lot of preparation, and began working with Google Cloud on AI two years ago.
The AI collaboration between OPPO and Google Cloud began from OnePlus phone, where the OnePlus team built an AI model using Google Cloud's Vertex AI platform to analyze user feedback from the online community about the OnePlus phone. Previously, the product team manually analyzed and collated user feedback. By using AutoML, they developed and trained an AI model to analyze and categorize users’ feedback online in just 45 days, reduced human workload by 30% and allowed the product team to focus on core development works.
OPPO also worked with Google closely on AI and jointly build future capabilities to land AI technology on mobile phone. OPPO is the first in the industry to integrate hardware power consumption feedback into Google NAS, and optimized the algorithm based on chip characteristics, reduced the power consumption of object detection algorithms by 27% and the latency by 40%, resulting in a higher energy efficiency and hardware-friendly AI model in a shorter development time.
Through the cooperation of these two projects, OPPO team strengthened their confidence on Google Cloud’s AI technology. When OPPO was ready to launch its AI phone in the overseas market, it naturally chose Google Cloud as the partner.
In our day-to-day work, meeting minutes is a time-consuming labour work. Using Google Cloud's Gemini large language model, OPPO developed an AI Recording Summary feature which can automatically summarize meeting content based on audio recording. This function can be used in speeches, on-site meetings, multi-person conversations and other scenarios to record the content. It can also recognize the speaker according to the voice. This feature released people from labour work, and can greatly improve work efficiency.
OPPO has also developed some AI Toolbox features based on Gemini large language model, including AI Summary, AI Writer (generate content, change article style and polish existing writings, and more) and AI Reply, which are helpful for improving work efficiency. AI Summary can understand the article and generate a summary, eliminating the time and effort of human labour. AI Writer can help users spell check the article, and continue or expand the text accordingly based on user requirements. In social media apps, AI can automatically write social media posts based on the photos shared. AI Reply can generate different styles of replies in the IM apps.
In addition, OPPO has closely collaborated with Google on AI, giving priority to experience preview models, continuous feedback and iteration, and integrating the most advanced commercial model capabilities into OPPO applications. In the latest overseas flagship product OPPO Find X8 series, the AI Toolbox 2.0 and AI Summary functions have been upgraded. New AI capabilities have been introduced into functions such as Documents and Notes, and the new Gemini app and 'Circle to Search' feature will also bring users a smoother and smarter user experience in the new generation of products. This is an achievement from OPPO and Google's commitment to provide users with efficient AI experience.
OPPO team has achieved satisfactory results after using Gemini in AI mobile phone. They believe Gemini is very versatile, the dimensional consistency shown in multiple application domains is very good, and there is no need to fine-tune for specific domain, and the desired effect can be achieved through simple prompt adjustments. In addition, OPPO team were impressed by Gemini which supports 1 million tokens context length when they were evaluating all kinds of LLMs. It was an industry-leading metric at that time and had a great advantage for understanding the content of large documents. Considering other factors such as price, Gemini was chosen from the AI technologies evaluated and became the best choice for OPPO's AI mobile phone products at that time.
In 2024, OPPO set up an AI Center to consolidate resources on AI research and development. This improves OPPO‘s capability on AI technology and AI mobile phone development. In the coming years, OPPO will continue to work with Google to leverage Google's overall strengths from the Android kernel to cloud platform and AI technology to create more new features based on generative AI technology for users around the world. OPPO will work with global partners to create truly revolutionary and best AI phone experiences.
OPPO is a leading global smart device brand. Since the launch of its first mobile phone — “Smiley Face” — in 2008, OPPO has been in relentless pursuit of the perfect synergy of aesthetic satisfaction and innovative technology. Today, OPPO provides a wide range of smart devices spearheaded by the Find and Reno series. Beyond devices, OPPO also provides its users with ColorOS operating system and internet services. OPPO has footprints in more than 70 countries and regions, with more than 40,000 employees dedicated to creating a better life for customers around the world.
Industry: Media and Entertainment
Location: China
Products: Gemini, Vertex AI, AutoML, Vertex AI NAS
About Google Cloud partner—iKala
iKala is a Taiwanese digitalization and AI commerce solution provider founded in 2011. Its subsidiary iKala Cloud is a Google Cloud partner offering consultation services for cloud infrastructure, hybrid cloud solutions, machine learning, and marketing applications to help enterprises overcome challenges brought by digital transformation. The company has served more than 400 enterprise customers in Asia Pacific for their use of Google Cloud.