https://www.gstatic.com/bricks/image/073fd7ac-e7f4-4328-b8b4-d0be3ac802e5.png

Sound Particles: Creating a 3D audio solution on Google Cloud and tuning up the future of entertainment

Google Cloud Results
  • Enhanced performance: Google Cloud reduced simulation runtime from 100 hours to two seconds, boosting speed and efficiency

  • Scalability and reliability: The binaural solution can handle increasing user demand across major entertainment platforms without compromising performance

  • Cost-effectiveness: The solution is affordable to millions of users because it's cloud-based rather than in-house

  • Accelerated development: Google for Startups Cloud Program expedited product research and sped up market entry for Sound Particles

  • Competitive advantage: This cutting-edge AI-powered binaural solution sets Sound Particles as a leader in the entertainment industry

Sound Particles, an audio technology innovator, created the industry’s first AI-powered binaural audio solution, disrupting the entertainment industry after being granted access to the Google for Startups Cloud Program.

The challenge of immersive audio experiences

An immersive and personalized audio experience in cinema, TV, games, and VR sounded far-fetched, until Sound Particles arrived. Founded in 2016 by former university professor Nuno Fonseca, this innovative Portuguese startup didn’t just take the sound workflows to the next level, they decided to go further and win the game. 

Sound Particles has already succeeded in the entertainment industry by developing a software that applies CGI principles to create complex sounds. This approach has been adopted by renowned musicians, AAA game studios, and major Hollywood studios, powering blockbusters like Indiana Jones, Oppenheimer, Mission Impossible, Dune, and Star Wars IX. However, they wanted to tackle a more ambitious challenge. An idea that first was dismissed as a fantasy. 

In a context where the entertainment industry is shifting toward spatial sound, is it really possible to deliver a truly 3D audio experience to users who don’t have high-end speaker set ups

Although over 100 PhD theses backup the science behind binaural audio, all existing solutions on the market fall short. Moreover, each individual’s unique ears, head, and shoulder shape influences how they perceive sounds. Therefore, personalization is mandatory for an authentic 3D audio experience over headphones.

To bring this vision to life, Sound Particles conducted thousands of acoustic simulations over five years, each demanding high-performance servers due to its complex physics and mathematics. But they weren’t alone: on November 23, 2022, Sound Particles joined the Google for Startups Cloud Program. With the support of the program, they began a supercharged product research to develop a binaural solution to offer the quality of 10+ speakers audio in any headphone and audio format. Now, Sound Particles is on track to redefine the future of audio with a powerful and scalable infrastructure capable of modeling individual listener profiles on a global scale.

The Binaural project is by far the most technical, most demanding CPU kind of work, and most complex problem that we’ve faced. Google Cloud was the natural choice due to its high-quality data management, AI, and Machine Learning tools available around the world.

Rui Rijo

COO of Sound Particles

Google's funding, technology, and expertise were crucial to the success of our project to bring spatial sound to everyone on the planet.

Rui Rijo

COO of Sound Particles

Sound Particles banner

Hitting all the right notes with Google Cloud

After the company joined the Google for Startups Cloud Program, one of the first things that changed was the simulation time. In order to replace the complex math simulations, which were not scalable for real-world scenarios, and to provide a high quality solution, independent of device and audio format, Sound Particles turned to AI. By leveraging Google Cloud's infrastructure, the creation of a dataset decreased from 100 hours to just two seconds.

“But it's not only the technical side. The most important thing is that every time I talk to someone at Google Cloud, they are really rooting for the success of the company,” says Nuno Fonseca, CEO & Founder of Sound Particles. Despite the solution’s specific design and tuning requirements, Google Cloud's senior engineers collaborated closely with the Sound Particles team throughout the development process. Additionally, Google Cloud's business professionals played a key role in shaping the market and business aspects of the solution, enabling them to connect with potential major customers. “Without the Google for Startups Cloud Program, all this research would not have been possible. All the training, support capabilities, and networking offered were a fundamental force to develop this unique deep-tech solution,” continues Fonseca. 

While the solution is still in the go-to-market phase (it’s not available to the public yet), the feedback so far has been outstandingly positive. Beyond outperforming competitors, this AI-powered personalized binaural solution significantly enhances the user audio experience, driving increased engagement with entertainment. Additionally, it empowers users of all digital proficiency levels to be able to take their smartphones and personalize their audio experience, obtaining the best 3D sound over headphones with ease. And most importantly: as Sound Particles aims to provide a binaural solution accessible to everyone worldwide, regardless of headphone model or audio format, affordability is crucial. By using Google Cloud, the Portuguese startup reduced costs compared to maintaining an in-house infrastructure.

Furthermore, in a fast-paced world where every microsecond matters and demand for immersive and interactive experiences grows, maintaining a seamless workflow and fast response times are essential for delivering exceptional customer experiences. Scalability and reliability are therefore paramount for this 3D personalized audio solution. With Google Cloud’s infrastructure, Sound Particle’s solution can handle increased user demand without compromising performance, ensuring it remains at the forefront of entertainment. As Fonseca explains, "Sound Particles is building a future-proof, scalable solution capable of supporting millions of users. With Google Cloud, we're confident that our binaural audio technology can be deployed across major streaming platforms and beyond.”

What began as a 2019 initiative centered around Google Workspace Suite has now evolved into a more ambitious undertaking: leveraging Google Cloud technology to solve complex problems. By overcoming these challenges, Sound Particles is now ready to release a solution that will empower users across diverse sectors, from streaming giants to gaming platforms, to transform ordinary headphones into immersive 3D audio portals.

Our solution leverages a combination of artificial intelligence (AI) through machine learning (ML), computer vision, signal processing, and other cutting-edge technologies. This would have been unattainable without the tools, infrastructure, and technical and business support provided by Google Cloud.

Nuno Fonseca

CEO/Founder of Sound Particles

Google has been an exceptional partner throughout our journey, and they really care about the success of our company, willing to help us not only with the technical side, but also in other areas. And this support is fantastic for any company, especially startups.

Nuno Fonseca

CEO/Founder of Sound Particles

Sound Particles is a technology company specializing in innovative 3D audio software and tools for sound design and audio post-production. They provide solutions that allow creators to craft immersive soundscapes for films, TV, gaming, and virtual reality using advanced spatial audio techniques.

Industry: Technology

Location: Portugal

Products: Google Cloud, Google Workspace