Virgin Media O2 logo

Virgin Media O2: Completing monumental data migration journey to Google Cloud

Google Cloud Results
  • On track to complete six large-scale migrations in five years

  • Increased data capacity by 400% by migrating mobile network data pipelines to BigQuery

Virgin Media O2 began a five-year Google Cloud migration post-merger to unify data and improve business and customer experiences.

Our legacy on-premises infrastructure lacked agility, which impacted time to market and created data siloes. Expensive infrastructure updates and higher licensing costs also increased our total cost of ownership. We needed to consolidate our data on one platform to optimize costs, performance, and customer experience.

Vinay Pai

Head of Data Architecture, Virgin Media O2

When Virgin Media and O2 merged in 2021, two of the UK's most iconic brands came together to deliver exceptional connectivity and digital services to 45.8 million broadband, mobile, phone, and home subscribers. However, the union also created a vast and complex data infrastructure, including multiple on-premises data warehouses and data lakes, which led to significant challenges in terms of scalability, performance, and cost.

"Our legacy on-premises infrastructure lacked agility, which impacted time to market and created data siloes," says Vinay Pai, Head of Data Architecture at Virgin Media O2 (VMO2). "Expensive infrastructure updates and higher licensing costs also increased our total cost of ownership (TCO). We needed to consolidate our data on one platform to optimize costs, performance, and customer experience."

VMO2 embarked on a five-year journey to migrate its entire infrastructure to Google Cloud.

Chosen for its serverless and scalable infrastructure, advanced AI capabilities, and data analytics tools such as BigQuery, strong security and compliance, and commitment to sustainability, Google Cloud has helped VMO2 rapidly adapt to changing business needs while protecting sensitive customer data.

Bringing Virgin Media's infrastructure up to speed with Google Cloud

In 2020, prior to merging with O2, Virgin Media began the first stage of its platform modernization journey by migrating away from its legacy Hadoop platform, which was used primarily for high-volume processing of TV viewing and network data analytics. Hosted on-premises on Hortonworks, this system caused scalability and performance issues, preventing analytics teams from running queries efficiently.

"We wanted to move away from an infrastructure-as-a-service model into a cloud environment with managed services and serverless capabilities," Pai says. "That way, we could focus our efforts on building business solutions rather than managing infrastructure."

Partnering with Google Cloud for its expertise in data and analytics and its open-source technologies, Virgin Media started by mapping its existing architecture onto equivalent capabilities in Google Cloud, primarily BigQuery for data storage and processing and Dataproc for data lake modernization.

We wanted to move away from an infrastructure-as-a-service model into a cloud environment with managed services and serverless capabilities. That way, we could focus our efforts on building business solutions rather than managing infrastructure.

Vinay Pai

Head of Data Architecture, Virgin Media O2

The team completed the migration in 18 months, wrapping up before legacy licenses were due for renewal, and achieved its goals to increase efficiency and add value to its operations.

Taking learnings from its first migration, Virgin Media then turned its attention to its legacy Netezza data warehouse, which hosted both fixed-line and mobile business data. This complex ecosystem had been built over 15 years and had reached its capacity limit, requiring a significant overhaul to migrate to Google Cloud. To address the immediate need for data accessibility, VMO2 implemented tactical data ingestion solutions while simultaneously working on a long-term cloud-native architecture.

This two-year migration project successfully decommissioned the on-premises platform and enabled VMO2's digital team to consume data in a unified ecosystem. This helped accelerate data analytics and enabled the development of new data products, such as pricing models and unified customer communications.

Merging complex data architecture into one platform

BigQuery and Dataflow enable us to analyze data at a granular level, providing valuable insights into customer behavior and preferences. These real-time insights empower us to optimize network performance, maintain compliance with contractual obligations, improve customer experiences, and identify emerging trends.

Chandu Bhuman

Senior Manager, Data Engineering, Virgin Media O2

Following the merger, VMO2 began migrating the former O2's Teradata data warehouse to Google Cloud in 2022. By moving to Teradata Vantage™ on Google Cloud, VMO2 aimed to improve data accessibility and accelerate the company's overall cloud migration.

"One of the key challenges faced in this migration was establishing connectivity between the on-premises integration tools and the Teradata Vantage platform," Pai explains. "This had to be completed in a short span of time, and Google Cloud made it possible."

Next, in 2023, the company began another large Hadoop migration of mobile network data that included Mobility Management Entity and weblogs data processing pipelines, which account for about 70% of the entire cluster's utilization. By migrating these pipelines to BigQuery and Dataflow, VMO2 increased its data capacity by 400% while reducing TCO by 30%.

"BigQuery and Dataflow enable us to analyze data at a granular level, providing valuable insights into customer behavior and preferences," says Chandu Bhuman, Senior Manager, Data Engineering at Virgin Media O2. "These real-time insights empower us to optimize network performance, maintain compliance with contractual obligations, improve customer experiences, and identify emerging trends."

That same year, VMO2 performed a two-step migration of O2's complex data warehouse platform built on Hadoop. The team first took a lift-and-shift approach to accelerate the journey to cloud adoption and make it easier to consume data for various downstream applications.

VMO2 pushed forward with the second step of migration in 2024, aiming to fully embrace cloud-native architecture. This involved transitioning from managing infrastructure to leveraging managed services and serverless functions from Google Cloud. Set to be completed in 2025, this will enable VMO2 to streamline operations, reduce costs, and improve scalability and flexibility, ultimately leading to a more integrated and efficient data environment. VMO2 has already started leveraging BigQuery's data sharing capabilities to streamline data sharing across departments and make data sharing across the company safe, secure, and self-service.

"Although the previous migration had moved us to Google Cloud, we were still operating as an Infrastructure as a Service model and running Hadoop services on top," Pai explains. "This next stage moves us toward a complete cloud-native architecture, integrating all data in one place."

Reducing total cost of ownership by consolidating on Google Cloud

Over a period of five years, VMO2 has transformed from multiple large-scale technology stacks into a single consistent platform, delivering a robust, scalable, and secure data management framework that serves all critical business operations. By moving all key functions to Google Cloud, VMO2 has reduced its TCO for equivalent on-premises platforms by approximately 30%.

"By bringing all raw data into BigQuery and using it to create both data lake and data warehouse, we have significantly simplified the architecture as well as reduced data siloes," Pai says. This multi-phase endeavor has also accelerated the company's development and deployment timelines compared to legacy platforms. BigQuery has unlocked unprecedented scalability and flexibility for VMO2, improving data platform availability and uptime, which ultimately enhances customer experience.

Data is indispensable for driving innovation, shaping our strategies, and ensuring business performance. With BigQuery at the core of our infrastructure, we have the unified data we need to fuel our analytical products, inform customer insights, and power operational decisions.

Vinay Pai

Head of Data Architecture, Virgin Media O2

"Data is indispensable for driving innovation, shaping our strategies, and ensuring business performance," Pai says. "With BigQuery at the core of our infrastructure, we have the unified data we need to fuel our analytical products, inform customer insights, and power operational decisions."

Virgin Media O2 combines the UK's largest and most reliable mobile network with a broadband network offering the fastest widely-available broadband speeds.

Industry: Technology

Location: United Kingdom

Products: BigQuery, Dataproc, Dataflow, Cloud Run functions, Cloud Run, Cloud Storage, Google Kubernetes Engine, Memorystore for Redis

Google Cloud