Gains reliable, scalable architecture with migration to Google Cloud
Enables data-driven insights about product development and customer targeting with BigQuery
Achieves simple, seamless migration to Cloud SQL with Database Migration Service
Frees engineers to focus on product innovation thanks to Google Cloud managed services
Smartproxy's on-premise infrastructure couldn't keep pace with growth due to downtime risks and maintenance. Migrating to Google Cloud provided a stable, scalable infrastructure for growth and data insights.
With an expected annual growth rate of 9.49% from 2024-29, the global ecommerce market is booming. To keep pace with this growth–and stay ahead of the competition–retailers and marketers are making increasingly sophisticated use of market data to understand their customers and make decisions that give them the edge in a crowded marketplace. However, with blocking and geo-fencing technologies making vast amounts of public data inaccessible, companies can find it hard to gather the data they need. That’s where Smartproxy comes in.
Now running on Google Cloud, Smartproxy’s ready-made data-scraping and proxy-management tools help customers to gather accurate, public data–such as information on pricing, competitor activity, and market trends–from thousands of websites all over the world, at scale. As Smartproxy CEO Vytautas Savickas explains, “Smartproxy’s goal is to create a frictionless experience to allow customers to get to that ‘aha!’ moment as quickly as possible.”
With its systems previously running on virtual machines in on-premise data centers, Smartproxy had to spend a significant amount of time maintaining its infrastructure. Upgrades, security patches, and installations all took Smartproxy engineers away from the important work of developing products and services.
On-premise hardware also requires a lot of provisioning time, meaning Smartproxy needed to plan ahead when it wanted to scale up its infrastructure to meet growing demand. And because it was unable to quickly scale its infrastructure back down again during low demand, it needed to keep its servers running, which meant it was left paying for resources it didn’t need.
Reliability was another challenge. Smartproxy’s on-premise infrastructure had no redundancy, so if a machine encountered an issue, it could affect part of the application, potentially leading to disruptions in service for customers. Smartproxy needed a robust infrastructure to deliver the reliable service its customers expected, with the flexibility to innovate quickly in a market where techniques and regulations are constantly changing. It turned to Google Cloud.
The main driver was time efficiency. With Google Cloud managed services, our engineers can save time as they no longer need to configure the infrastructure and servers themselves. And with built-in redundancy, auto scaling, and security, Google Cloud works out of the box.
Justinas Tamaševičius
Head of Engineering, Smartproxy
Smartproxy began its migration to Google Cloud in 2022. With Google Kubernetes Engine (GKE) as the backbone of its infrastructure, Smartproxy now has a reliable system with built-in redundancy, meaning that if one of its instances fails, it can switch traffic to another instance, with no impact on the availability of its services for its customers.
Smartproxy’s product development pipeline has become smoother, too. The company is adding automated tests to its continuous integration pipelines, using blue-green deployments to ensure that if anything goes wrong, it will automatically revert to the previous version. This allows Smartproxy to release new features more safely. And because GKE is a managed service, there is no need for Smartproxy’s engineers to spend valuable time maintaining, provisioning, and updating its servers, while the reduction in downtime means customers benefit from a higher availability of services.
“With Google Cloud, we have a more stable system,” says Justinas Tamaševičius, Head of Engineering at Smartproxy. “That’s good for our developers and it's good for our customers too because it means they can use our services without crashes.”
At the same time, Smartproxy can control its cloud expenditure more effectively as GKE is more cost efficient than its previous on-premise architecture. Its autoscaling feature allows Smartproxy to automatically scale its resources up and down to meet the peaks and troughs in demand, meaning the company only ever pays for what it uses.
As a company that enables businesses to use data, it’s imperative that Smartproxy can make data-driven decisions of its own. With BigQuery, Smartproxy can do just that.
Smartproxy uses insights gained from BigQuery to improve its services for its customers. The company uses A/B testing to understand how customers use its products and services. That data is fed into BigQuery and combined with other customer data to show the development team which variants of products and features perform better, allowing them to improve their services accordingly. For example, Smartproxy recently refreshed the user interface for its main product configuration page, feeding the data from a series of tests into BigQuery to generate insights that enabled the company to hone the interface in the most user-friendly way.
BigQuery is our data warehouse for data insights and analysis. We integrate with Google Ads, Google Analytics, Google Search Console, and some external tools like PostHog. It’s become our single source for all marketing and operational insights.
Justinas Tamaševičius
Head of Engineering, Smartproxy
BigQuery also helps the Smartproxy marketing team understand how its campaigns are performing and optimize them accordingly. With BigQuery, Smartproxy can gain insights on a wide range of key metrics such as conversion rates, cost-per-acquisition, and lifetime value of customers to understand the efficiency of their marketing spend and make strategic decisions around customer targeting and campaign performance. The marketing team also uses Looker Studio in combination with BigQuery to generate user-friendly reports and graphs to track the performance of campaigns and report back to stakeholders across the business.
When Smartproxy migrated its infrastructure to Google Cloud, it knew it would experience latency in its systems for as long as its relational database remained on premise. Smartproxy decided to migrate its relational database to Cloud SQL, but with the database handling all the company’s application and user data, the company needed to handle the migration in the safest possible way to minimize downtime.
With the Database Migration Service from Google Cloud, Smartproxy simplified the migration, with continuous data replication allowing it to keep its databases in sync to ensure a smooth transition with minimal disruption to services.
With its relational database now in the cloud with Cloud SQL, Smartproxy’s services operate with low latency once more. The fact that the database is managed by Google Cloud also means downtime is minimized for users, while Smartproxy engineers save time they used to spend maintaining its on-premise database.
“Google Cloud enables us to focus on delivering business value. It has helped to accelerate our development times, because our engineers and developers are free to work on developing and deploying new user features instead of managing our infrastructure,” explains Tamaševičius.
With its migration to Google Cloud complete, Smartproxy is now laser focused on growing the business, with the goal of becoming the leading web data-gathering platform, while ensuring it’s always able to provide the right tool for its customers’ needs. For Savickas, that depends on the company’s ability to innovate quickly, which depends in turn on using the right technology. “If we need to adapt, to innovate, or to change something, we don't want our technology to hold us back,” says Savickas. “The technology we use is there to support us, and that’s exactly what Google Cloud does: it supports us in getting where we want to go.”
If we need to adapt, to innovate, or to change something, we don't want our technology to hold us back. The technology we use is there to support us, and that’s exactly what Google Cloud does: it supports us in getting where we want to go.
Vytautas Savickas
CEO, Smartproxy
Smartproxy is a customer-obsessed web data-gathering platform, enabling everyone–Fortune 500 companies and solopreneurs–to unlock public web data worldwide. With a focus on exceptional proxy performance, innovative data-gathering solutions, and dedicated experts per every client, they strive to deliver superior data collection experience. Trusted by 50K+ clientele, recognized for the Best Value, Happiest Users and Quality Choice, Smartproxy is on a mission to take the lead on the data-as-a-service market.
Industry: Technology
Location: Lithuania
Products: Google Kubernetes Engine, BigQuery, Cloud SQL, Database Migration Service, Google Ads, Google Analytics, Looker Studio