Jump to Content
Containers & Kubernetes

How to improve your Kubernetes security posture with GKE Dataplane V2 network policies

March 3, 2023
Bon Sethi

Strategic Cloud Architect

Try Google Cloud

Start building on Google Cloud with $300 in free credits and 20+ always free products.

Free trial

As more organizations adopt Kubernetes, they also embrace new paradigms for connecting and protecting their workloads. Relying on perimeter defense alone is no longer an effective strategy. With microservice architecture patterns continuing to evolve rapidly, it is imperative that organizations adopt a defense-in-depth strategy to keep their applications and data protected. 

To effectively manage a highly distributed and dynamic system, with an abundance of exposed ports and APIs, organizations need more than traditional network-perimeter firewalls. With a myriad of connections between microservices, a rogue actor could use a compromised container instance to move laterally through the network to attack others, leading to cascading failures and significant data loss. 

Fortunately for those running their microservices on GKE and Anthos, there is GKE Dataplane V2 that provides consistent network policy enforcement, logging, and monitoring without having to install any third-party software add-ons. 

GKE Dataplane V2: the what and how

GKE Dataplane V2 integrates eBPF (extended Berkeley Packet Filter) – a capability that allows applications to execute code in the Linux Kernel space without any changes to the kernel source code or loading a module. By safely extending the capabilities of the kernel, eBPF allows regular user-space applications to package the logic to be executed within the Linux kernel, as bytecode.*. eBPF is a groundbreaking technology that offers several advantages:

  • Performance - eBPF programs are executed in the kernel, making them much faster than user-space programs.

  • Security - eBPF programs are sandboxed which ensures the underlying kernel source code remains protected and unchanged. 

  • Extensible - eBPF is a powerful tool that can be used to create new features and functionality that would not be possible with traditional kernel programming techniques.

GKE Dataplane V2 harnesses the power of eBPF and Cilium (an open-source project based on eBPF) to flexibly and performantly process network packets in-kernel leveraging Kubernetes-specific metadata. With GKE Dataplane V2, eBPF programs in the Kernel are able to route and process packets arriving at a GKE node without relying on kube-proxy and iptables for service routing, resulting in significant network performance improvements. GKE Dataplane V2 also helps improve your cluster(s) security posture with built-in Network Policy enforcement and real-time visibility of network activity.  Network packets are processed in the kernel and annotated actions are reported back to the user-space for logging. 

(You can enable GKE Dataplane V2 when you create new clusters with GKE version 1.20.6-gke.700 and later. See availability here. GKE Autopilot clusters created with version 1.23.4-gke.1500 and above (and in minor version 1.22, after patch 1.22.7-gke.1500) have Dataplane V2 enabled by default.)

Let's take a look at an example of how we can use network policies in GKE Dataplane V2 to control which Pods receive incoming traffic. By allowing you to limit connections between pods, network policies reduce the blast radius and provide enhanced security. To begin with, we create a GKE cluster with Dataplane V2 enabled using the following command:

Loading...

Clone the GCP repo here and kubectl apply the manifests.  Upon running

Loading...

you will notice a redis-cluster service running in your cluster.

https://storage.googleapis.com/gweb-cloudblog-publish/images/Image_1.max-800x800.jpg
Diagram 1: Current state of your GKE cluster

Next we’ll demonstrate how a rogue actor gains access to our cluster and launches another redis container image to steal our data and disrupt the service.

Loading...

From the rogue container’s prompt, run

Loading...

The response should come back as

Loading...

which confirms that the rogue actor could illegitimately access our service and data.

https://storage.googleapis.com/gweb-cloudblog-publish/images/Image_2_ovmBjoP.max-800x800.jpg
Diagram 2: GKE cluster with rogue container that can access redis service

Next we configure a NetworkPolicy to allow traffic to redis-service pods only from the backend pods. All other incoming traffic to redis pods should get blocked.

Loading...

Next, we apply the above NetworkPolicy to the cluster.

Loading...

Now make the same request again from the rogue container’s prompt

Loading...

You’ll notice that the above request hangs. Exit from the shell.

This diagram below shows the effect of the redis-allow-from-backend policy on two connections to redis-cluster service. The network policy only allows the connection(s) from backend pods. All other incoming requests to the redis-cluster service are denied since no network policy allows such requests.
https://storage.googleapis.com/gweb-cloudblog-publish/images/Image_3.max-800x800.jpg
Diagram 3: GKE cluster with Dataplane V2 Network Policy applied

Now, even though with NetworkPolicy enforcement, the rogue actor was unable to access our data, they could still be silently probing our cluster. Besides preventing unauthorized access, we must also log such activities for alerting and analysis. GKE creates a NetworkLogging object by default in new Dataplane V2 clusters. We can configure network logging settings by editing the NetworkLogging object in our cluster. Using our example above, to log all denied connections, we run

Loading...

Network policy logs are automatically uploaded to Cloud Logging where we can search and analyze our network traffic to spot any malicious or unauthorized network activity (and set up alerts for quick action). 

Conclusion

GKE Dataplane V2 optimizes your cluster networking and provides an easy way to connect and protect your workloads. With network policy enforcement and logging built-in, without relying on any third-party software add-ons, GKE Dataplane V2 enables you to easily secure your network without compromising on innovation. 

Learn more:

Posted in