Redis

Redis is an open source advanced key-value store. It is often referred to as a data-structure server since values can contain strings, hashes, lists, sets and sorted sets. For more information, visit redis.io.

Prerequisites

To collect and ingest Redis telemetry, you must install Ops Agent version 2.7.0 or higher.

Configure the Ops Agent for Redis

Following the guide for Configuring the Ops Agent, add the required elements to collect logs from your Redis instances, and restart the agent.

Example configuration

The following command creates the configuration file to collect and ingest logs for Redis and restarts the Ops Agent on Linux.

sudo tee /etc/google-cloud-ops-agent/config.yaml > /dev/null << EOF
logging:
  receivers:
    redis:
      type: redis
  service:
    pipelines:
      redis:
        receivers:
        - redis
metrics:
  receivers:
    redis:
      type: redis
      endpoint: localhost:6379
      collection_interval: 60s
      password: Strong_Password123
  service:
    pipelines:
      redis:
        receivers:
        - redis
EOF
sudo service google-cloud-ops-agent restart

Configure logs collection

To ingest logs from Redis, you must create receivers for the logs Redis produces and then create a pipeline for the new receivers. To configure a receiver for your redis logs, specify the following fields:

Field Default Description
type This value must be redis.
include_paths [/var/log/redis/redis-server.log, /var/log/redis_6379.log, /var/log/redis/redis.log, /var/log/redis/default.log, /var/log/redis/redis_6379.log] A list of filesystem paths to read by tailing each file. A wild card (*) can be used in the paths; for example, /var/log/redis/*.log.
exclude_paths [] A list of filesystem path patterns to exclude from the set matched by include_paths.

What is logged

Redis logs contain the following fields in the LogEntry:

Field Type Description
jsonPayload.roleChar string Redis role character (X, C, S, M)
jsonPayload.role string Translated from Redis role character (sentinel, RDB/AOF_writing_child, slave, master)
jsonPayload.level string Log entry level
jsonPayload.pid number Process ID
jsonPayload.message string Log message
severity string (LogSeverity) Log entry level (translated)
timestamp string (Timestamp) Time the entry was logged

Configure metrics collection

To collect metrics from Redis, you must create a receiver for Redis metrics and then create a pipeline for the new receiver. To configure a receiver for your Redis metrics, specify the following fields:

Field Default Description
type This value must be redis.
address localhost:6379 The URL exposed by Redis.
collection_interval 60s A time.Duration value, such as 30s or 5m.
password The password used to connect to the server.

What is monitored

The following table provides the list of metrics that the Ops Agent collects from the Redis instance.

Metric type 
Kind, Type
Monitored resources
Labels
workload.googleapis.com/redis.clients.blocked
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.clients.connected
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.clients.max_input_buffer
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.clients.max_output_buffer
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.commands.processed
CUMULATIVEINT64
gce_instance
 
workload.googleapis.com/redis.connections.received
CUMULATIVEINT64
gce_instance
 
workload.googleapis.com/redis.connections.rejected
CUMULATIVEINT64
gce_instance
 
workload.googleapis.com/redis.cpu.time
CUMULATIVEDOUBLE
gce_instance
state
workload.googleapis.com/redis.keys.evicted
CUMULATIVEINT64
gce_instance
 
workload.googleapis.com/redis.keys.expired
CUMULATIVEINT64
gce_instance
 
workload.googleapis.com/redis.keyspace.hits
CUMULATIVEINT64
gce_instance
 
workload.googleapis.com/redis.keyspace.misses
CUMULATIVEINT64
gce_instance
 
workload.googleapis.com/redis.latest_fork
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.memory.fragmentation_ratio
GAUGEDOUBLE
gce_instance
 
workload.googleapis.com/redis.memory.lua
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.memory.peak
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.memory.rss
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.memory.used
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.net.input
CUMULATIVEINT64
gce_instance
 
workload.googleapis.com/redis.net.output
CUMULATIVEINT64
gce_instance
 
workload.googleapis.com/redis.rdb.changes_since_last_save
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.replication.backlog_first_byte_offset
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.replication.offset
GAUGEINT64
gce_instance
 
workload.googleapis.com/redis.slaves.connected
GAUGEINT64
gce_instance
 

Verify the configuration

You can use the Logs Explorer and Metrics Explorer to verify that you correctly configured the Redis receiver. It might take one or two minutes for the Ops agent to begin collecting logs and metrics.

To verify the logs are ingested, go to the Logs Explorer and run the following query to view the Redis logs:

resource.type="gce_instance"
logName=("projects/PROJECT_ID/logs/redis")


To verify the metrics are ingested, go to Metrics Explorer and run the following query in the MQL tab.

fetch gce_instance
| metric 'workload.googleapis.com/redis.connections.received'
| align rate(1m)
| every 1m