This guide describes the Stackdriver Logging agent, an application based on fluentd that runs on your Google Compute Engine and Amazon EC2 virtual machine (VM) instances. The agent streams logs from common third-party applications and system software to Stackdriver Logging. It is a best practice to install the agent on all your VM instances.
To install the agent, see Installing the Logging Agent.
The logging agent is compatible with the following environments.
Virtual machine instances
You can install the logging agent on the following kinds of VM instances. The instances must have external IP addresses:
Google Compute Engine instances. The logging agent sends the logs to each instance's associated project.
Amazon Elastic Compute Cloud (EC2) instances. The logging agent sends the logs to the AWS connector project for your Stackdriver account. Stackdriver creates this project for you when you connect your AWS account to a Stackdriver account.
The following VM instances support Stackdriver Logging using their own software, possibly including custom versions or configurations of the logging agent. Manually installing the Stackdriver Logging agent on them is not supported:
Google App Engine flexible environments.
Google Container Engine node instances. You can enable support for Stackdriver Logging on your new container clusters by selecting a checkbox.
The logging agent supports the following operating systems on compatible VM instances:
- Amazon Linux AMI
- CentOS 7 and 6
- Debian 8 "Jessie", Debian 7 "Wheezy", and Debian-7-backports
- Red Hat Enterprise Linux 7 and 6
- Ubuntu LTS 12.04 "Precise", LTS 14.04 "Trusty", 14.10 "Utopic", 15.04 "Vivid", 15.10 "Wiley", LTS 16.04 "Xenial"
- Windows Server 2008 R2, 2012 R2, and 2016
Third party and system logs
By default, the Stackdriver Logging agent is configured to stream logs included in the list of supported logs. You can configure the agent to stream additional logs.
Installing the logging agent
If you are ready to install the agent, see Installing the Stackdriver Logging Agent.
Getting the logging agent source code
The logging agent is installed by a script described in the installation instructions. You do not need the information in this section unless you want to customize the logging agent or you have other special needs.
The logging agent,
google-fluentd, is a modified version of the
fluentd log data collector.
google-fluentd is distributed in two separate packages:
- A package named
google-fluentdthat includes the core
fluentdprogram and an output plugin for the Stackdriver Logging API.
- A package named
google-fluentd-catch-all-config, which includes the configuration files for the agent and for the logs from various third-party software packages.
Here is where you can find the Stackdriver Logging agent software:
- The packaging scripts to create the
google-fluentdpackages are available as google-fluentd.
- The output plugin is packaged as a Ruby gem, and is included in the
google-fluentdpackage. It is also available separately as fluent-plugin-google-cloud.
- The source code is available as fluent-plugin-google-cloud and fluentd-catch-all-config.
- The original
fluentdpackage is fluentd on GitHub.