REST Resource: projects.locations.instances.forwarders.collectors

Resource: Collector

Collectors detail the configuration for a specific data type. NEXT TAG: 6

JSON representation 
{
  "name": string,
  "display_name": string,
  "config": {
    object (CollectorConfig)
  },
  "state": enum (State),
  "type": enum (Type)
}
Fields
name

string

Immutable. The resource ID of the Collector. Format: projects/{project}/locations/{location}/instances/{instance}/forwarders/{forwarder}/collectors/{collector}
display_name

string

User-specified collector name.
config

object (CollectorConfig)

Collector configuration settings.
state

enum (State)

Output only. State of the collector.
type

enum (Type)

Output only. Type of the collector.

CollectorConfig

CollectorConfig. Default configuration values will be applied during resource creation for the following fields when they are missing or zero-valued: - max_seconds_per_batch - max_bytes_per_batch NEXT TAG: 13

JSON representation 
{
  "log_type": string,
  "metadata": {
    object (ForwarderMetadata)
  },
  "regex_filters": [
    {
      object (RegexFilter)
    }
  ],
  "disk_buffer": {
    object (DiskBuffer)
  },
  "max_seconds_per_batch": integer,
  "max_bytes_per_batch": string,

  // Union field settings can be only one of the following:
  "file_settings": {
    object (FileSettings)
  },
  "kafka_settings": {
    object (KafkaSettings)
  },
  "pcap_settings": {
    object (PcapSettings)
  },
  "splunk_settings": {
    object (SplunkSettings)
  },
  "syslog_settings": {
    object (SyslogSettings)
  },
  "webproxy_settings": {
    object (WebProxySettings)
  }
  // End of list of possible types for union field settings.
}
Fields
log_type

string

Required. Type of logs collected.
metadata

object (ForwarderMetadata)

Metadata applied at the Collector level. This can be used in conjunction with, or take precedence over, Metadata applied at the Forwarder level. Refer to each Metadata field for further information.
regex_filters[]

object (RegexFilter)

Filters applied at the collector level, which can override filters defined at the Forwarder level.
disk_buffer

object (DiskBuffer)

Disk Buffering configuration at the collector level.
max_seconds_per_batch

integer

Maximum number of seconds between Forwarder batch uploads.
max_bytes_per_batch

string (int64 format)

Maximum number of bytes queued before Forwarder batch upload.
Union field settings. Ingestion settings of the collector. settings can be only one of the following:
file_settings

object (FileSettings)

File settings.
kafka_settings

object (KafkaSettings)

Kafka settings.
pcap_settings

object (PcapSettings)

PCAP settings.
splunk_settings

object (SplunkSettings)

Splunk settings.
syslog_settings

object (SyslogSettings)

Syslog settings.
webproxy_settings

object (WebProxySettings)

WebProxy settings.

FileSettings

FileSettings for a Collector. NEXT TAG: 2

JSON representation 
{
  "file_path": string
}
Fields
file_path

string

Path of file to monitor.

KafkaSettings

KafkaSettings for a Collector. Default configuration values will be applied during resource creation for the following fields when they are missing or zero-valued: - timeout NEXT TAG: 7

JSON representation 
{
  "authentication": {
    object (UsernamePasswordAuth)
  },
  "topic": string,
  "group_id": string,
  "timeout": string,
  "brokers": [
    string
  ],
  "tls_settings": {
    object (TLSSettings)
  }
}
Fields
authentication

object (UsernamePasswordAuth)

Username/Password for Kafka instance.
topic

string

Kafka Topic.
group_id

string

Kafka Group ID.
timeout

string (Duration format)

Kafka Timeout value, which will be truncated to seconds.

A duration in seconds with up to nine fractional digits, ending with 's'. Example: "3.5s".
brokers[]

string

Kafka Brokers.
tls_settings

object (TLSSettings)

TLS Settings.

UsernamePasswordAuth

Username/Password based authentication information.

JSON representation 
{
  "username": string,
  "password": string
}
Fields
username

string

Username of an identity used for authentication.
password

string

Password of the account identified by username.

TLSSettings

TLS Settings information for Collectors with TLS support (e.g. Kafka, Syslog)

JSON representation 
{
  "certificate": string,
  "certificate_key": string,
  "minimum_tls_version": string,
  "insecure_skip_verification": boolean
}
Fields
certificate

string

TLS Certificate.
certificate_key

string

TLS Certificate Key.
minimum_tls_version

string

Minimum TLS Version.
insecure_skip_verification

boolean

Disables SSL certification verification.

PcapSettings

PcapSettings for a Collector. NEXT TAG: 3

JSON representation 
{
  "network_interface": string,
  "berkeley_packet_filter": string
}
Fields
network_interface

string

Interface to listen for PCAP data.
berkeley_packet_filter

string

Berkeley Packet Filter (BPF) for PCAP handle.

SplunkSettings

SplunkSettings for a Collector. Default configuration values will be applied during resource creation for the following fields when they are missing or zero-valued: - minimum_window_size - maximum_window_size NEXT TAG: 9

JSON representation 
{
  "authentication": {
    object (UsernamePasswordAuth)
  },
  "host": string,
  "port": integer,
  "minimum_window_size": string,
  "maximum_window_size": string,
  "query_string": string,
  "query_mode": string,
  "cert_ignored": boolean
}
Fields
authentication

object (UsernamePasswordAuth)

Username/Password for Splunk instance.
host

string

Host or IP for Splunk instance REST API.
port

integer

Port associated with the Splunk instance, used with the host field.
minimum_window_size

string (Duration format)

Minimum time range, truncated to seconds, for the Splunk query.

A duration in seconds with up to nine fractional digits, ending with 's'. Example: "3.5s".
maximum_window_size

string (Duration format)

Maximum time range, truncated to seconds, for the Splunk query.

A duration in seconds with up to nine fractional digits, ending with 's'. Example: "3.5s".
query_string

string

Query used to filter records within Splunk.
query_mode

string

Query mode for Splunk. Currently, only a value of "realtime" is supported, For details about real-time searches in Splunk, please see the Splunk documentation.
cert_ignored

boolean

Ignore Certificate.

SyslogSettings

SyslogSettings for a Collector. Default configuration values will be applied during resource creation for the following fields when they are missing or zero-valued: - buffer_size - connection_timeout NEXT TAG: 7

JSON representation 
{
  "protocol": enum (Protocol),
  "address": string,
  "port": integer,
  "buffer_size": string,
  "connection_timeout": string,
  "tls_settings": {
    object (TLSSettings)
  }
}
Fields
protocol

enum (Protocol)

Syslog collector will listen using this protocol.
address

string

IP Address or Hostname (will be resolved to an IP) on which the Forwarder's syslog collector will listen.
port

integer

Port on which the Forwarder's syslog collector will listen.
buffer_size

string (int64 format)

Protocol Buffer Size.
connection_timeout

string (Duration format)

The time, truncated to seconds, after which TCP connections will drop-off after being inactive.

A duration in seconds with up to nine fractional digits, ending with 's'. Example: "3.5s".
tls_settings

object (TLSSettings)

TLS Settings.

Protocol

Protocol on which a syslog collector can listen.

Enums
PROTOCOL_UNSPECIFIED Attempting to set this default value will result in a validation error.
TCP Syslog collector will listen for data using TCP.
UDP Syslog collector will listen for data using UDP.

WebProxySettings

WebProxySettings for a Collector. NEXT TAG: 3

JSON representation 
{
  "network_interface": string,
  "berkeley_packet_filter": string
}
Fields
network_interface

string

Interface to listen for WebProxy data.
berkeley_packet_filter

string

Berkeley Packet Filter (BPF) for WebProxy handle.

DiskBuffer

DiskBuffering configuration applied at the collector level. NEXT TAG: 4

JSON representation 
{
  "enabled": boolean,
  "directory_path": string,
  "max_file_buffer_bytes": string
}
Fields
enabled

boolean

Describes whether disk buffering is enabled on the collector.
directory_path

string

Directory path for files written.
max_file_buffer_bytes

string (int64 format)

Maximum Buffered File Size.

State

States of a collector.

Enums
STATE_UNSPECIFIED The default value. This value is used if the state is omitted.
ACTIVE Collector is allowed to accept data.
SUSPENDED Collector is not allowed to accept data.

Type

Collector type.

Enums
TYPE_UNSPECIFIED Default/Unset value.
FILE File input.
KAFKA Kafka input.
PCAP Pcap input.
SPLUNK Splunk input.
WEBPROXY Webproxy input.
SYSLOG Syslog input.

Methods

create

 Create a collector.

delete

 Delete a collector by collector ID.

get

 Get a collector by collector ID.

list

 List all collectors for the forwarder.

patch

 Update a collector.