Class SoftwareConfig (3.3.1)

SoftwareConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Specifies the selection and config of software inside the cluster.

Attributes

NameDescription
image_version str
Optional. The version of software inside the cluster. It must be one of the supported `Dataproc Versions
properties Sequence[google.cloud.dataproc_v1.types.SoftwareConfig.PropertiesEntry]
Optional. The properties to set on daemon config files. Property keys are specified in ``prefix:property`` format, for example ``core:hadoop.tmp.dir``. The following are supported prefixes and their mappings: - capacity-scheduler: ``capacity-scheduler.xml`` - core: ``core-site.xml`` - distcp: ``distcp-default.xml`` - hdfs: ``hdfs-site.xml`` - hive: ``hive-site.xml`` - mapred: ``mapred-site.xml`` - pig: ``pig.properties`` - spark: ``spark-defaults.conf`` - yarn: ``yarn-site.xml`` For more information, see `Cluster properties
optional_components Sequence[google.cloud.dataproc_v1.types.Component]
Optional. The set of components to activate on the cluster.

Inheritance

builtins.object > proto.message.Message > SoftwareConfig

Classes

PropertiesEntry

PropertiesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The abstract base class for a message.

Parameters
NameDescription
kwargs dict

Keys and values corresponding to the fields of the message.

mapping Union[dict, `.Message`]

A dictionary or message to be used to determine the values for this message.

ignore_unknown_fields Optional(bool)

If True, do not raise errors for unknown fields. Only applied if mapping is a mapping type or there are keyword parameters.