SoftwareConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)Specifies the selection and config of software inside the cluster.
Attributes | |
|---|---|
| Name | Description |
image_version |
str
Optional. The version of software inside the cluster. It must be one of the supported `Dataproc Versions |
properties |
Sequence[google.cloud.dataproc_v1.types.SoftwareConfig.PropertiesEntry]
Optional. The properties to set on daemon config files. Property keys are specified in prefix:property format,
for example core:hadoop.tmp.dir. The following are
supported prefixes and their mappings:
- capacity-scheduler: capacity-scheduler.xml
- core: core-site.xml
- distcp: distcp-default.xml
- hdfs: hdfs-site.xml
- hive: hive-site.xml
- mapred: mapred-site.xml
- pig: pig.properties
- spark: spark-defaults.conf
- yarn: yarn-site.xml
For more information, see `Cluster
properties |
optional_components |
Sequence[google.cloud.dataproc_v1.types.Component]
Optional. The set of components to activate on the cluster. |
Classes
PropertiesEntry
PropertiesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)The abstract base class for a message.
| Parameters | |
|---|---|
| Name | Description |
kwargs |
dict
Keys and values corresponding to the fields of the message. |
mapping |
Union[dict,
A dictionary or message to be used to determine the values for this message. |
ignore_unknown_fields |
Optional(bool)
If True, do not raise errors for unknown fields. Only applied if |