Class SparkSqlJob (2.5.0)

SparkSqlJob(mapping=None, *, ignore_unknown_fields=False, **kwargs)

A Dataproc job for running Apache Spark SQL <http://spark.apache.org/sql/>__ queries.

Attributes
Name	Description
`query_file_uri`	`str` The HCFS URI of the script that contains SQL queries.
`query_list`	`google.cloud.dataproc_v1.types.QueryList` A list of queries.
`script_variables`	`Sequence[google.cloud.dataproc_v1.types.SparkSqlJob.ScriptVariablesEntry]` Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET `name="value";`).
`properties`	`Sequence[google.cloud.dataproc_v1.types.SparkSqlJob.PropertiesEntry]` Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
`jar_file_uris`	`Sequence[str]` Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
`logging_config`	`google.cloud.dataproc_v1.types.LoggingConfig` Optional. The runtime log config for job execution.

Classes

PropertiesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The abstract base class for a message.

Parameters
Name	Description
`kwargs`	`dict` Keys and values corresponding to the fields of the message.
`mapping`	`Union[dict, .Message]` A dictionary or message to be used to determine the values for this message.
`ignore_unknown_fields`	`Optional(bool)` If True, do not raise errors for unknown fields. Only applied if `mapping` is a mapping type or there are keyword parameters.

ScriptVariablesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The abstract base class for a message.

Parameters
Name	Description
`kwargs`	`dict` Keys and values corresponding to the fields of the message.
`mapping`	`Union[dict, .Message]` A dictionary or message to be used to determine the values for this message.
`ignore_unknown_fields`	`Optional(bool)` If True, do not raise errors for unknown fields. Only applied if `mapping` is a mapping type or there are keyword parameters.