SparkSqlJob(mapping=None, *, ignore_unknown_fields=False, **kwargs)A Dataproc job for running Apache Spark
SQL <http://spark.apache.org/sql/>__ queries.
Attributes | |
|---|---|
| Name | Description |
query_file_uri |
str
The HCFS URI of the script that contains SQL queries. |
query_list |
google.cloud.dataproc_v1beta2.types.QueryList
A list of queries. |
script_variables |
Sequence[google.cloud.dataproc_v1beta2.types.SparkSqlJob.ScriptVariablesEntry]
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).
|
properties |
Sequence[google.cloud.dataproc_v1beta2.types.SparkSqlJob.PropertiesEntry]
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten. |
jar_file_uris |
Sequence[str]
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH. |
logging_config |
google.cloud.dataproc_v1beta2.types.LoggingConfig
Optional. The runtime log config for job execution. |
Classes
PropertiesEntry
PropertiesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)The abstract base class for a message.
| Parameters | |
|---|---|
| Name | Description |
kwargs |
dict
Keys and values corresponding to the fields of the message. |
mapping |
Union[dict,
A dictionary or message to be used to determine the values for this message. |
ignore_unknown_fields |
Optional(bool)
If True, do not raise errors for unknown fields. Only applied if |
ScriptVariablesEntry
ScriptVariablesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)The abstract base class for a message.
| Parameters | |
|---|---|
| Name | Description |
kwargs |
dict
Keys and values corresponding to the fields of the message. |
mapping |
Union[dict,
A dictionary or message to be used to determine the values for this message. |
ignore_unknown_fields |
Optional(bool)
If True, do not raise errors for unknown fields. Only applied if |