Class SparkSqlJob

A Dataproc job for running Apache Spark SQL <http://spark.apache.org/sql/>__ queries.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes
NameDescription
strquery_file_uri
The HCFS URI of the script that contains SQL queries. This field is a member of `oneof`_ ``queries``.
google.cloud.dataproc_v1.types.QueryListquery_list
A list of queries. This field is a member of `oneof`_ ``queries``.
Sequence[google.cloud.dataproc_v1.types.SparkSqlJob.ScriptVariablesEntry]script_variables
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET ``name="value";``).
Sequence[google.cloud.dataproc_v1.types.SparkSqlJob.PropertiesEntry]properties
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
Sequence[str]jar_file_uris
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
google.cloud.dataproc_v1.types.LoggingConfiglogging_config
Optional. The runtime log config for job execution.

Inheritance

builtins.object > proto.message.Message > SparkSqlJob

Classes

PropertiesEntry

PropertiesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)

API documentation for dataproc_v1.types.SparkSqlJob.PropertiesEntry class.

ScriptVariablesEntry

ScriptVariablesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)

API documentation for dataproc_v1.types.SparkSqlJob.ScriptVariablesEntry class.