Class SparkSqlBatch

SparkSqlBatch(mapping=None, *, ignore_unknown_fields=False, **kwargs)

A configuration for running Apache Spark SQL <http://spark.apache.org/sql/>__ queries as a batch workload.

Attributes

NameDescription
query_file_uri str
Required. The HCFS URI of the script that contains Spark SQL queries to execute.
query_variables Sequence[google.cloud.dataproc_v1.types.SparkSqlBatch.QueryVariablesEntry]
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: ``SET name="value";``).
jar_file_uris Sequence[str]
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Inheritance

builtins.object > proto.message.Message > SparkSqlBatch

Classes

QueryVariablesEntry

QueryVariablesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The abstract base class for a message.

Parameters
NameDescription
kwargs dict

Keys and values corresponding to the fields of the message.

mapping Union[dict, `.Message`]

A dictionary or message to be used to determine the values for this message.

ignore_unknown_fields Optional(bool)

If True, do not raise errors for unknown fields. Only applied if mapping is a mapping type or there are keyword parameters.