SparkSqlBatch(mapping=None, *, ignore_unknown_fields=False, **kwargs)
A configuration for running Apache Spark
SQL <https://spark.apache.org/sql/>
__ queries as a batch workload.
Attributes |
|
---|---|
Name | Description |
query_file_uri |
str
Required. The HCFS URI of the script that contains Spark SQL queries to execute. |
query_variables |
MutableMapping[str, str]
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value"; ).
|
jar_file_uris |
MutableSequence[str]
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH. |
Classes
QueryVariablesEntry
QueryVariablesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)
The abstract base class for a message.
Parameters | |
---|---|
Name | Description |
kwargs |
dict
Keys and values corresponding to the fields of the message. |
mapping |
Union[dict,
A dictionary or message to be used to determine the values for this message. |
ignore_unknown_fields |
Optional(bool)
If True, do not raise errors for unknown fields. Only applied if |