A Cloud Dataproc job for running Apache Spark SQL queries.
JSON representation | |
---|---|
{ "scriptVariables": { string: string, ... }, "properties": { string: string, ... }, "jarFileUris": [ string ], "loggingConfig": { object ( |
Fields | ||
---|---|---|
scriptVariables |
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET An object containing a list of |
|
properties |
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. An object containing a list of |
|
jarFileUris[] |
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH. |
|
loggingConfig |
Optional. The runtime log config for job execution. |
|
Union field queries . Required. The sequence of Spark SQL queries to execute, specified as either an HCFS file URI or as a list of queries. queries can be only one of the following: |
||
queryFileUri |
The HCFS URI of the script that contains SQL queries. |
|
queryList |
A list of queries. |