Reference documentation and code samples for the Google Cloud Dataproc V1 Client class SparkSqlBatch.
A configuration for running Apache Spark SQL queries as a batch workload.
Generated from protobuf message google.cloud.dataproc.v1.SparkSqlBatch
Methods
__construct
Constructor.
| Parameters | |
|---|---|
| Name | Description |
data |
array
Optional. Data for populating the Message object. |
↳ query_file_uri |
string
Required. The HCFS URI of the script that contains Spark SQL queries to execute. |
↳ query_variables |
array|Google\Protobuf\Internal\MapField
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: |
↳ jar_file_uris |
array
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH. |
getQueryFileUri
Required. The HCFS URI of the script that contains Spark SQL queries to execute.
| Returns | |
|---|---|
| Type | Description |
string | |
setQueryFileUri
Required. The HCFS URI of the script that contains Spark SQL queries to execute.
| Parameter | |
|---|---|
| Name | Description |
var |
string
|
| Returns | |
|---|---|
| Type | Description |
$this | |
getQueryVariables
Optional. Mapping of query variable names to values (equivalent to the
Spark SQL command: SET name="value";).
| Returns | |
|---|---|
| Type | Description |
Google\Protobuf\Internal\MapField | |
setQueryVariables
Optional. Mapping of query variable names to values (equivalent to the
Spark SQL command: SET name="value";).
| Parameter | |
|---|---|
| Name | Description |
var |
array|Google\Protobuf\Internal\MapField
|
| Returns | |
|---|---|
| Type | Description |
$this | |
getJarFileUris
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
| Returns | |
|---|---|
| Type | Description |
Google\Protobuf\Internal\RepeatedField | |
setJarFileUris
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
| Parameter | |
|---|---|
| Name | Description |
var |
string[]
|
| Returns | |
|---|---|
| Type | Description |
$this | |