Google Cloud Dataproc V1 Client - Class SparkSqlJob (3.6.1)

Reference documentation and code samples for the Google Cloud Dataproc V1 Client class SparkSqlJob.

A Dataproc job for running Apache Spark SQL queries.

Generated from protobuf message google.cloud.dataproc.v1.SparkSqlJob

Methods

__construct

Constructor.

Parameters
NameDescription
data array

Optional. Data for populating the Message object.

↳ query_file_uri string

The HCFS URI of the script that contains SQL queries.

↳ query_list Google\Cloud\Dataproc\V1\QueryList

A list of queries.

↳ script_variables array|Google\Protobuf\Internal\MapField

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

↳ properties array|Google\Protobuf\Internal\MapField

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

↳ jar_file_uris array

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

↳ logging_config Google\Cloud\Dataproc\V1\LoggingConfig

Optional. The runtime log config for job execution.

getQueryFileUri

The HCFS URI of the script that contains SQL queries.

Returns
TypeDescription
string

hasQueryFileUri

setQueryFileUri

The HCFS URI of the script that contains SQL queries.

Parameter
NameDescription
var string
Returns
TypeDescription
$this

getQueryList

A list of queries.

Returns
TypeDescription
Google\Cloud\Dataproc\V1\QueryList|null

hasQueryList

setQueryList

A list of queries.

Parameter
NameDescription
var Google\Cloud\Dataproc\V1\QueryList
Returns
TypeDescription
$this

getScriptVariables

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

Returns
TypeDescription
Google\Protobuf\Internal\MapField

setScriptVariables

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

Parameter
NameDescription
var array|Google\Protobuf\Internal\MapField
Returns
TypeDescription
$this

getProperties

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

Returns
TypeDescription
Google\Protobuf\Internal\MapField

setProperties

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

Parameter
NameDescription
var array|Google\Protobuf\Internal\MapField
Returns
TypeDescription
$this

getJarFileUris

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Returns
TypeDescription
Google\Protobuf\Internal\RepeatedField

setJarFileUris

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Parameter
NameDescription
var string[]
Returns
TypeDescription
$this

getLoggingConfig

Optional. The runtime log config for job execution.

Returns
TypeDescription
Google\Cloud\Dataproc\V1\LoggingConfig|null

hasLoggingConfig

clearLoggingConfig

setLoggingConfig

Optional. The runtime log config for job execution.

Parameter
NameDescription
var Google\Cloud\Dataproc\V1\LoggingConfig
Returns
TypeDescription
$this

getQueries

Returns
TypeDescription
string