Cloud Dataproc V1 API - Class Google::Cloud::Dataproc::V1::SparkSqlJob (v1.3.0)

Reference documentation and code samples for the Cloud Dataproc V1 API class Google::Cloud::Dataproc::V1::SparkSqlJob.

A Dataproc job for running Apache Spark SQL queries.

Inherits

  • Object

Extended By

  • Google::Protobuf::MessageExts::ClassMethods

Includes

  • Google::Protobuf::MessageExts

Methods

#jar_file_uris

def jar_file_uris() -> ::Array<::String>
Returns
  • (::Array<::String>) — Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

#jar_file_uris=

def jar_file_uris=(value) -> ::Array<::String>
Parameter
  • value (::Array<::String>) — Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
Returns
  • (::Array<::String>) — Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

#logging_config

def logging_config() -> ::Google::Cloud::Dataproc::V1::LoggingConfig
Returns

#logging_config=

def logging_config=(value) -> ::Google::Cloud::Dataproc::V1::LoggingConfig
Parameter
Returns

#properties

def properties() -> ::Google::Protobuf::Map{::String => ::String}
Returns
  • (::Google::Protobuf::Map{::String => ::String}) — Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API might be overwritten.

#properties=

def properties=(value) -> ::Google::Protobuf::Map{::String => ::String}
Parameter
  • value (::Google::Protobuf::Map{::String => ::String}) — Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API might be overwritten.
Returns
  • (::Google::Protobuf::Map{::String => ::String}) — Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API might be overwritten.

#query_file_uri

def query_file_uri() -> ::String
Returns
  • (::String) — The HCFS URI of the script that contains SQL queries.

    Note: The following fields are mutually exclusive: query_file_uri, query_list. If a field in that set is populated, all other fields in the set will automatically be cleared.

#query_file_uri=

def query_file_uri=(value) -> ::String
Parameter
  • value (::String) — The HCFS URI of the script that contains SQL queries.

    Note: The following fields are mutually exclusive: query_file_uri, query_list. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::String) — The HCFS URI of the script that contains SQL queries.

    Note: The following fields are mutually exclusive: query_file_uri, query_list. If a field in that set is populated, all other fields in the set will automatically be cleared.

#query_list

def query_list() -> ::Google::Cloud::Dataproc::V1::QueryList
Returns
  • (::Google::Cloud::Dataproc::V1::QueryList) — A list of queries.

    Note: The following fields are mutually exclusive: query_list, query_file_uri. If a field in that set is populated, all other fields in the set will automatically be cleared.

#query_list=

def query_list=(value) -> ::Google::Cloud::Dataproc::V1::QueryList
Parameter
  • value (::Google::Cloud::Dataproc::V1::QueryList) — A list of queries.

    Note: The following fields are mutually exclusive: query_list, query_file_uri. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::Dataproc::V1::QueryList) — A list of queries.

    Note: The following fields are mutually exclusive: query_list, query_file_uri. If a field in that set is populated, all other fields in the set will automatically be cleared.

#script_variables

def script_variables() -> ::Google::Protobuf::Map{::String => ::String}
Returns
  • (::Google::Protobuf::Map{::String => ::String}) — Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

#script_variables=

def script_variables=(value) -> ::Google::Protobuf::Map{::String => ::String}
Parameter
  • value (::Google::Protobuf::Map{::String => ::String}) — Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).
Returns
  • (::Google::Protobuf::Map{::String => ::String}) — Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).