Google Cloud Dataproc v1 API - Class SparkSqlJob (5.7.0) 

public sealed class SparkSqlJob : IMessage<SparkSqlJob>, IEquatable<SparkSqlJob>, IDeepCloneable<SparkSqlJob>, IBufferMessage, IMessage

Reference documentation and code samples for the Google Cloud Dataproc v1 API class SparkSqlJob.

A Dataproc job for running Apache Spark SQL queries.

Inheritance

object > SparkSqlJob

Namespace

Google.Cloud.Dataproc.V1

Assembly

Google.Cloud.Dataproc.V1.dll

Constructors

SparkSqlJob()

public SparkSqlJob()

SparkSqlJob(SparkSqlJob)

public SparkSqlJob(SparkSqlJob other)
Parameter
NameDescription
otherSparkSqlJob

Properties

HasQueryFileUri

public bool HasQueryFileUri { get; }

Gets whether the "query_file_uri" field is set

Property Value
TypeDescription
bool

JarFileUris

public RepeatedField<string> JarFileUris { get; }

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Property Value
TypeDescription
RepeatedFieldstring

LoggingConfig

public LoggingConfig LoggingConfig { get; set; }

Optional. The runtime log config for job execution.

Property Value
TypeDescription
LoggingConfig

Properties

public MapField<string, string> Properties { get; }

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

Property Value
TypeDescription
MapFieldstringstring

QueriesCase

public SparkSqlJob.QueriesOneofCase QueriesCase { get; }
Property Value
TypeDescription
SparkSqlJobQueriesOneofCase

QueryFileUri

public string QueryFileUri { get; set; }

The HCFS URI of the script that contains SQL queries.

Property Value
TypeDescription
string

QueryList

public QueryList QueryList { get; set; }

A list of queries.

Property Value
TypeDescription
QueryList

ScriptVariables

public MapField<string, string> ScriptVariables { get; }

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

Property Value
TypeDescription
MapFieldstringstring