public sealed class SparkBatch : IMessage<SparkBatch>, IEquatable<SparkBatch>, IDeepCloneable<SparkBatch>, IBufferMessage, IMessage
Reference documentation and code samples for the Google Cloud Dataproc v1 API class SparkBatch.
A configuration for running an Apache Spark batch workload.
Implements
IMessageSparkBatch, IEquatableSparkBatch, IDeepCloneableSparkBatch, IBufferMessage, IMessageNamespace
Google.Cloud.Dataproc.V1Assembly
Google.Cloud.Dataproc.V1.dll
Constructors
SparkBatch()
public SparkBatch()
SparkBatch(SparkBatch)
public SparkBatch(SparkBatch other)
Parameter | |
---|---|
Name | Description |
other |
SparkBatch |
Properties
ArchiveUris
public RepeatedField<string> ArchiveUris { get; }
Optional. HCFS URIs of archives to be extracted into the working directory
of each executor. Supported file types:
.jar
, .tar
, .tar.gz
, .tgz
, and .zip
.
Property Value | |
---|---|
Type | Description |
RepeatedFieldstring |
Args
public RepeatedField<string> Args { get; }
Optional. The arguments to pass to the driver. Do not include arguments
that can be set as batch properties, such as --conf
, since a collision
can occur that causes an incorrect batch submission.
Property Value | |
---|---|
Type | Description |
RepeatedFieldstring |
DriverCase
public SparkBatch.DriverOneofCase DriverCase { get; }
Property Value | |
---|---|
Type | Description |
SparkBatchDriverOneofCase |
FileUris
public RepeatedField<string> FileUris { get; }
Optional. HCFS URIs of files to be placed in the working directory of each executor.
Property Value | |
---|---|
Type | Description |
RepeatedFieldstring |
HasMainClass
public bool HasMainClass { get; }
Gets whether the "main_class" field is set
Property Value | |
---|---|
Type | Description |
bool |
HasMainJarFileUri
public bool HasMainJarFileUri { get; }
Gets whether the "main_jar_file_uri" field is set
Property Value | |
---|---|
Type | Description |
bool |
JarFileUris
public RepeatedField<string> JarFileUris { get; }
Optional. HCFS URIs of jar files to add to the classpath of the Spark driver and tasks.
Property Value | |
---|---|
Type | Description |
RepeatedFieldstring |
MainClass
public string MainClass { get; set; }
Optional. The name of the driver main class. The jar file that contains
the class must be in the classpath or specified in jar_file_uris
.
Property Value | |
---|---|
Type | Description |
string |
MainJarFileUri
public string MainJarFileUri { get; set; }
Optional. The HCFS URI of the jar file that contains the main class.
Property Value | |
---|---|
Type | Description |
string |