Google Cloud Dataproc v1 API - Class PigJob (5.5.0) 

public sealed class PigJob : IMessage<PigJob>, IEquatable<PigJob>, IDeepCloneable<PigJob>, IBufferMessage, IMessage

Reference documentation and code samples for the Google Cloud Dataproc v1 API class PigJob.

A Dataproc job for running Apache Pig queries on YARN.

Inheritance

object > PigJob

Namespace

GoogleCloudGoogle.Cloud.DataprocV1

Assembly

Google.Cloud.Dataproc.V1.dll

Constructors

PigJob()

public PigJob()

PigJob(PigJob)

public PigJob(PigJob other)
Parameter
NameDescription
otherPigJob

Properties

ContinueOnFailure

public bool ContinueOnFailure { get; set; }

Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.

Property Value
TypeDescription
bool

JarFileUris

public RepeatedField<string> JarFileUris { get; }

Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.

Property Value
TypeDescription
RepeatedFieldstring

LoggingConfig

public LoggingConfig LoggingConfig { get; set; }

Optional. The runtime log config for job execution.

Property Value
TypeDescription
LoggingConfig

Properties

public MapField<string, string> Properties { get; }

Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.

Property Value
TypeDescription
MapFieldstringstring

QueriesCase

public PigJob.QueriesOneofCase QueriesCase { get; }
Property Value
TypeDescription
PigJobQueriesOneofCase

QueryFileUri

public string QueryFileUri { get; set; }

The HCFS URI of the script that contains the Pig queries.

Property Value
TypeDescription
string

QueryList

public QueryList QueryList { get; set; }

A list of queries.

Property Value
TypeDescription
QueryList

ScriptVariables

public MapField<string, string> ScriptVariables { get; }

Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).

Property Value
TypeDescription
MapFieldstringstring