Class PigJob (3.1.0)

public sealed class PigJob : IMessage<PigJob>, IEquatable<PigJob>, IDeepCloneable<PigJob>, IBufferMessage, IMessage

A Dataproc job for running Apache Pig queries on YARN.

Inheritance

Object > PigJob

Namespace

Google.Cloud.Dataproc.V1

Assembly

Google.Cloud.Dataproc.V1.dll

Constructors

PigJob()

public PigJob()

PigJob(PigJob)

public PigJob(PigJob other)
Parameter
NameDescription
otherPigJob

Properties

ContinueOnFailure

public bool ContinueOnFailure { get; set; }

Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.

Property Value
TypeDescription
Boolean

JarFileUris

public RepeatedField<string> JarFileUris { get; }

Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.

Property Value
TypeDescription
RepeatedField<String>

LoggingConfig

public LoggingConfig LoggingConfig { get; set; }

Optional. The runtime log config for job execution.

Property Value
TypeDescription
LoggingConfig

Properties

public MapField<string, string> Properties { get; }

Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.

Property Value
TypeDescription
MapField<String, String>

QueriesCase

public PigJob.QueriesOneofCase QueriesCase { get; }
Property Value
TypeDescription
PigJob.QueriesOneofCase

QueryFileUri

public string QueryFileUri { get; set; }

The HCFS URI of the script that contains the Pig queries.

Property Value
TypeDescription
String

QueryList

public QueryList QueryList { get; set; }

A list of queries.

Property Value
TypeDescription
QueryList

ScriptVariables

public MapField<string, string> ScriptVariables { get; }

Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).

Property Value
TypeDescription
MapField<String, String>