public sealed class PigJob : IMessage<PigJob>, IEquatable<PigJob>, IDeepCloneable<PigJob>, IBufferMessage, IMessage
Reference documentation and code samples for the Google Cloud Dataproc v1 API class PigJob.
A Dataproc job for running Apache Pig queries on YARN.
Namespace
Google.Cloud.Dataproc.V1Assembly
Google.Cloud.Dataproc.V1.dll
Constructors
PigJob()
public PigJob()
PigJob(PigJob)
public PigJob(PigJob other)
Parameter | |
---|---|
Name | Description |
other | PigJob |
Properties
ContinueOnFailure
public bool ContinueOnFailure { get; set; }
Optional. Whether to continue executing queries if a query fails.
The default value is false
. Setting to true
can be useful when
executing independent parallel queries.
Property Value | |
---|---|
Type | Description |
bool |
HasQueryFileUri
public bool HasQueryFileUri { get; }
Gets whether the "query_file_uri" field is set
Property Value | |
---|---|
Type | Description |
bool |
JarFileUris
public RepeatedField<string> JarFileUris { get; }
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
Property Value | |
---|---|
Type | Description |
RepeatedFieldstring |
LoggingConfig
public LoggingConfig LoggingConfig { get; set; }
Optional. The runtime log config for job execution.
Property Value | |
---|---|
Type | Description |
LoggingConfig |
Properties
public MapField<string, string> Properties { get; }
Optional. A mapping of property names to values, used to configure Pig.
Properties that conflict with values set by the Dataproc API may be
overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml
,
/etc/pig/conf/pig.properties, and classes in user code.
Property Value | |
---|---|
Type | Description |
MapFieldstringstring |
QueriesCase
public PigJob.QueriesOneofCase QueriesCase { get; }
Property Value | |
---|---|
Type | Description |
PigJobQueriesOneofCase |
QueryFileUri
public string QueryFileUri { get; set; }
The HCFS URI of the script that contains the Pig queries.
Property Value | |
---|---|
Type | Description |
string |
QueryList
public QueryList QueryList { get; set; }
A list of queries.
Property Value | |
---|---|
Type | Description |
QueryList |
ScriptVariables
public MapField<string, string> ScriptVariables { get; }
Optional. Mapping of query variable names to values (equivalent to the Pig
command: name=[value]
).
Property Value | |
---|---|
Type | Description |
MapFieldstringstring |