A Dataproc job for running Apache Pig queries on YARN.
JSON representation |
---|
{ "continueOnFailure": boolean, "scriptVariables": { string: string, ... }, "properties": { string: string, ... }, "jarFileUris": [ string ], "loggingConfig": { object ( |
Fields | |
---|---|
continueOnFailure |
Optional. Whether to continue executing queries if a query fails. The default value is |
scriptVariables |
Optional. Mapping of query variable names to values (equivalent to the Pig command: An object containing a list of |
properties |
Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code. An object containing a list of |
jarFileUris[] |
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs. |
loggingConfig |
Optional. The runtime log config for job execution. |
Union field queries . Required. The sequence of Pig queries to execute, specified as an HCFS file URI or a list of queries. queries can be only one of the following: |
|
queryFileUri |
The HCFS URI of the script that contains the Pig queries. |
queryList |
A list of queries. |