如何在 oozie 中将猪选项作为参数传递?
How to pass pig option as parameter in oozie?
为了执行我的猪脚本,我需要关闭优化器。在命令行和脚本中使用以下命令可以正常工作。
pig -t ColumnMapKeyPrune population.pig
如何在oozie中传递这个选项?
我试过作为参数传递。
<action>
<pig>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<script>Population.pig</script>
<argument>-t</argument>
<argument>ColumnMapKeyPrune</argument>
<param>piggybankJar=${piggybankJar}</param>
<param>datafuJar=${datafuJar}</param>
<param>inputPath=${inputPath}</param>
<param>outputPath=${outputPath}</param>
</pig>
</action>
收到以下错误:
E0701: XML schema error, cvc-complex-type.2.4.a: Invalid content was found starting with element 'param'. One of '{"uri:oozie:workflow:0.4":argument, "uri:oozie:workflow:0.4":file, "uri:oozie:workflow:0.4":archive}' is expected.
尝试使用参数,但没有用
<action>
<pig>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<script>Population.pig</script>
<param>-t</param>
<param>ColumnMapKeyPrune</param>
<param>piggybankJar=${piggybankJar}</param>
<param>datafuJar=${datafuJar}</param>
<param>inputPath=${inputPath}</param>
<param>outputPath=${outputPath}</param>
</pig>
</action>
对于 pig oozie 操作只允许参数、存档、文件和参数标签。如何传递此 optimizer_off 选项?
在你的 pig 脚本中设置下面提到的 属性 并尝试一次。
设置pig.optimizer.rules.disabled'ColumnMapKeyPrune';
供参考,请仔细阅读下面提到的link
[http://pig.apache.org/docs/r0.14.0/perf.html#optimization-rules]
为了执行我的猪脚本,我需要关闭优化器。在命令行和脚本中使用以下命令可以正常工作。
pig -t ColumnMapKeyPrune population.pig
如何在oozie中传递这个选项?
我试过作为参数传递。
<action>
<pig>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<script>Population.pig</script>
<argument>-t</argument>
<argument>ColumnMapKeyPrune</argument>
<param>piggybankJar=${piggybankJar}</param>
<param>datafuJar=${datafuJar}</param>
<param>inputPath=${inputPath}</param>
<param>outputPath=${outputPath}</param>
</pig>
</action>
收到以下错误:
E0701: XML schema error, cvc-complex-type.2.4.a: Invalid content was found starting with element 'param'. One of '{"uri:oozie:workflow:0.4":argument, "uri:oozie:workflow:0.4":file, "uri:oozie:workflow:0.4":archive}' is expected.
尝试使用参数,但没有用
<action>
<pig>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<script>Population.pig</script>
<param>-t</param>
<param>ColumnMapKeyPrune</param>
<param>piggybankJar=${piggybankJar}</param>
<param>datafuJar=${datafuJar}</param>
<param>inputPath=${inputPath}</param>
<param>outputPath=${outputPath}</param>
</pig>
</action>
对于 pig oozie 操作只允许参数、存档、文件和参数标签。如何传递此 optimizer_off 选项?
在你的 pig 脚本中设置下面提到的 属性 并尝试一次。
设置pig.optimizer.rules.disabled'ColumnMapKeyPrune';
供参考,请仔细阅读下面提到的link
[http://pig.apache.org/docs/r0.14.0/perf.html#optimization-rules]