[
https://issues.apache.org/jira/browse/PIG-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyunzhang_intel updated PIG-4362:
----------------------------------
Attachment: PIG-4362_4.patch
How to use PIG-4362_4.patch(containing patch of PIG-4209), following are my
steps:
0. patch –p1<PIG-4364_4.patch
1. ant clean –Dhadoopversion=23 –jar
2. Generate data
a) ant -Dharness.cluster.conf=$HADOOP_CONF_DIR
-Dharness.cluster.bin=$HADOOP_BIN test-e2e-deploy-local
b) hadoop fs -put test/e2e/pig/testdist/data ./
3. ant -Dharness.cluster.conf=$HADOOP_HOME/conf
-Dharness.cluster.bin=$HADOOP_HOME/bin -Dharness.hadoop.home=$HADOOP_HOME
–Dhadoopversion=23 -Dtests.to.run="-t ComputeSpec" test-e2e-spark
> Make ship work with spark
> -------------------------
>
> Key: PIG-4362
> URL: https://issues.apache.org/jira/browse/PIG-4362
> Project: Pig
> Issue Type: Bug
> Components: spark
> Reporter: liyunzhang_intel
> Assignee: liyunzhang_intel
> Attachments: PIG-4362.patch, PIG-4362_1.patch, PIG-4362_2.patch,
> PIG-4362_3.patch, PIG-4362_4.patch, test_harnesss_1420652019
>
>
> Related e2e test: ComputeSpec_1~ComputeSpec_8.
> found following error when run ComputeSpec_4.pig
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> 299 SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 300 ===== Task Information Header =====
> 301 Command: perl PigStreaming.pl
> (stdin-org.apache.pig.builtin.PigStreaming/stdout-org.apache.pig.builtin.PigStreaming)
> 302 Start time: Mon Dec 29 10:48:43 CST 2014
> 303 ===== * * * =====
> 304 Can't open perl script "PigStreaming.pl": No such file or directory
> 305 Details at logfile:
> /home/zly/prj/oss/pig/test/e2e/pig/testdist/out/pigtest/root/root-1419821303-streaming.conf/ComputeSpec_4.log
> 306 ERROR TestDriver::runTestGroup at : 729 Failed to run test ComputeSpec_4
> <Failed running
> ./out/pigtest/root/root-1419821303-streaming.conf/ComputeSpec_4. pig
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)