[
https://issues.apache.org/jira/browse/PIG-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Dai updated PIG-3790:
----------------------------
Attachment: PIG-3790-2.patch
Attach new patch which incorporates Rohini's review comments and open questions
above:
1. MultiQuery_11/Macro_Misc_3 issue is general to Hadoop 2, move to PIG-3819
2. Can't we make test-tez just call test-base like test and test-local?
Yes, we should, added in new patch. And we can remove tests/tez.conf since we
don't need a specific test suite
3. -Dharness.old.pig is not effective in test-tez
Make -Dharness.old.pig work but optional in new patch
4. PIG_CLASSPATH too long issue
In the patch, I saved PIG_CLASSPATH into orig_pig_classpath in the test setup,
when running test, set PIG_CLASSPATH to saved orig_pig_classpath. Since
orig_pig_classpath is set only once, so it will keep expanding.
> Several changes in Tez e2e
> --------------------------
>
> Key: PIG-3790
> URL: https://issues.apache.org/jira/browse/PIG-3790
> Project: Pig
> Issue Type: Sub-task
> Components: tez
> Affects Versions: tez-branch
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: tez-branch
>
> Attachments: PIG-3790-1.patch, PIG-3790-2.patch
>
>
> Need to change several thing in e2e:
> 1. If test contains tag "verify_pig_script", "verify_pig_script" still run
> against tez, should run against MR
> 2. Have the following line in test:
> $ENV{'PIG_CLASSPATH'} = $ENV{'PIG_CLASSPATH'} . $separator . $pcp;
> PIG_CLASSPATH eventually get too long and exceed system limit
> 3. Some tests such as MultiQuery_11, perl command is enclosed in double quote
> (perl -ne "print $_;"), Pig runtime will do the parameter substitution and
> replace $_ to the last command executed. This seems should goes to MR as
> well, if so, I will open another ticket to fix in trunk.
> 4. Since e2e is now in a good shape, we need to enable all test suite instead
> of just tez.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
