Author: daijy
Date: Tue Jan 31 21:10:45 2017
New Revision: 1781170
URL: http://svn.apache.org/viewvc?rev=1781170&view=rev
Log:
PIG-5119: SkewedJoin_15 is unstable
Modified:
pig/branches/branch-0.16/CHANGES.txt
pig/branches/branch-0.16/test/e2e/pig/tests/nightly.conf
Modified: pig/branches/branch-0.16/CHANGES.txt
URL:
http://svn.apache.org/viewvc/pig/branches/branch-0.16/CHANGES.txt?rev=1781170&r1=1781169&r2=1781170&view=diff
==============================================================================
--- pig/branches/branch-0.16/CHANGES.txt (original)
+++ pig/branches/branch-0.16/CHANGES.txt Tue Jan 31 21:10:45 2017
@@ -32,6 +32,8 @@ OPTIMIZATIONS
BUG FIXES
+PIG-5119: SkewedJoin_15 is unstable (daijy)
+
PIG-5118: Script fails with Invalid dag containing 0 vertices (rohini)
PIG-5111: e2e Utf8Test fails in local mode (rohini)
Modified: pig/branches/branch-0.16/test/e2e/pig/tests/nightly.conf
URL:
http://svn.apache.org/viewvc/pig/branches/branch-0.16/test/e2e/pig/tests/nightly.conf?rev=1781170&r1=1781169&r2=1781170&view=diff
==============================================================================
--- pig/branches/branch-0.16/test/e2e/pig/tests/nightly.conf (original)
+++ pig/branches/branch-0.16/test/e2e/pig/tests/nightly.conf Tue Jan 31
21:10:45 2017
@@ -3215,13 +3215,15 @@ b = load ':INPATH:/singlefile/votertab10
c = group a by (name, age);
d = group b by (name, age);
e = join c by $0, d by $0 using 'skewed' parallel 5;
-store e into ':OUTPATH:';\,
+f = foreach e generate c::group, flatten(c::a), d::group, flatten(d::b);
+store f into ':OUTPATH:';\,
'verify_pig_script' => q\a = load
':INPATH:/singlefile/studenttab10k' using PigStorage() as (name, age, gpa);
b = load ':INPATH:/singlefile/votertab10k' as (name, age, registration,
contributions);
c = group a by (name, age);
d = group b by (name, age);
e = join c by $0, d by $0;
-store e into ':OUTPATH:';\
+f = foreach e generate c::group, flatten(c::a), d::group, flatten(d::b);
+store f into ':OUTPATH:';\
}
]
