Author: daijy
Date: Tue Jan 31 21:11:21 2017
New Revision: 1781171
URL: http://svn.apache.org/viewvc?rev=1781171&view=rev
Log:
PIG-5119: SkewedJoin_15 is unstable
Modified:
pig/trunk/CHANGES.txt
pig/trunk/test/e2e/pig/tests/nightly.conf
Modified: pig/trunk/CHANGES.txt
URL:
http://svn.apache.org/viewvc/pig/trunk/CHANGES.txt?rev=1781171&r1=1781170&r2=1781171&view=diff
==============================================================================
--- pig/trunk/CHANGES.txt (original)
+++ pig/trunk/CHANGES.txt Tue Jan 31 21:11:21 2017
@@ -191,6 +191,8 @@ OPTIMIZATIONS
BUG FIXES
+PIG-5119: SkewedJoin_15 is unstable (daijy)
+
PIG-5118: Script fails with Invalid dag containing 0 vertices (rohini)
PIG-5111: e2e Utf8Test fails in local mode (rohini)
Modified: pig/trunk/test/e2e/pig/tests/nightly.conf
URL:
http://svn.apache.org/viewvc/pig/trunk/test/e2e/pig/tests/nightly.conf?rev=1781171&r1=1781170&r2=1781171&view=diff
==============================================================================
--- pig/trunk/test/e2e/pig/tests/nightly.conf (original)
+++ pig/trunk/test/e2e/pig/tests/nightly.conf Tue Jan 31 21:11:21 2017
@@ -3229,13 +3229,15 @@ b = load ':INPATH:/singlefile/votertab10
c = group a by (name, age);
d = group b by (name, age);
e = join c by $0, d by $0 using 'skewed' parallel 5;
-store e into ':OUTPATH:';\,
+f = foreach e generate c::group, flatten(c::a), d::group, flatten(d::b);
+store f into ':OUTPATH:';\,
'verify_pig_script' => q\a = load
':INPATH:/singlefile/studenttab10k' using PigStorage() as (name, age, gpa);
b = load ':INPATH:/singlefile/votertab10k' as (name, age, registration,
contributions);
c = group a by (name, age);
d = group b by (name, age);
e = join c by $0, d by $0;
-store e into ':OUTPATH:';\
+f = foreach e generate c::group, flatten(c::a), d::group, flatten(d::b);
+store f into ':OUTPATH:';\
}
]
