Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/skewjoinopt8.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/skewjoinopt8.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/skewjoinopt8.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/skewjoinopt8.q.out Wed Dec 17 02:54:52 2014 @@ -72,9 +72,8 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 2 <- Map 1 (PARTITION-LEVEL SORT, 1), Map 4 (PARTITION-LEVEL SORT, 1), Map 5 (PARTITION-LEVEL SORT, 1) - Reducer 7 <- Map 6 (PARTITION-LEVEL SORT, 1), Map 8 (PARTITION-LEVEL SORT, 1), Map 9 (PARTITION-LEVEL SORT, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 7 (NONE, 0) + Reducer 2 <- Map 1 (PARTITION-LEVEL SORT, 1), Map 3 (PARTITION-LEVEL SORT, 1), Map 4 (PARTITION-LEVEL SORT, 1) + Reducer 6 <- Map 5 (PARTITION-LEVEL SORT, 1), Map 7 (PARTITION-LEVEL SORT, 1), Map 8 (PARTITION-LEVEL SORT, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -91,7 +90,7 @@ STAGE PLANS: Map-reduce partition columns: key (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: val (type: string) - Map 4 + Map 3 Map Operator Tree: TableScan alias: b @@ -105,7 +104,7 @@ STAGE PLANS: Map-reduce partition columns: key (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: val (type: string) - Map 5 + Map 4 Map Operator Tree: TableScan alias: c @@ -119,7 +118,7 @@ STAGE PLANS: Map-reduce partition columns: key (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: val (type: string) - Map 6 + Map 5 Map Operator Tree: TableScan alias: b @@ -133,7 +132,7 @@ STAGE PLANS: Map-reduce partition columns: key (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: val (type: string) - Map 8 + Map 7 Map Operator Tree: TableScan alias: c @@ -147,7 +146,7 @@ STAGE PLANS: Map-reduce partition columns: key (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: val (type: string) - Map 9 + Map 8 Map Operator Tree: TableScan alias: a @@ -181,7 +180,7 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Reducer 7 + Reducer 6 Reduce Operator Tree: Join Operator condition map: @@ -201,8 +200,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 3 - Vertex: Union 3 Stage: Stage-0 Fetch Operator
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/skewjoinopt9.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/skewjoinopt9.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/skewjoinopt9.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/skewjoinopt9.q.out Wed Dec 17 02:54:52 2014 @@ -64,8 +64,7 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 3 <- Map 5 (PARTITION-LEVEL SORT, 1), Union 2 (PARTITION-LEVEL SORT, 1) - Union 2 <- Map 1 (NONE, 0), Map 4 (NONE, 0) + Reducer 2 <- Map 1 (PARTITION-LEVEL SORT, 1), Map 3 (PARTITION-LEVEL SORT, 1), Map 4 (PARTITION-LEVEL SORT, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -82,7 +81,7 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: string) - Map 4 + Map 3 Map Operator Tree: TableScan alias: t1 @@ -96,7 +95,7 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: string) - Map 5 + Map 4 Map Operator Tree: TableScan alias: b @@ -110,7 +109,7 @@ STAGE PLANS: Map-reduce partition columns: key (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: val (type: string) - Reducer 3 + Reducer 2 Reduce Operator Tree: Join Operator condition map: @@ -131,8 +130,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 2 - Vertex: Union 2 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/stats1.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/stats1.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/stats1.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/stats1.q.out Wed Dec 17 02:54:52 2014 @@ -30,7 +30,6 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Union 3 <- Map 4 (NONE, 0), Reducer 2 (NONE, 0) #### A masked pattern was here #### Vertices: Map 1 @@ -49,7 +48,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: s2 @@ -79,8 +78,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.tmptable - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/temp_table.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/temp_table.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/temp_table.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/temp_table.q.out Wed Dec 17 02:54:52 2014 @@ -200,8 +200,7 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Union 2 <- Map 1 (NONE, 0), Map 4 (NONE, 0) - Reducer 3 <- Union 2 (SORT, 1) + Reducer 2 <- Map 1 (SORT, 1), Map 3 (SORT, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -215,7 +214,7 @@ STAGE PLANS: key expressions: _col0 (type: string) sort order: + value expressions: _col1 (type: string) - Map 4 + Map 3 Map Operator Tree: TableScan alias: bar @@ -226,7 +225,7 @@ STAGE PLANS: key expressions: _col0 (type: string) sort order: + value expressions: _col1 (type: string) - Reducer 3 + Reducer 2 Reduce Operator Tree: Select Operator expressions: KEY.reducesinkkey0 (type: string), VALUE._col0 (type: string) @@ -242,8 +241,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 2 - Vertex: Union 2 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union.q.out Wed Dec 17 02:54:52 2014 @@ -27,8 +27,6 @@ STAGE DEPENDENCIES: STAGE PLANS: Stage: Stage-1 Spark - Edges: - Union 2 <- Map 1 (NONE, 0), Map 3 (NONE, 0) #### A masked pattern was here #### Vertices: Map 1 @@ -49,7 +47,7 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Map 3 + Map 2 Map Operator Tree: TableScan alias: src @@ -67,8 +65,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 2 - Vertex: Union 2 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union10.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union10.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union10.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union10.q.out Wed Dec 17 02:54:52 2014 @@ -36,9 +36,8 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 5 <- Map 4 (GROUP, 1) - Reducer 7 <- Map 6 (GROUP, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 5 (NONE, 0), Reducer 7 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 1) + Reducer 6 <- Map 5 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -57,7 +56,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: s2 @@ -73,7 +72,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 6 + Map 5 Map Operator Tree: TableScan alias: s3 @@ -108,7 +107,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.tmptable - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -127,7 +126,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.tmptable - Reducer 7 + Reducer 6 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -146,8 +145,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.tmptable - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union11.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union11.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union11.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union11.q.out Wed Dec 17 02:54:52 2014 @@ -27,10 +27,9 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 4 <- Union 3 (GROUP, 1) - Reducer 6 <- Map 5 (GROUP, 1) - Reducer 8 <- Map 7 (GROUP, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 6 (NONE, 0), Reducer 8 (NONE, 0) + Reducer 5 <- Map 4 (GROUP, 1) + Reducer 7 <- Map 6 (GROUP, 1) + Reducer 3 <- Reducer 2 (GROUP, 1), Reducer 5 (GROUP, 1), Reducer 7 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -49,7 +48,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 5 + Map 4 Map Operator Tree: TableScan alias: s2 @@ -65,7 +64,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 7 + Map 6 Map Operator Tree: TableScan alias: s3 @@ -103,7 +102,7 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: bigint) - Reducer 4 + Reducer 3 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -122,7 +121,7 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Reducer 6 + Reducer 5 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -144,7 +143,7 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: bigint) - Reducer 8 + Reducer 7 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -166,8 +165,6 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: bigint) - Union 3 - Vertex: Union 3 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union13.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union13.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union13.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union13.q.out Wed Dec 17 02:54:52 2014 @@ -19,8 +19,6 @@ STAGE DEPENDENCIES: STAGE PLANS: Stage: Stage-1 Spark - Edges: - Union 2 <- Map 1 (NONE, 0), Map 3 (NONE, 0) #### A masked pattern was here #### Vertices: Map 1 @@ -39,7 +37,7 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Map 3 + Map 2 Map Operator Tree: TableScan alias: s2 @@ -55,8 +53,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 2 - Vertex: Union 2 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union14.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union14.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union14.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union14.q.out Wed Dec 17 02:54:52 2014 @@ -24,9 +24,8 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 3 <- Union 2 (GROUP, 1) - Reducer 5 <- Map 4 (GROUP, 1) - Union 2 <- Map 1 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 1) + Reducer 2 <- Map 1 (GROUP, 1), Reducer 4 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -49,7 +48,7 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: s1 @@ -65,7 +64,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Reducer 3 + Reducer 2 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -84,7 +83,7 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -106,8 +105,6 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: bigint) - Union 2 - Vertex: Union 2 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union15.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union15.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union15.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union15.q.out Wed Dec 17 02:54:52 2014 @@ -27,8 +27,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 4 <- Union 3 (GROUP, 1) - Union 3 <- Map 5 (NONE, 0), Map 6 (NONE, 0), Reducer 2 (NONE, 0) + Reducer 3 <- Map 4 (GROUP, 1), Map 5 (GROUP, 1), Reducer 2 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -47,7 +46,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 5 + Map 4 Map Operator Tree: TableScan alias: s2 @@ -67,7 +66,7 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: bigint) - Map 6 + Map 5 Map Operator Tree: TableScan alias: s3 @@ -109,7 +108,7 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: bigint) - Reducer 4 + Reducer 3 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -128,8 +127,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 3 - Vertex: Union 3 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union16.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union16.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union16.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union16.q.out Wed Dec 17 02:54:52 2014 @@ -72,8 +72,7 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 3 <- Union 2 (GROUP, 1) - Union 2 <- Map 1 (NONE, 0), Map 10 (NONE, 0), Map 11 (NONE, 0), Map 12 (NONE, 0), Map 13 (NONE, 0), Map 14 (NONE, 0), Map 15 (NONE, 0), Map 16 (NONE, 0), Map 17 (NONE, 0), Map 18 (NONE, 0), Map 19 (NONE, 0), Map 20 (NONE, 0), Map 21 (NONE, 0), Map 22 (NONE, 0), Map 23 (NONE, 0), Map 24 (NONE, 0), Map 25 (NONE, 0), Map 26 (NONE, 0), Map 27 (NONE, 0), Map 4 (NONE, 0), Map 5 (NONE, 0), Map 6 (NONE, 0), Map 7 (NONE, 0), Map 8 (NONE, 0), Map 9 (NONE, 0) + Reducer 2 <- Map 1 (GROUP, 1), Map 10 (GROUP, 1), Map 11 (GROUP, 1), Map 12 (GROUP, 1), Map 13 (GROUP, 1), Map 14 (GROUP, 1), Map 15 (GROUP, 1), Map 16 (GROUP, 1), Map 17 (GROUP, 1), Map 18 (GROUP, 1), Map 19 (GROUP, 1), Map 20 (GROUP, 1), Map 21 (GROUP, 1), Map 22 (GROUP, 1), Map 23 (GROUP, 1), Map 24 (GROUP, 1), Map 25 (GROUP, 1), Map 26 (GROUP, 1), Map 3 (GROUP, 1), Map 4 (GROUP, 1), Map 5 (GROUP, 1), Map 6 (GROUP, 1), Map 7 (GROUP, 1), Map 8 (GROUP, 1), Map 9 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -310,7 +309,7 @@ STAGE PLANS: Reduce Output Operator sort order: value expressions: _col0 (type: bigint) - Map 27 + Map 3 Map Operator Tree: TableScan alias: src @@ -401,7 +400,7 @@ STAGE PLANS: Reduce Output Operator sort order: value expressions: _col0 (type: bigint) - Reducer 3 + Reducer 2 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -419,8 +418,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 2 - Vertex: Union 2 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union18.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union18.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union18.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union18.q.out Wed Dec 17 02:54:52 2014 @@ -44,7 +44,6 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Union 3 <- Map 4 (NONE, 0), Reducer 2 (NONE, 0) #### A masked pattern was here #### Vertices: Map 1 @@ -63,7 +62,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: s2 @@ -113,8 +112,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.dest2 - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union19.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union19.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union19.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union19.q.out Wed Dec 17 02:54:52 2014 @@ -44,8 +44,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Union 3 <- Map 5 (NONE, 0), Reducer 2 (NONE, 0) - Reducer 4 <- Union 3 (GROUP, 1) + Reducer 3 <- Map 4 (GROUP, 1), Reducer 2 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -64,7 +63,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 5 + Map 4 Map Operator Tree: TableScan alias: s2 @@ -120,7 +119,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.dest2 - Reducer 4 + Reducer 3 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -136,8 +135,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.dest1 - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union2.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union2.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union2.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union2.q.out Wed Dec 17 02:54:52 2014 @@ -20,8 +20,7 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 3 <- Union 2 (GROUP, 1) - Union 2 <- Map 1 (NONE, 0), Map 4 (NONE, 0) + Reducer 2 <- Map 1 (GROUP, 1), Map 3 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -37,7 +36,7 @@ STAGE PLANS: Reduce Output Operator sort order: value expressions: _col0 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: s2 @@ -50,7 +49,7 @@ STAGE PLANS: Reduce Output Operator sort order: value expressions: _col0 (type: bigint) - Reducer 3 + Reducer 2 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -68,8 +67,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 2 - Vertex: Union 2 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union23.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union23.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union23.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union23.q.out Wed Dec 17 02:54:52 2014 @@ -24,8 +24,7 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Union 2 <- Map 1 (NONE, 0), Map 4 (NONE, 0) - Reducer 3 <- Union 2 (SORT, 1) + Reducer 2 <- Map 1 (SORT, 1), Map 3 (SORT, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -47,7 +46,7 @@ STAGE PLANS: Reduce Output Operator key expressions: _col0 (type: string), _col1 (type: string) sort order: ++ - Map 4 + Map 3 Map Operator Tree: TableScan alias: src @@ -60,7 +59,7 @@ STAGE PLANS: Reduce Output Operator key expressions: _col0 (type: string), _col1 (type: string) sort order: ++ - Reducer 3 + Reducer 2 Reduce Operator Tree: Select Operator expressions: KEY.reducesinkkey0 (type: string), KEY.reducesinkkey1 (type: string) @@ -73,8 +72,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 2 - Vertex: Union 2 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union25.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union25.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union25.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union25.q.out Wed Dec 17 02:54:52 2014 @@ -66,10 +66,8 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Union 5 <- Map 4 (NONE, 0), Map 7 (NONE, 0) - Reducer 6 <- Union 5 (GROUP, 3) - Union 2 <- Map 1 (NONE, 0), Reducer 6 (NONE, 0) - Reducer 3 <- Union 2 (GROUP, 3) + Reducer 4 <- Map 3 (GROUP, 3), Map 5 (GROUP, 3) + Reducer 2 <- Map 1 (GROUP, 3), Reducer 4 (GROUP, 3) #### A masked pattern was here #### Vertices: Map 1 @@ -89,7 +87,7 @@ STAGE PLANS: sort order: ++ Map-reduce partition columns: _col0 (type: string), _col1 (type: string) value expressions: _col2 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: a @@ -107,7 +105,7 @@ STAGE PLANS: key expressions: _col0 (type: string) sort order: + Map-reduce partition columns: _col0 (type: string) - Map 7 + Map 5 Map Operator Tree: TableScan alias: b @@ -125,7 +123,7 @@ STAGE PLANS: key expressions: _col0 (type: string) sort order: + Map-reduce partition columns: _col0 (type: string) - Reducer 3 + Reducer 2 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -145,7 +143,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.tmp_unionall - Reducer 6 + Reducer 4 Reduce Operator Tree: Group By Operator keys: KEY._col0 (type: string) @@ -164,10 +162,6 @@ STAGE PLANS: sort order: ++ Map-reduce partition columns: _col0 (type: string), _col1 (type: string) value expressions: _col2 (type: bigint) - Union 2 - Vertex: Union 2 - Union 5 - Vertex: Union 5 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union28.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union28.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union28.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union28.q.out Wed Dec 17 02:54:52 2014 @@ -41,9 +41,8 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 4 <- Map 3 (GROUP, 1) - Reducer 6 <- Map 5 (GROUP, 1) - Union 2 <- Map 1 (NONE, 0), Reducer 4 (NONE, 0), Reducer 6 (NONE, 0) + Reducer 3 <- Map 2 (GROUP, 1) + Reducer 5 <- Map 4 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -63,7 +62,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.union_subq_union - Map 3 + Map 2 Map Operator Tree: TableScan alias: src @@ -84,7 +83,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string), _col1 (type: string) Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE value expressions: _col2 (type: bigint) - Map 5 + Map 4 Map Operator Tree: TableScan alias: src @@ -105,7 +104,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string), _col1 (type: string) Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE value expressions: _col2 (type: bigint) - Reducer 4 + Reducer 3 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -128,7 +127,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.union_subq_union - Reducer 6 + Reducer 5 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -151,8 +150,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.union_subq_union - Union 2 - Vertex: Union 2 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union29.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union29.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union29.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union29.q.out Wed Dec 17 02:54:52 2014 @@ -40,8 +40,6 @@ STAGE DEPENDENCIES: STAGE PLANS: Stage: Stage-1 Spark - Edges: - Union 2 <- Map 1 (NONE, 0), Map 3 (NONE, 0), Map 4 (NONE, 0) #### A masked pattern was here #### Vertices: Map 1 @@ -61,7 +59,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.union_subq_union - Map 3 + Map 2 Map Operator Tree: TableScan alias: src @@ -78,7 +76,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.union_subq_union - Map 4 + Map 3 Map Operator Tree: TableScan alias: src @@ -95,8 +93,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.union_subq_union - Union 2 - Vertex: Union 2 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union3.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union3.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union3.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union3.q.out Wed Dec 17 02:54:52 2014 @@ -46,13 +46,12 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 11 <- Map 10 (GROUP, 1) + Reducer 10 <- Map 9 (GROUP, 1) Reducer 2 <- Map 1 (GROUP, 1) - Reducer 6 <- Map 5 (GROUP, 1) - Reducer 9 <- Map 8 (GROUP, 1) + Reducer 5 <- Map 4 (GROUP, 1) + Reducer 8 <- Map 7 (GROUP, 1) Reducer 3 <- Reducer 2 (SORT, 1) - Reducer 7 <- Reducer 6 (SORT, 1) - Union 4 <- Reducer 11 (NONE, 0), Reducer 3 (NONE, 0), Reducer 7 (NONE, 0), Reducer 9 (NONE, 0) + Reducer 6 <- Reducer 5 (SORT, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -68,7 +67,7 @@ STAGE PLANS: Reduce Output Operator sort order: Statistics: Num rows: 1 Data size: 0 Basic stats: PARTIAL Column stats: COMPLETE - Map 10 + Map 4 Map Operator Tree: TableScan alias: src @@ -81,7 +80,7 @@ STAGE PLANS: Reduce Output Operator sort order: Statistics: Num rows: 1 Data size: 0 Basic stats: PARTIAL Column stats: COMPLETE - Map 5 + Map 7 Map Operator Tree: TableScan alias: src @@ -94,7 +93,7 @@ STAGE PLANS: Reduce Output Operator sort order: Statistics: Num rows: 1 Data size: 0 Basic stats: PARTIAL Column stats: COMPLETE - Map 8 + Map 9 Map Operator Tree: TableScan alias: src @@ -107,7 +106,7 @@ STAGE PLANS: Reduce Output Operator sort order: Statistics: Num rows: 1 Data size: 0 Basic stats: PARTIAL Column stats: COMPLETE - Reducer 11 + Reducer 10 Reduce Operator Tree: Limit Number of rows: 1 @@ -151,7 +150,7 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Reducer 6 + Reducer 5 Reduce Operator Tree: Limit Number of rows: 1 @@ -165,7 +164,7 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: int) Statistics: Num rows: 1 Data size: 0 Basic stats: PARTIAL Column stats: COMPLETE - Reducer 7 + Reducer 6 Reduce Operator Tree: Select Operator expressions: KEY.reducesinkkey0 (type: int) @@ -179,7 +178,7 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Reducer 9 + Reducer 8 Reduce Operator Tree: Limit Number of rows: 1 @@ -195,8 +194,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 4 - Vertex: Union 4 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union30.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union30.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union30.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union30.q.out Wed Dec 17 02:54:52 2014 @@ -55,9 +55,8 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 4 <- Map 3 (GROUP, 1) - Reducer 6 <- Map 5 (GROUP, 1) - Union 2 <- Map 1 (NONE, 0), Map 7 (NONE, 0), Reducer 4 (NONE, 0), Reducer 6 (NONE, 0) + Reducer 3 <- Map 2 (GROUP, 1) + Reducer 5 <- Map 4 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -77,7 +76,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.union_subq_union - Map 3 + Map 2 Map Operator Tree: TableScan alias: src @@ -98,7 +97,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string), _col1 (type: string) Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE value expressions: _col2 (type: bigint) - Map 5 + Map 4 Map Operator Tree: TableScan alias: src @@ -119,7 +118,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string), _col1 (type: string) Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE value expressions: _col2 (type: bigint) - Map 7 + Map 6 Map Operator Tree: TableScan alias: src @@ -136,7 +135,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.union_subq_union - Reducer 4 + Reducer 3 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -159,7 +158,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.union_subq_union - Reducer 6 + Reducer 5 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -182,8 +181,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.union_subq_union - Union 2 - Vertex: Union 2 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union33.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union33.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union33.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union33.q.out Wed Dec 17 02:54:52 2014 @@ -41,9 +41,8 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 4 <- Map 3 (GROUP PARTITION-LEVEL SORT, 1) - Reducer 5 <- Reducer 4 (GROUP, 1) - Union 2 <- Map 1 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 3 <- Map 2 (GROUP PARTITION-LEVEL SORT, 1) + Reducer 4 <- Reducer 3 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -62,7 +61,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.test_src - Map 3 + Map 2 Map Operator Tree: TableScan alias: src @@ -83,7 +82,7 @@ STAGE PLANS: Map-reduce partition columns: rand() (type: double) Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE value expressions: _col1 (type: bigint) - Reducer 4 + Reducer 3 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -97,7 +96,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE value expressions: _col1 (type: bigint) - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -114,8 +113,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.test_src - Union 2 - Vertex: Union 2 Stage: Stage-0 Move Operator @@ -191,7 +188,6 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP PARTITION-LEVEL SORT, 3) - Union 4 <- Map 5 (NONE, 0), Reducer 3 (NONE, 0) Reducer 3 <- Reducer 2 (GROUP, 3) #### A masked pattern was here #### Vertices: @@ -216,7 +212,7 @@ STAGE PLANS: Map-reduce partition columns: rand() (type: double) Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE value expressions: _col1 (type: bigint) - Map 5 + Map 4 Map Operator Tree: TableScan alias: src @@ -263,8 +259,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.test_src - Union 4 - Vertex: Union 4 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union4.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union4.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union4.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union4.q.out Wed Dec 17 02:54:52 2014 @@ -34,8 +34,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 5 <- Map 4 (GROUP, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -54,7 +53,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: s2 @@ -89,7 +88,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.tmptable - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -108,8 +107,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.tmptable - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union5.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union5.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union5.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union5.q.out Wed Dec 17 02:54:52 2014 @@ -23,9 +23,8 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 4 <- Union 3 (GROUP, 1) - Reducer 6 <- Map 5 (GROUP, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 6 (NONE, 0) + Reducer 5 <- Map 4 (GROUP, 1) + Reducer 3 <- Reducer 2 (GROUP, 1), Reducer 5 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -44,7 +43,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 5 + Map 4 Map Operator Tree: TableScan alias: s2 @@ -82,7 +81,7 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: bigint) - Reducer 4 + Reducer 3 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -101,7 +100,7 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Reducer 6 + Reducer 5 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -123,8 +122,6 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: bigint) - Union 3 - Vertex: Union 3 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union6.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union6.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union6.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union6.q.out Wed Dec 17 02:54:52 2014 @@ -34,7 +34,6 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Union 3 <- Map 4 (NONE, 0), Reducer 2 (NONE, 0) #### A masked pattern was here #### Vertices: Map 1 @@ -53,7 +52,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: s2 @@ -83,8 +82,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.tmptable - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union7.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union7.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union7.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union7.q.out Wed Dec 17 02:54:52 2014 @@ -23,8 +23,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 4 <- Union 3 (GROUP, 1) - Union 3 <- Map 5 (NONE, 0), Reducer 2 (NONE, 0) + Reducer 3 <- Map 4 (GROUP, 1), Reducer 2 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -43,7 +42,7 @@ STAGE PLANS: sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE value expressions: _col0 (type: bigint) - Map 5 + Map 4 Map Operator Tree: TableScan alias: s2 @@ -85,7 +84,7 @@ STAGE PLANS: sort order: + Map-reduce partition columns: _col0 (type: string) value expressions: _col1 (type: bigint) - Reducer 4 + Reducer 3 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -104,8 +103,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 3 - Vertex: Union 3 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union8.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union8.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union8.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union8.q.out Wed Dec 17 02:54:52 2014 @@ -21,8 +21,6 @@ STAGE DEPENDENCIES: STAGE PLANS: Stage: Stage-1 Spark - Edges: - Union 2 <- Map 1 (NONE, 0), Map 3 (NONE, 0), Map 4 (NONE, 0) #### A masked pattern was here #### Vertices: Map 1 @@ -41,7 +39,7 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Map 3 + Map 2 Map Operator Tree: TableScan alias: s2 @@ -57,7 +55,7 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Map 4 + Map 3 Map Operator Tree: TableScan alias: s3 @@ -73,8 +71,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 2 - Vertex: Union 2 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union9.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union9.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union9.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union9.q.out Wed Dec 17 02:54:52 2014 @@ -22,8 +22,7 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 3 <- Union 2 (GROUP, 1) - Union 2 <- Map 1 (NONE, 0), Map 4 (NONE, 0), Map 5 (NONE, 0) + Reducer 2 <- Map 1 (GROUP, 1), Map 3 (GROUP, 1), Map 4 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -39,7 +38,7 @@ STAGE PLANS: Reduce Output Operator sort order: value expressions: _col0 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: s2 @@ -52,7 +51,7 @@ STAGE PLANS: Reduce Output Operator sort order: value expressions: _col0 (type: bigint) - Map 5 + Map 4 Map Operator Tree: TableScan alias: s3 @@ -65,7 +64,7 @@ STAGE PLANS: Reduce Output Operator sort order: value expressions: _col0 (type: bigint) - Reducer 3 + Reducer 2 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -83,8 +82,6 @@ STAGE PLANS: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Union 2 - Vertex: Union 2 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_ppr.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_ppr.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_ppr.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_ppr.q.out Wed Dec 17 02:54:52 2014 @@ -112,8 +112,7 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Union 2 <- Map 1 (NONE, 0), Map 4 (NONE, 0) - Reducer 3 <- Union 2 (SORT, 1) + Reducer 2 <- Map 1 (SORT, 1), Map 3 (SORT, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -233,7 +232,7 @@ STAGE PLANS: Truncated Path -> Alias: /srcpart/ds=2008-04-08/hr=11 [x] /srcpart/ds=2008-04-08/hr=12 [x] - Map 4 + Map 3 Map Operator Tree: TableScan alias: y @@ -350,7 +349,7 @@ STAGE PLANS: Truncated Path -> Alias: /srcpart/ds=2008-04-08/hr=11 [y] /srcpart/ds=2008-04-08/hr=12 [y] - Reducer 3 + Reducer 2 Needs Tagging: false Reduce Operator Tree: Select Operator @@ -378,8 +377,6 @@ STAGE PLANS: TotalFiles: 1 GatherStats: false MultiFileSpray: false - Union 2 - Vertex: Union 2 Stage: Stage-0 Fetch Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_1.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_1.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_1.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_1.q.out Wed Dec 17 02:54:52 2014 @@ -69,8 +69,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 5 <- Map 4 (GROUP, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -94,7 +93,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col1 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: inputtbl1 @@ -129,7 +128,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -143,8 +142,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_10.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_10.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_10.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_10.q.out Wed Dec 17 02:54:52 2014 @@ -89,8 +89,7 @@ STAGE PLANS: Stage: Stage-1 Spark Edges: - Reducer 4 <- Map 3 (GROUP, 1) - Union 2 <- Map 1 (NONE, 0), Map 5 (NONE, 0), Reducer 4 (NONE, 0) + Reducer 3 <- Map 2 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -107,7 +106,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Map 3 + Map 2 Map Operator Tree: TableScan alias: inputtbl1 @@ -128,7 +127,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col1 (type: bigint) - Map 5 + Map 4 Map Operator Tree: TableScan alias: inputtbl1 @@ -142,7 +141,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Reducer 4 + Reducer 3 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -156,8 +155,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Union 2 - Vertex: Union 2 Stage: Stage-6 Conditional Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_11.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_11.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_11.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_11.q.out Wed Dec 17 02:54:52 2014 @@ -88,8 +88,6 @@ STAGE DEPENDENCIES: STAGE PLANS: Stage: Stage-1 Spark - Edges: - Union 2 <- Map 1 (NONE, 0), Map 3 (NONE, 0), Map 4 (NONE, 0) #### A masked pattern was here #### Vertices: Map 1 @@ -109,7 +107,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Map 3 + Map 2 Map Operator Tree: TableScan alias: inputtbl1 @@ -126,7 +124,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Map 4 + Map 3 Map Operator Tree: TableScan alias: inputtbl1 @@ -143,8 +141,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Union 2 - Vertex: Union 2 Stage: Stage-6 Conditional Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_15.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_15.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_15.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_15.q.out Wed Dec 17 02:54:52 2014 @@ -75,8 +75,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 5 <- Map 4 (GROUP, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -100,7 +99,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col1 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: inputtbl1 @@ -138,7 +137,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -155,8 +154,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_16.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_16.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_16.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_16.q.out Wed Dec 17 02:54:52 2014 @@ -78,8 +78,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 5 <- Map 4 (GROUP, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -103,7 +102,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col1 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: inputtbl1 @@ -141,7 +140,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -158,8 +157,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Union 3 - Vertex: Union 3 Stage: Stage-6 Conditional Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_17.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_17.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_17.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_17.q.out Wed Dec 17 02:54:52 2014 @@ -67,8 +67,6 @@ STAGE DEPENDENCIES: STAGE PLANS: Stage: Stage-1 Spark - Edges: - Union 2 <- Map 1 (NONE, 0), Map 3 (NONE, 0) #### A masked pattern was here #### Vertices: Map 1 @@ -88,7 +86,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Map 3 + Map 2 Map Operator Tree: TableScan alias: inputtbl1 @@ -105,8 +103,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe name: default.outputtbl1 - Union 2 - Vertex: Union 2 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_18.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_18.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_18.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_18.q.out Wed Dec 17 02:54:52 2014 @@ -73,8 +73,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 5 <- Map 4 (GROUP, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -98,7 +97,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string), _col1 (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col2 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: inputtbl1 @@ -136,7 +135,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -153,8 +152,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_19.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_19.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_19.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_19.q.out Wed Dec 17 02:54:52 2014 @@ -73,8 +73,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 5 <- Map 4 (GROUP, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -98,7 +97,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col1 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: inputtbl1 @@ -133,7 +132,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -147,8 +146,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator @@ -265,8 +262,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 3) - Reducer 5 <- Map 4 (GROUP, 3) - Union 3 <- Reducer 2 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 3) #### A masked pattern was here #### Vertices: Map 1 @@ -293,7 +289,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 15 Data size: 15 Basic stats: COMPLETE Column stats: NONE value expressions: _col1 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: inputtbl1 @@ -337,7 +333,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -357,8 +353,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator @@ -437,8 +431,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 3) - Reducer 5 <- Map 4 (GROUP, 3) - Union 3 <- Reducer 2 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 3) #### A masked pattern was here #### Vertices: Map 1 @@ -462,7 +455,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col1 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: inputtbl1 @@ -502,7 +495,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -521,8 +514,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_2.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_2.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_2.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_2.q.out Wed Dec 17 02:54:52 2014 @@ -75,7 +75,6 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Union 3 <- Map 4 (NONE, 0), Map 5 (NONE, 0), Reducer 2 (NONE, 0) #### A masked pattern was here #### Vertices: Map 1 @@ -99,7 +98,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col1 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: inputtbl1 @@ -113,7 +112,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Map 5 + Map 4 Map Operator Tree: TableScan alias: inputtbl1 @@ -141,8 +140,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_20.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_20.q.out?rev=1646142&r1=1646141&r2=1646142&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_20.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/spark/union_remove_20.q.out Wed Dec 17 02:54:52 2014 @@ -71,8 +71,7 @@ STAGE PLANS: Spark Edges: Reducer 2 <- Map 1 (GROUP, 1) - Reducer 5 <- Map 4 (GROUP, 1) - Union 3 <- Reducer 2 (NONE, 0), Reducer 5 (NONE, 0) + Reducer 4 <- Map 3 (GROUP, 1) #### A masked pattern was here #### Vertices: Map 1 @@ -96,7 +95,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col1 (type: bigint) - Map 4 + Map 3 Map Operator Tree: TableScan alias: inputtbl1 @@ -134,7 +133,7 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Reducer 5 + Reducer 4 Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) @@ -151,8 +150,6 @@ STAGE PLANS: output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: default.outputtbl1 - Union 3 - Vertex: Union 3 Stage: Stage-0 Move Operator
