-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25176/
-----------------------------------------------------------

Review request for hive, Brock Noland, Szehon Ho, and Xuefu Zhang.


Bugs: HIVE-7870
    https://issues.apache.org/jira/browse/HIVE-7870


Repository: hive-git


Description
-------

HIVE-7870: Insert overwrite table query does not generate correct task plan 
[Spark Branch]

The cause of this problem is during spark/tez task generation, the union file 
sink operator are cloned to two new filesink operator. The linkedfilesinkdesc 
info for those new filesink operators are missing. In addition, the two new 
filesink operators also need to be linked together.   


Diffs
-----

  itests/src/test/resources/testconfiguration.properties 6393671 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java 9c808d4 
  ql/src/java/org/apache/hadoop/hive/ql/parse/spark/GenSparkProcContext.java 
5ddc16d 
  ql/src/java/org/apache/hadoop/hive/ql/parse/spark/GenSparkUtils.java 379a39c 
  ql/src/java/org/apache/hadoop/hive/ql/parse/spark/SparkCompiler.java 76fc290 
  ql/src/test/queries/clientpositive/union_remove_spark_1.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_10.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_15.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_16.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_17.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_18.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_19.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_2.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_20.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_21.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_24.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_25.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_3.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_4.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_5.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_6.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_7.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_8.q PRE-CREATION 
  ql/src/test/queries/clientpositive/union_remove_spark_9.q PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_1.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_10.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_11.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_15.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_16.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_17.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_18.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_19.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_2.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_20.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_21.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_24.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_25.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_3.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_4.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_5.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_6.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_7.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_8.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/spark/union_remove_spark_9.q.out 
PRE-CREATION 

Diff: https://reviews.apache.org/r/25176/diff/


Testing
-------


Thanks,

Na Yang

Reply via email to