[jira] [Updated] (HIVE-7465) Implement pre-commit testing [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7465: -- Fix Version/s: (was: spark-branch) 1.1.0 Implement pre-commit testing [Spark

[jira] [Updated] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9041: -- Fix Version/s: (was: spark-branch) 1.1.0 Generate better plan for queries

[jira] [Updated] (HIVE-7815) Reduce Side Join with single reducer [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7815: -- Fix Version/s: (was: spark-branch) 1.1.0 Reduce Side Join with single reducer

[jira] [Updated] (HIVE-8682) Enable table statistic collection on counter for CTAS query[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8682: -- Fix Version/s: (was: spark-branch) 1.1.0 Enable table statistic collection on

[jira] [Updated] (HIVE-8015) Merge from trunk (3) [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8015: -- Fix Version/s: (was: spark-branch) 1.1.0 Merge from trunk (3) [Spark Branch]

[jira] [Updated] (HIVE-7766) Cleanup Reduce operator code [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7766: -- Fix Version/s: (was: spark-branch) 1.1.0 Cleanup Reduce operator code [Spark

[jira] [Updated] (HIVE-7749) Enable timestamp.* tests [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7749: -- Fix Version/s: (was: spark-branch) 1.1.0 Enable timestamp.* tests [Spark Branch]

[jira] [Updated] (HIVE-9449) Push YARN configuration to Spark while deply Spark on YARN[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9449: -- Fix Version/s: (was: spark-branch) Push YARN configuration to Spark while deply Spark on YARN[Spark

[jira] [Updated] (HIVE-7930) enable vectorization_short_regress.q, vector_string_concat.q [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7930: -- Fix Version/s: (was: spark-branch) 1.1.0 enable vectorization_short_regress.q,

[jira] [Updated] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8616: -- Fix Version/s: (was: spark-branch) 1.1.0 convert joinOp to MapJoinOp and

[jira] [Updated] (HIVE-9098) Check cross product for conditional task [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9098: -- Fix Version/s: (was: spark-branch) 1.1.0 Check cross product for conditional

[jira] [Updated] (HIVE-9094) TimeoutException when trying get executor count from RSC [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9094: -- Fix Version/s: (was: spark-branch) 1.1.0 TimeoutException when trying get

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Fix Version/s: (was: spark-branch) 1.1.0 Let Context.isLocalOnlyExecutionMode()

[jira] [Updated] (HIVE-8959) SparkSession is not closed until JVM exit.[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8959: -- Fix Version/s: (was: spark-branch) 1.1.0 SparkSession is not closed until JVM

[jira] [Updated] (HIVE-8302) GroupByShuffler.java missing apache license header [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8302: -- Fix Version/s: (was: spark-branch) 1.1.0 GroupByShuffler.java missing apache

[jira] [Updated] (HIVE-9319) Cleanup Modified Files [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9319: -- Fix Version/s: (was: spark-branch) 1.1.0 Cleanup Modified Files [Spark Branch]

[jira] [Updated] (HIVE-7606) Design SparkSession, SparkSessionManager [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7606: -- Fix Version/s: (was: spark-branch) 1.1.0 Design SparkSession,

[jira] [Updated] (HIVE-9379) Fix tests with some versions of Spark + Snappy [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9379: -- Fix Version/s: (was: spark-branch) 1.1.0 Fix tests with some versions of Spark +

[jira] [Updated] (HIVE-7856) Enable parallelism in Reduce Side Join [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7856: -- Fix Version/s: (was: spark-branch) 1.1.0 Enable parallelism in Reduce Side Join

[jira] [Updated] (HIVE-8640) Support hints of SMBJoin [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8640: -- Fix Version/s: (was: spark-branch) 1.1.0 Support hints of SMBJoin [Spark Branch]

[jira] [Updated] (HIVE-8572) Enable more vectorization tests [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8572: -- Fix Version/s: (was: spark-branch) 1.1.0 Enable more vectorization tests [Spark

[jira] [Updated] (HIVE-8140) Remove obsolete code from SparkWork [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8140: -- Fix Version/s: (was: spark-branch) 1.1.0 Remove obsolete code from SparkWork

[jira] [Updated] (HIVE-8528) Add remote Spark client to Hive [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8528: -- Fix Version/s: (was: spark-branch) 1.1.0 Add remote Spark client to Hive [Spark

[jira] [Updated] (HIVE-8995) Find thread leak in RSC Tests [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8995: -- Fix Version/s: (was: spark-branch) 1.1.0 Find thread leak in RSC Tests [Spark

[jira] [Updated] (HIVE-7866) Merge from trunk (1) [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7866: -- Fix Version/s: (was: spark-branch) 1.1.0 Merge from trunk (1) [Spark Branch]

[jira] [Updated] (HIVE-8303) Merge from trunk to spark 9/29/14

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8303: -- Fix Version/s: (was: spark-branch) 1.1.0 Merge from trunk to spark 9/29/14

[jira] [Updated] (HIVE-9552) Merge trunk to Spark branch 2/2/2015 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9552: -- Fix Version/s: (was: spark-branch) 1.1.0 Merge trunk to Spark branch 2/2/2015

[jira] [Updated] (HIVE-8970) Enable map join optimization only when hive.auto.convert.join is true [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8970: -- Fix Version/s: (was: spark-branch) 1.1.0 Enable map join optimization only when

[jira] [Updated] (HIVE-8456) Support Hive Counter to collect spark job metric[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8456: -- Fix Version/s: (was: spark-branch) 1.1.0 Support Hive Counter to collect spark

[jira] [Updated] (HIVE-8942) Investigate test failure on skewjoin.q [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8942: -- Fix Version/s: (was: spark-branch) 1.1.0 Investigate test failure on skewjoin.q

[jira] [Updated] (HIVE-8502) Merge trunk into spark 10/17/14 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8502: -- Fix Version/s: (was: spark-branch) 1.1.0 Merge trunk into spark 10/17/14 [Spark

[jira] [Updated] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8622: -- Fix Version/s: (was: spark-branch) 1.1.0 Split map-join plan into 2 SparkTasks

[jira] [Updated] (HIVE-7772) Add tests for order/sort/distribute/cluster by query [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7772: -- Fix Version/s: (was: spark-branch) 1.1.0 Add tests for

[jira] [Updated] (HIVE-8623) Implement HashTableLoader for Spark map-join [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8623: -- Fix Version/s: (was: spark-branch) 1.1.0 Implement HashTableLoader for Spark

[jira] [Updated] (HIVE-9179) Add listeners on JobHandle so job status change can be notified to the client [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9179: -- Fix Version/s: (was: spark-branch) 1.1.0 Add listeners on JobHandle so job

[jira] [Updated] (HIVE-9256) Merge trunk to spark 1/5/2015 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9256: -- Fix Version/s: (was: spark-branch) 1.1.0 Merge trunk to spark 1/5/2015 [Spark

[jira] [Updated] (HIVE-8043) Support merging small files [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8043: -- Fix Version/s: (was: spark-branch) 1.1.0 Support merging small files [Spark

[jira] [Updated] (HIVE-9036) Replace akka for remote spark client RPC [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9036: -- Fix Version/s: (was: spark-branch) 1.1.0 Replace akka for remote spark client

[jira] [Updated] (HIVE-7792) Enable tests on Spark branch (2) [Sparch Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7792: -- Fix Version/s: (was: spark-branch) 1.1.0 Enable tests on Spark branch (2)

[jira] [Updated] (HIVE-9099) infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9099: -- Fix Version/s: (was: spark-branch) 1.1.0 infer_bucket_sort_convert_join.q and

[jira] [Updated] (HIVE-9281) Code cleanup [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9281: -- Fix Version/s: (was: spark-branch) 1.1.0 Code cleanup [Spark Branch]

[jira] [Updated] (HIVE-8455) Print Spark job progress format info on the console[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8455: -- Fix Version/s: (was: spark-branch) 1.1.0 Print Spark job progress format info on

[jira] [Updated] (HIVE-7881) enable Qtest scriptfile1.q [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7881: -- Fix Version/s: (was: spark-branch) 1.1.0 enable Qtest scriptfile1.q [Spark

[jira] [Updated] (HIVE-8118) Support work that have multiple child works to work around SPARK-3622 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8118: -- Fix Version/s: (was: spark-branch) 1.1.0 Support work that have multiple child

[jira] [Updated] (HIVE-8963) Investigate test failure on bucketmapjoin7.q [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8963: -- Fix Version/s: (was: spark-branch) 1.1.0 Investigate test failure on

[jira] [Updated] (HIVE-8984) Enable job metrics/statistics gathering for remote spark context [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8984: -- Fix Version/s: (was: spark-branch) 1.1.0 Enable job metrics/statistics gathering

[jira] [Updated] (HIVE-9428) LocalSparkJobStatus may return failed job as successful [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9428: -- Fix Version/s: (was: spark-branch) LocalSparkJobStatus may return failed job as successful [Spark

[jira] [Updated] (HIVE-8106) Enable vectorization for spark [spark branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8106: -- Fix Version/s: (was: spark-branch) 1.1.0 Enable vectorization for spark [spark

[jira] [Updated] (HIVE-8463) Add numPartitions info to SparkEdgeProperty [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8463: -- Fix Version/s: (was: spark-branch) 1.1.0 Add numPartitions info to

[jira] [Updated] (HIVE-7626) Add jar through CLI did not loaded by Spark executor[Spark Branck]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7626: -- Fix Version/s: (was: spark-branch) 1.1.0 Add jar through CLI did not loaded by

[jira] [Updated] (HIVE-7642) Set hive input format by configuration.[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7642: -- Fix Version/s: (was: spark-branch) 1.1.0 Set hive input format by

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9059: -- Fix Version/s: (was: spark-branch) 1.1.0 Remove wrappers for SparkJobInfo and

[jira] [Updated] (HIVE-7560) StarterProject: Fix exception handling in POC code [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7560: -- Fix Version/s: (was: spark-branch) 1.1.0 StarterProject: Fix exception handling

[jira] [Updated] (HIVE-7439) Spark job monitoring and error reporting [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7439: -- Fix Version/s: (was: spark-branch) 1.1.0 Spark job monitoring and error

[jira] [Updated] (HIVE-7848) Refresh SparkContext when spark configuration changes [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7848: -- Fix Version/s: (was: spark-branch) 1.1.0 Refresh SparkContext when spark

[jira] [Updated] (HIVE-7842) Enable qtest load_dyn_part1.q [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7842: -- Fix Version/s: (was: spark-branch) 1.1.0 Enable qtest load_dyn_part1.q [Spark

[jira] [Updated] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8639: -- Fix Version/s: (was: spark-branch) 1.1.0 Convert SMBJoin to MapJoin [Spark

[jira] [Updated] (HIVE-7767) hive.optimize.union.remove does not work properly [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7767: -- Fix Version/s: (was: spark-branch) 1.1.0 hive.optimize.union.remove does not

[jira] [Updated] (HIVE-9267) Ensure custom UDF works with Spark [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9267: -- Fix Version/s: (was: spark-branch) 1.1.0 Ensure custom UDF works with Spark

[jira] [Updated] (HIVE-10863) Merge trunk to Spark branch 5/28/2015 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10863: --- Attachment: mj.patch Merge trunk to Spark branch 5/28/2015 [Spark Branch]

[jira] [Commented] (HIVE-10863) Merge trunk to Spark branch 5/28/2015 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564198#comment-14564198 ] Xuefu Zhang commented on HIVE-10863: Unfortunately, the patch is too big to be

[jira] [Updated] (HIVE-10863) Merge trunk to Spark branch 5/28/2015 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10863: --- Attachment: HIVE-10863.0-spark.patch Patch #0 is a dummy patch to trigger a test run. Merge trunk

[jira] [Comment Edited] (HIVE-10821) Beeline-CLI: Implement CLI source command using Beeline functionality

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564806#comment-14564806 ] Xuefu Zhang edited comment on HIVE-10821 at 5/29/15 1:36 PM: -

[jira] [Comment Edited] (HIVE-10821) Beeline-CLI: Implement CLI source command using Beeline functionality

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564806#comment-14564806 ] Xuefu Zhang edited comment on HIVE-10821 at 5/29/15 1:37 PM: -

[jira] [Commented] (HIVE-10821) Beeline-CLI: Implement CLI source command using Beeline functionality

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564806#comment-14564806 ] Xuefu Zhang commented on HIVE-10821: [~Ferd], thanks for working on this. If you're

[jira] [Updated] (HIVE-10434) Cancel connection when remote Spark driver process has failed [Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10434: --- Fix Version/s: (was: spark-branch) 1.3.0 Cancel connection when remote Spark

[jira] [Updated] (HIVE-10473) Spark client is recreated even spark configuration is not changed

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10473: --- Fix Version/s: (was: spark-branch) 1.3.0 Spark client is recreated even spark

[jira] [Updated] (HIVE-10626) Spark paln need to be updated [Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10626: --- Fix Version/s: (was: spark-branch) 1.3.0 Spark paln need to be updated [Spark

[jira] [Updated] (HIVE-10458) Enable parallel order by for spark [Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10458: --- Fix Version/s: (was: spark-branch) 1.3.0 Enable parallel order by for spark

[jira] [Updated] (HIVE-10302) Load small tables (for map join) in executor memory only once [Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10302: --- Fix Version/s: (was: spark-branch) 1.3.0 Load small tables (for map join) in

[jira] [Updated] (HIVE-10527) NPE in SparkUtilities::isDedicatedCluster [Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10527: --- Fix Version/s: (was: spark-branch) 1.3.0 NPE in

[jira] [Updated] (HIVE-8858) Visualize generated Spark plan [Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8858: -- Fix Version/s: (was: spark-branch) 1.3.0 Visualize generated Spark plan [Spark

[jira] [Commented] (HIVE-10870) Merge Spark branch to trunk 5/29/2015

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568008#comment-14568008 ] Xuefu Zhang commented on HIVE-10870: All patches are cherry-picked to master, with

[jira] [Updated] (HIVE-10476) Hive query should fail when it fails to initialize a session in SetSparkReducerParallelism [Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10476: --- Fix Version/s: (was: spark-branch) 1.3.0 Hive query should fail when it fails

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10550: --- Fix Version/s: (was: spark-branch) 1.3.0 Dynamic RDD caching optimization for

[jira] [Updated] (HIVE-10302) Load small tables (for map join) in executor memory only once [Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10302: --- Attachment: 10302.patch Patch 10302 (without HIVE-) is the result of rebasing with latest master,

[jira] [Updated] (HIVE-10671) yarn-cluster mode offers a degraded performance from yarn-client [Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10671: --- Fix Version/s: (was: spark-branch) 1.3.0 yarn-cluster mode offers a degraded

[jira] [Updated] (HIVE-10721) SparkSessionManagerImpl leaks SparkSessions [Spark Branch]

2015-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10721: --- Fix Version/s: (was: spark-branch) 1.3.0 SparkSessionManagerImpl leaks

[jira] [Commented] (HIVE-6867) Bucketized Table feature fails in some cases

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565734#comment-14565734 ] Xuefu Zhang commented on HIVE-6867: --- I don't quite understand either the major change or

[jira] [Commented] (HIVE-6867) Bucketized Table feature fails in some cases

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565548#comment-14565548 ] Xuefu Zhang commented on HIVE-6867: --- Yeah. I saw that, but I was wondering why we cannot

[jira] [Commented] (HIVE-10771) separatorChar has no effect in CREATE TABLE AS SELECT statement

2015-05-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562127#comment-14562127 ] Xuefu Zhang commented on HIVE-10771: Doesn't appear so. This is just to fix something

[jira] [Commented] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562274#comment-14562274 ] Xuefu Zhang commented on HIVE-10550: +1 to latest patch if tests passes. Thanks.

[jira] [Updated] (HIVE-10850) Followup for HIVE-10550, check performance w.r.t. persistence level

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10850: --- Summary: Followup for HIVE-10550, check performance w.r.t. persistence level (was: Followup for

[jira] [Updated] (HIVE-10850) Followup for HIVE-10550, check performance w.r.t. persistence level [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10850: --- Summary: Followup for HIVE-10550, check performance w.r.t. persistence level [Spark Branch] (was:

[jira] [Commented] (HIVE-10761) Create codahale-based metrics system for Hive

2015-06-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569341#comment-14569341 ] Xuefu Zhang commented on HIVE-10761: +1 Create codahale-based metrics system for

[jira] [Commented] (HIVE-10761) Create codahale-based metrics system for Hive

2015-06-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569345#comment-14569345 ] Xuefu Zhang commented on HIVE-10761: +1 Create codahale-based metrics system for

[jira] [Updated] (HIVE-10868) Update release note for 1.2.0 and 1.1.0

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10868: --- Attachment: HIVE-10868.patch Update release note for 1.2.0 and 1.1.0

[jira] [Commented] (HIVE-9863) Querying parquet tables fails with IllegalStateException [Spark Branch]

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565196#comment-14565196 ] Xuefu Zhang commented on HIVE-9863: --- Okay. Let me try to reproduce it with the old

[jira] [Commented] (HIVE-6867) Bucketized Table feature fails in some cases

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565242#comment-14565242 ] Xuefu Zhang commented on HIVE-6867: --- [~pxiong], Looking at the latest patch, I don't

[jira] [Updated] (HIVE-10870) Merge Spark branch to trunk 5/29/2015

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10870: --- Attachment: HIVE-10870.patch Patch is generated by cherry-picking patches from Spark branch and

[jira] [Comment Edited] (HIVE-10283) HIVE-4240 may be causing issue with bucketed tables

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565200#comment-14565200 ] Xuefu Zhang edited comment on HIVE-10283 at 5/29/15 9:29 PM: -

[jira] [Resolved] (HIVE-10868) Update release note for 1.2.0 and 1.1.0

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-10868. Resolution: Fixed Fix Version/s: 1.3.0 Committed to master. Thanks to Thejas for the review.

[jira] [Commented] (HIVE-10283) HIVE-4240 may be causing issue with bucketed tables

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565467#comment-14565467 ] Xuefu Zhang commented on HIVE-10283: If this is the case, then it's a serious issue.

[jira] [Commented] (HIVE-6867) Bucketized Table feature fails in some cases

2015-05-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565473#comment-14565473 ] Xuefu Zhang commented on HIVE-6867: --- Thanks for the explanation, [~pxiong]. However, even

[jira] [Commented] (HIVE-11112) ISO-8859-1 text output has fragments of previous longer rows appended

2015-06-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605788#comment-14605788 ] Xuefu Zhang commented on HIVE-2: To accelerate the process, I committed the patch

[jira] [Commented] (HIVE-11135) Fix the Beeline set and save command in order to avoid the NullPointerException

2015-06-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604501#comment-14604501 ] Xuefu Zhang commented on HIVE-11135: +1 Fix the Beeline set and save command in

[jira] [Commented] (HIVE-10673) Dynamically partitioned hash join for Tez

2015-06-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604508#comment-14604508 ] Xuefu Zhang commented on HIVE-10673: Sorry if this obvious, but could we have details

[jira] [Commented] (HIVE-10616) TypeInfoUtils doesn't handle DECIMAL with just precision specified

2015-06-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604478#comment-14604478 ] Xuefu Zhang commented on HIVE-10616: Agreed with Alex, I don't think there is any

[jira] [Commented] (HIVE-10983) SerDeUtils bug ,when Text is reused

2015-06-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604491#comment-14604491 ] Xuefu Zhang commented on HIVE-10983: Actually, this issue is probably the same as

[jira] [Commented] (HIVE-11112) ISO-8859-1 text output has fragments of previous longer rows appended

2015-06-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604493#comment-14604493 ] Xuefu Zhang commented on HIVE-2: [~ychena], could you check if the patch in

<    1   2   3   4   5   6   7   8   9   10   >