[jira] [Commented] (HIVE-15526) Some tests need SORT_QUERY_RESULTS

2017-01-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794403#comment-15794403 ] Rui Li commented on HIVE-15526: --- Failures not related. [~xuefuz], could you have a look? The change is

[jira] [Updated] (HIVE-15526) Some tests need SORT_QUERY_RESULTS

2017-01-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15526: -- Description: {{temp_table_gb1.q}} and {{vector_between_in.q}} > Some tests need SORT_QUERY_RESULTS >

[jira] [Commented] (HIVE-15526) Some tests need SORT_QUERY_RESULTS

2017-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794388#comment-15794388 ] Hive QA commented on HIVE-15526: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15530) Optimize the column stats update logic in table alteration

2017-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794303#comment-15794303 ] Hive QA commented on HIVE-15530: Here are the results of testing the latest attachment:

[jira] [Resolved] (HIVE-15313) Add export spark.yarn.archive or spark.yarn.jars variable in Hive on Spark document

2017-01-02 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu resolved HIVE-15313. - Resolution: Fixed Fix Version/s: 2.2.0 Updated the (Configuring Hive section

[jira] [Updated] (HIVE-15525) Hooking ChangeManager to "drop table", "drop partition"

2017-01-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15525: -- Attachment: HIVE-15525.2.patch > Hooking ChangeManager to "drop table", "drop partition" >

[jira] [Commented] (HIVE-15313) Add export spark.yarn.archive or spark.yarn.jars variable in Hive on Spark document

2017-01-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794215#comment-15794215 ] Rui Li commented on HIVE-15313: --- [~Ferd], yeah I'm OK to update the wiki for performance first. I'll update

[jira] [Updated] (HIVE-15526) Some tests need SORT_QUERY_RESULTS

2017-01-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15526: -- Status: Patch Available (was: Open) > Some tests need SORT_QUERY_RESULTS > --

[jira] [Updated] (HIVE-15526) Some tests need SORT_QUERY_RESULTS

2017-01-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15526: -- Attachment: HIVE-15526.1.patch > Some tests need SORT_QUERY_RESULTS > -- > >

[jira] [Commented] (HIVE-15527) Memory usage is unbound in SortByShuffler for Spark

2017-01-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794194#comment-15794194 ] Xuefu Zhang commented on HIVE-15527: [~csun], [~lirui], and [~kellyzly], thanks for your feedback. The

[jira] [Resolved] (HIVE-8373) OOM for a simple query with spark.master=local [Spark Branch]

2017-01-02 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu resolved HIVE-8373. Resolution: Fixed Fix Version/s: 2.2.0 WIKI has been updated. Thanks [~kellyzly] for the

[jira] [Commented] (HIVE-15530) Optimize the column stats update logic in table alteration

2017-01-02 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794176#comment-15794176 ] Pengcheng Xiong commented on HIVE-15530: [~Yibing], could u add a test case for this? Thanks. >

[jira] [Updated] (HIVE-15530) Optimize the column stats update logic in table alteration

2017-01-02 Thread Yibing Shi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yibing Shi updated HIVE-15530: -- Status: Patch Available (was: Open) > Optimize the column stats update logic in table alteration >

[jira] [Assigned] (HIVE-15530) Optimize the column stats update logic in table alteration

2017-01-02 Thread Yibing Shi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yibing Shi reassigned HIVE-15530: - Assignee: Yibing Shi > Optimize the column stats update logic in table alteration >

[jira] [Updated] (HIVE-15530) Optimize the column stats update logic in table alteration

2017-01-02 Thread Yibing Shi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yibing Shi updated HIVE-15530: -- Attachment: HIVE-15530.1.patch > Optimize the column stats update logic in table alteration >

[jira] [Updated] (HIVE-15313) Add export spark.yarn.archive or spark.yarn.jars variable in Hive on Spark document

2017-01-02 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-15313: Assignee: liyunzhang_intel > Add export spark.yarn.archive or spark.yarn.jars variable in Hive on

[jira] [Commented] (HIVE-15313) Add export spark.yarn.archive or spark.yarn.jars variable in Hive on Spark document

2017-01-02 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794156#comment-15794156 ] Ferdinand Xu commented on HIVE-15313: - [~lirui], any progress or plan about HIVE-15302? I think we can

[jira] [Commented] (HIVE-15529) LLAP: TaskSchedulerService can get stuck when scheduleTask returns DELAYED_RESOURCES

2017-01-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794069#comment-15794069 ] Rajesh Balamohan commented on HIVE-15529: - [~pxiong] - Yes, on task failure the node gets into

[jira] [Comment Edited] (HIVE-15527) Memory usage is unbound in SortByShuffler for Spark

2017-01-02 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793967#comment-15793967 ] liyunzhang_intel edited comment on HIVE-15527 at 1/3/17 2:53 AM: -

[jira] [Commented] (HIVE-15527) Memory usage is unbound in SortByShuffler for Spark

2017-01-02 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793967#comment-15793967 ] liyunzhang_intel commented on HIVE-15527: - [~xuefuz] and [~lirui]: HiveKVResultCache will write

[jira] [Commented] (HIVE-15481) Support multiple and nested subqueries

2017-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793920#comment-15793920 ] Hive QA commented on HIVE-15481: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15527) Memory usage is unbound in SortByShuffler for Spark

2017-01-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793903#comment-15793903 ] Rui Li commented on HIVE-15527: --- Since the HiveKVResultCache here only stores values for the same key, I

[jira] [Updated] (HIVE-15530) Optimize the column stats update logic in table alteration

2017-01-02 Thread Yibing Shi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yibing Shi updated HIVE-15530: -- Description: Currently when a table is altered, if any of below conditions is true, HMS would try to

[jira] [Updated] (HIVE-15481) Support multiple and nested subqueries

2017-01-02 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-15481: --- Status: Patch Available (was: Open) Added back restriction to disable multiple queries with OR since

[jira] [Updated] (HIVE-15481) Support multiple and nested subqueries

2017-01-02 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-15481: --- Attachment: HIVE-15481.4.patch > Support multiple and nested subqueries >

[jira] [Updated] (HIVE-15481) Support multiple and nested subqueries

2017-01-02 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-15481: --- Status: Open (was: Patch Available) > Support multiple and nested subqueries >

[jira] [Commented] (HIVE-15525) Hooking ChangeManager to "drop table", "drop partition"

2017-01-02 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793805#comment-15793805 ] Thejas M Nair commented on HIVE-15525: -- [~daijy] can you please include a reviewboard link or pull

[jira] [Commented] (HIVE-15527) Memory usage is unbound in SortByShuffler for Spark

2017-01-02 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793570#comment-15793570 ] Chao Sun commented on HIVE-15527: - Patch looks good. Any idea why the qfile result is different? > Memory

[jira] [Updated] (HIVE-15507) Nested column pruning: fix issue when selecting struct field from array/map element

2017-01-02 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-15507: Resolution: Fixed Fix Version/s: 2.2.0 Target Version/s: 2.2.0 Status:

[jira] [Commented] (HIVE-15529) LLAP: TaskSchedulerService can get stuck when scheduleTask returns DELAYED_RESOURCES

2017-01-02 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793297#comment-15793297 ] Pengcheng Xiong commented on HIVE-15529: [~rajesh.balamohan], this sounds related to HIVE-15467?

[jira] [Commented] (HIVE-15528) Expose Spark job error in SparkTask

2017-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15792519#comment-15792519 ] Hive QA commented on HIVE-15528: Here are the results of testing the latest attachment: