[jira] [Commented] (HIVE-16839) Unbalanced calls to openTransaction/commitTransaction when alter the same partition concurrently

2017-06-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061759#comment-16061759 ] Nemon Lou commented on HIVE-16839: -- Our system does not support concurrency. When users submit both drop

[jira] [Commented] (HIVE-16907) "INSERT INTO" overwrite old data when destination table encapsulated by backquote

2017-06-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16050173#comment-16050173 ] Nemon Lou commented on HIVE-16907: -- Refer to this method :

[jira] [Commented] (HIVE-16907) "INSERT INTO" overwrite old data when destination table encapsulated by backquote

2017-06-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16050146#comment-16050146 ] Nemon Lou commented on HIVE-16907: -- AST with backquote: {noformat} | TOK_QUERY

[jira] [Commented] (HIVE-16839) Unbalanced calls to openTransaction/commitTransaction when alter the same partition concurrently

2017-06-07 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042020#comment-16042020 ] Nemon Lou commented on HIVE-16839: -- I have assigned it to you.Thanks. > Unbalanced calls to

[jira] [Assigned] (HIVE-16839) Unbalanced calls to openTransaction/commitTransaction when alter the same partition concurrently

2017-06-07 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reassigned HIVE-16839: Assignee: Vihang Karajgaonkar > Unbalanced calls to openTransaction/commitTransaction when alter

[jira] [Commented] (HIVE-16839) Unbalanced calls to openTransaction/commitTransaction when alter the same partition concurrently

2017-06-06 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040007#comment-16040007 ] Nemon Lou commented on HIVE-16839: -- Seems that we need a rollbackTransaction in method getPartition for

[jira] [Updated] (HIVE-16839) Unbalanced calls to openTransaction/commitTransaction when alter the same partition concurrently

2017-06-06 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-16839: - Description: SQL to reproduce: prepare: {noformat} hdfs dfs -mkdir -p

[jira] [Commented] (HIVE-12614) RESET command does not close spark session

2017-04-10 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963745#comment-15963745 ] Nemon Lou commented on HIVE-12614: -- [~stakiar] Thanks for taking it over. :) > RESET command does not

[jira] [Updated] (HIVE-14557) Nullpointer When both SkewJoin and Mapjoin Enabled

2017-03-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14557: - Status: Patch Available (was: Open) > Nullpointer When both SkewJoin and Mapjoin Enabled >

[jira] [Updated] (HIVE-14557) Nullpointer When both SkewJoin and Mapjoin Enabled

2017-03-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14557: - Attachment: HIVE-14557.patch HIVE-6520 gives a detailed explanation about this issue. This patch puts

[jira] [Commented] (HIVE-15638) ArrayIndexOutOfBoundsException when output Columns for UDTF are pruned

2017-01-17 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827388#comment-15827388 ] Nemon Lou commented on HIVE-15638: -- The following query will pass(adding a 'select * ' before UDTF hwrl)

[jira] [Updated] (HIVE-14662) Wrong Class Instance When Using Custom SERDE

2016-10-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14662: - Attachment: HIVE-14662.patch > Wrong Class Instance When Using Custom SERDE >

[jira] [Updated] (HIVE-14662) Wrong Class Instance When Using Custom SERDE

2016-10-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14662: - Status: Patch Available (was: Open) > Wrong Class Instance When Using Custom SERDE >

[jira] [Commented] (HIVE-14390) Wrong Table alias when CBO is on

2016-08-06 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410830#comment-15410830 ] Nemon Lou commented on HIVE-14390: -- Thanks a lot. [~pxiong] [~ashutoshc] . I haven't managed to update

[jira] [Commented] (HIVE-10153) CBO (Calcite Return Path): TPC-DS Q15 in-efficient join order

2016-08-04 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407306#comment-15407306 ] Nemon Lou commented on HIVE-10153: -- This filter prevents joining date_dim first: {noformat} (

[jira] [Commented] (HIVE-14390) Wrong Table alias when CBO is on

2016-08-02 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404176#comment-15404176 ] Nemon Lou commented on HIVE-14390: -- [~pxiong] Query plans for union15.q and union.9.q in SparkCliDriver

[jira] [Commented] (HIVE-14374) BeeLine argument, and configuration handling cleanup

2016-08-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402036#comment-15402036 ] Nemon Lou commented on HIVE-14374: -- For my part,it will be fine to remove it. > BeeLine argument, and

[jira] [Commented] (HIVE-14374) BeeLine argument, and configuration handling cleanup

2016-08-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402020#comment-15402020 ] Nemon Lou commented on HIVE-14374: -- [~pvary] Thanks for reminding this.If it was removed by accident

[jira] [Assigned] (HIVE-14390) Wrong Table alias when CBO is on

2016-07-31 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reassigned HIVE-14390: Assignee: Nemon Lou > Wrong Table alias when CBO is on > > >

[jira] [Updated] (HIVE-14390) Wrong Table alias when CBO is on

2016-07-31 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14390: - Status: Patch Available (was: Open) > Wrong Table alias when CBO is on >

[jira] [Updated] (HIVE-14390) Wrong Table alias when CBO is on

2016-07-30 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14390: - Attachment: HIVE-14390.patch HIVE-14390.patch can fix this.But I'm not sure it's the right way. [~pxiong]

[jira] [Updated] (HIVE-14390) Wrong Table alias when CBO is on

2016-07-30 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14390: - Attachment: explain.rar > Wrong Table alias when CBO is on > > >

[jira] [Updated] (HIVE-14353) Performance degradation after Projection Pruning in CBO

2016-07-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14353: - Attachment: q46_explain_cbo_vs_nocbo.tar.gz > Performance degradation after Projection Pruning in CBO >

[jira] [Commented] (HIVE-14353) Performance degradation after Projection Pruning in CBO

2016-07-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398540#comment-15398540 ] Nemon Lou commented on HIVE-14353: -- The motivation of this jira ticket is that ,I found that query46 was

[jira] [Comment Edited] (HIVE-14353) Performance degradation after Projection Pruning in CBO

2016-07-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396893#comment-15396893 ] Nemon Lou edited comment on HIVE-14353 at 7/29/16 1:08 AM: ---

[jira] [Commented] (HIVE-14353) Performance degradation after Projection Pruning in CBO

2016-07-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397041#comment-15397041 ] Nemon Lou commented on HIVE-14353: -- A preliminary analysis: Hive has a built in column pruner, and column

[jira] [Updated] (HIVE-14353) Performance degradation after Projection Pruning in CBO

2016-07-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14353: - Attachment: q46_cbo_projection_prune_explain.rar > Performance degradation after Projection Pruning in

[jira] [Updated] (HIVE-14353) Performance degradation after Projection Pruning in CBO

2016-07-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14353: - Attachment: q46_cbo_no_projection_prune_explain.txt > Performance degradation after Projection Pruning

[jira] [Commented] (HIVE-14353) Performance degradation after Projection Pruning in CBO

2016-07-27 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396922#comment-15396922 ] Nemon Lou commented on HIVE-14353: -- [~pxiong] Sorry for the misleading. Performance degradation is at

[jira] [Commented] (HIVE-14353) Performance degradation after Projection Pruning in CBO

2016-07-27 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396893#comment-15396893 ] Nemon Lou commented on HIVE-14353: -- ||queries||CBO_total_time||CBO_time_in_SelectOP|| |q27| 266.494|251

[jira] [Assigned] (HIVE-14143) RawDataSize of RCFile is zero after analyze

2016-07-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reassigned HIVE-14143: Assignee: Nemon Lou (was: Abhishek) > RawDataSize of RCFile is zero after analyze >

[jira] [Commented] (HIVE-14143) RawDataSize of RCFile is zero after analyze

2016-07-04 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15361156#comment-15361156 ] Nemon Lou commented on HIVE-14143: -- [~pxiong] The "ids" passed in is just "sizeOfColumnsInTableScan" in

[jira] [Issue Comment Deleted] (HIVE-14143) RawDataSize of RCFile is zero after analyze

2016-07-02 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14143: - Comment: was deleted (was: Patch updated.) > RawDataSize of RCFile is zero after analyze >

[jira] [Updated] (HIVE-14143) RawDataSize of RCFile is zero after analyze

2016-07-02 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14143: - Attachment: HIVE-14143.1.patch > RawDataSize of RCFile is zero after analyze >

[jira] [Updated] (HIVE-14143) RawDataSize of RCFile is zero after analyze

2016-07-02 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14143: - Attachment: HIVE-14143.1.patch Patch updated. > RawDataSize of RCFile is zero after analyze >

[jira] [Updated] (HIVE-14143) RawDataSize of RCFile is zero after analyze

2016-07-02 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14143: - Attachment: (was: HIVE-14143.1.patch) > RawDataSize of RCFile is zero after analyze >

[jira] [Commented] (HIVE-14143) RawDataSize of RCFile is zero after analyze

2016-07-02 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360057#comment-15360057 ] Nemon Lou commented on HIVE-14143: -- Referring to ORC and LazySimpleSerde, rawDataSize is calculated

[jira] [Commented] (HIVE-14143) RawDataSize of RCFile is zero after analyze

2016-07-02 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360049#comment-15360049 ] Nemon Lou commented on HIVE-14143: -- Agreed. As describe in TableScanDesc.java {code} // Both

[jira] [Commented] (HIVE-14143) RawDataSize of RCFile is zero after analyze

2016-07-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359940#comment-15359940 ] Nemon Lou commented on HIVE-14143: -- [~pxiong] Thanks for your attention. RawDataSize for rcfile is a

[jira] [Updated] (HIVE-14143) RawDataSize of RCFile is zero after analyze

2016-07-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-14143: - Attachment: HIVE-14143.patch > RawDataSize of RCFile is zero after analyze >

[jira] [Updated] (HIVE-5999) Allow other characters for LINES TERMINATED BY

2016-06-12 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-5999: Status: Open (was: Patch Available) > Allow other characters for LINES TERMINATED BY >

[jira] [Commented] (HIVE-10815) Let HiveMetaStoreClient Choose MetaStore Randomly

2016-06-05 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316127#comment-15316127 ] Nemon Lou commented on HIVE-10815: -- Seems that no failure tests are related. [~thejas] would you review

[jira] [Updated] (HIVE-10815) Let HiveMetaStoreClient Choose MetaStore Randomly

2016-06-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-10815: - Attachment: HIVE-10815.2.patch Now there are less failure tests.So trigger it again. > Let

[jira] [Updated] (HIVE-10815) Let HiveMetaStoreClient Choose MetaStore Randomly

2016-06-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-10815: - Status: Patch Available (was: Open) > Let HiveMetaStoreClient Choose MetaStore Randomly >

[jira] [Updated] (HIVE-10815) Let HiveMetaStoreClient Choose MetaStore Randomly

2016-06-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-10815: - Status: Open (was: Patch Available) > Let HiveMetaStoreClient Choose MetaStore Randomly >

[jira] [Commented] (HIVE-5999) Allow other characters for LINES TERMINATED BY

2016-06-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311563#comment-15311563 ] Nemon Lou commented on HIVE-5999: - Failure tests seem unrelated.This patch is ready for review. > Allow

[jira] [Updated] (HIVE-5999) Allow other characters for LINES TERMINATED BY

2016-05-30 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-5999: Status: Patch Available (was: Open) > Allow other characters for LINES TERMINATED BY >

[jira] [Updated] (HIVE-5999) Allow other characters for LINES TERMINATED BY

2016-05-30 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-5999: Attachment: HIVE-5999.1.patch Fixing failure test. > Allow other characters for LINES TERMINATED BY >

[jira] [Updated] (HIVE-5999) Allow other characters for LINES TERMINATED BY

2016-05-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-5999: Status: Patch Available (was: Open) > Allow other characters for LINES TERMINATED BY >

[jira] [Updated] (HIVE-5999) Allow other characters for LINES TERMINATED BY

2016-05-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-5999: Attachment: HIVE-5999.patch Limitations: 1,"lines terminated by" only works with text file. 2,"Multiple

[jira] [Comment Edited] (HIVE-5999) Allow other characters for LINES TERMINATED BY

2016-05-26 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303389#comment-15303389 ] Nemon Lou edited comment on HIVE-5999 at 5/27/16 3:05 AM: -- [~ashutoshc] Do you

[jira] [Commented] (HIVE-5999) Allow other characters for LINES TERMINATED BY

2016-05-26 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303389#comment-15303389 ] Nemon Lou commented on HIVE-5999: - [~ashutoshc] Do you plan to work on this? I have implemented one based

[jira] [Updated] (HIVE-10417) Parallel Order By return wrong results for partitioned tables

2016-05-24 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-10417: - Status: Open (was: Patch Available) > Parallel Order By return wrong results for partitioned tables >

[jira] [Updated] (HIVE-13791) Fix failure Unit Test TestHiveSessionImpl.testLeakOperationHandle

2016-05-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13791: - Attachment: HIVE-13791.patch I have run TestHiveSessionImpl successfully from local . > Fix failure

[jira] [Updated] (HIVE-10815) Let HiveMetaStoreClient Choose MetaStore Randomly

2016-05-17 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-10815: - Status: Patch Available (was: Open) Patch rebased to master. > Let HiveMetaStoreClient Choose MetaStore

[jira] [Updated] (HIVE-10815) Let HiveMetaStoreClient Choose MetaStore Randomly

2016-05-17 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-10815: - Attachment: HIVE-10815.1.patch > Let HiveMetaStoreClient Choose MetaStore Randomly >

[jira] [Updated] (HIVE-10815) Let HiveMetaStoreClient Choose MetaStore Randomly

2016-05-17 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-10815: - Status: Open (was: Patch Available) > Let HiveMetaStoreClient Choose MetaStore Randomly >

[jira] [Commented] (HIVE-10815) Let HiveMetaStoreClient Choose MetaStore Randomly

2016-05-16 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285941#comment-15285941 ] Nemon Lou commented on HIVE-10815: -- Seems that it fail to attract any volunteer to review. Shall I

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-05-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284045#comment-15284045 ] Nemon Lou commented on HIVE-13602: -- Thanks [~pxiong] .It will be nice to provide a patch for branch-1,

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15257398#comment-15257398 ] Nemon Lou commented on HIVE-13602: -- It's 24581 on my computer. I must have checked the wrong stages from

[jira] [Updated] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13602: - Description: Running tpch with factor 2, q16 returns 1,160 rows when CBO is on, while returns 24,581

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15256275#comment-15256275 ] Nemon Lou commented on HIVE-13602: -- The result is right when using hive 1.2.1. After some digging

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255976#comment-15255976 ] Nemon Lou commented on HIVE-13602: -- I just copy it from the result of "explain rewrite q16". {noformat}

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255964#comment-15255964 ] Nemon Lou commented on HIVE-13602: -- >From calcite rel plan ,we can see the p_brand column is declared to

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255937#comment-15255937 ] Nemon Lou commented on HIVE-13602: -- The join order seems to be the same for both queries.The difference

[jira] [Updated] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13602: - Attachment: explain_cbo_good(rewrite)_part3.out explain_cbo_good(rewrite)_part2.out

[jira] [Updated] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-24 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13602: - Attachment: explain_cbo_bad_part3.out explain_cbo_bad_part2.out

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-24 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255897#comment-15255897 ] Nemon Lou commented on HIVE-13602: -- I used MR engine. The attachment is bigger than 50K ,and has been

[jira] [Commented] (HIVE-13546) Patch for HIVE-12893 is broken in branch-1

2016-04-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247342#comment-15247342 ] Nemon Lou commented on HIVE-13546: -- After reverting HIVE-12893 or applying the patch above ,this issue

[jira] [Commented] (HIVE-13546) Patch for HIVE-12893 is broken in branch-1

2016-04-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247335#comment-15247335 ] Nemon Lou commented on HIVE-13546: -- [~prasanth_j] would you take a look ? Seems that the patch for

[jira] [Updated] (HIVE-13546) Patch for HIVE-12893 is broken in branch-1

2016-04-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13546: - Attachment: HIVE-13546.patch > Patch for HIVE-12893 is broken in branch-1 >

[jira] [Commented] (HIVE-13141) Hive on Spark over HBase should accept parameters starting with "zookeeper.znode"

2016-03-20 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203646#comment-15203646 ] Nemon Lou commented on HIVE-13141: -- Thanks for review.We installed multiple HBase clusters on one Hadoop

[jira] [Commented] (HIVE-13314) Hive on spark mapjoin errors if spark.master is not set

2016-03-20 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203645#comment-15203645 ] Nemon Lou commented on HIVE-13314: -- Similar to HIVE-12616 ? > Hive on spark mapjoin errors if

[jira] [Updated] (HIVE-13141) Hive on Spark over HBase should accept parameters starting with "zookeeper.znode"

2016-02-24 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13141: - Component/s: Spark > Hive on Spark over HBase should accept parameters starting with > "zookeeper.znode"

[jira] [Updated] (HIVE-13141) Hive on Spark over HBase should accept parameters starting with "zookeeper.znode"

2016-02-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13141: - Attachment: HIVE-13141.patch > Hive on Spark over HBase should accept parameters starting with >

[jira] [Updated] (HIVE-13141) Hive on Spark over HBase should accept parameters starting with "zookeeper.znode"

2016-02-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13141: - Status: Patch Available (was: Open) > Hive on Spark over HBase should accept parameters starting with >

[jira] [Commented] (HIVE-12847) ORC file footer cache should be memory sensitive

2016-01-16 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103066#comment-15103066 ] Nemon Lou commented on HIVE-12847: -- The serialized size of ProtoBuf object is much smaller than the size

[jira] [Updated] (HIVE-12847) ORC file footer cache should be memory sensitive

2016-01-16 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12847: - Description: The size based footer cache can not control memory usage properly. Having seen a HiveServer2

[jira] [Assigned] (HIVE-12847) ORC file footer cache should be memory sensitive

2016-01-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reassigned HIVE-12847: Assignee: Nemon Lou > ORC file footer cache should be memory sensitive >

[jira] [Updated] (HIVE-12847) ORC file footer cache should be memory sensitive

2016-01-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12847: - Attachment: HIVE-12847.patch This patch limits the cache memory usage to 50% of max heap size. Having not

[jira] [Commented] (HIVE-12748) shuffle the metastore uris, so the request can be balanced to metastores

2015-12-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071797#comment-15071797 ] Nemon Lou commented on HIVE-12748: -- Duplicate of HIVE-10815 ? > shuffle the metastore uris, so the

[jira] [Commented] (HIVE-12716) Hive on Spark map-join throw NullPointerException

2015-12-21 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066211#comment-15066211 ] Nemon Lou commented on HIVE-12716: -- This issue only related to mapjoin hint. You can solve this by

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059568#comment-15059568 ] Nemon Lou commented on HIVE-12538: -- [~xuefuz] Thanks for review. I have created HIVE-12689 to keep track

[jira] [Updated] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12616: - Attachment: HIVE-12616.1.patch > NullPointerException when spark session is reused to run a mapjoin >

[jira] [Updated] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12616: - Attachment: HIVE-12616.2.patch Fixing failed test cases in TestSparkSessionManagerImpl. Failure in

[jira] [Commented] (HIVE-12615) Do not start spark session when only explain

2015-12-11 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052779#comment-15052779 ] Nemon Lou commented on HIVE-12615: -- I didn't expect so many test case are affected. Sorry for haven't run

[jira] [Commented] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-10 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050888#comment-15050888 ] Nemon Lou commented on HIVE-12616: -- [~xuefuz], thanks for review . It is not surprising that you doubt

[jira] [Updated] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12616: - Attachment: HIVE-12616.patch Explicitly setting spark.master before submit to spark . >

[jira] [Assigned] (HIVE-12615) Do not start spark session when only explain

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reassigned HIVE-12615: Assignee: Nemon Lou > Do not start spark session when only explain >

[jira] [Commented] (HIVE-12615) Do not start spark session when only explain

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048371#comment-15048371 ] Nemon Lou commented on HIVE-12615: -- [~xuefuz] Thanks for your attention .It's a good idea to show the

[jira] [Updated] (HIVE-12615) Do not start spark session when only explain

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12615: - Attachment: HIVE-12615.patch > Do not start spark session when only explain >

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049828#comment-15049828 ] Nemon Lou commented on HIVE-12538: -- Shall I provide a patch only fix issues mentioned here and keep track

[jira] [Updated] (HIVE-12615) Do not start spark session when only explain

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12615: - Priority: Minor (was: Major) > Do not start spark session when only explain >

[jira] [Updated] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12538: - Attachment: HIVE-12538.5.patch Uploading a patch addressing the following issues : 1, Property

[jira] [Updated] (HIVE-12615) Do not start spark session when only explain

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12615: - Component/s: Spark > Do not start spark session when only explain >

[jira] [Commented] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046645#comment-15046645 ] Nemon Lou commented on HIVE-12616: -- The following exception is found from excutors' log {noformat}

[jira] [Commented] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046799#comment-15046799 ] Nemon Lou commented on HIVE-12616: -- Another finding.Setting spark.master explicitly can also fix this.

[jira] [Commented] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046791#comment-15046791 ] Nemon Lou commented on HIVE-12616: -- Method SparkUtilities#isDedicatedCluster {code} public static

[jira] [Commented] (HIVE-12614) RESET command does not close spark session

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047901#comment-15047901 ] Nemon Lou commented on HIVE-12614: -- For a given hive connection with spark session already started ,the

[jira] [Assigned] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reassigned HIVE-12616: Assignee: Nemon Lou (was: Xuefu Zhang) > NullPointerException when spark session is reused to run

  1   2   3   >