[jira] [Commented] (HIVE-9736) StorageBasedAuthProvider should batch namenode-calls where possible.

2019-01-25 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752547#comment-16752547 ] Zheng Shao commented on HIVE-9736: -- Are we sure that FileSystem.listStatus(Path[]) is faster than a loop

[jira] [Updated] (HIVE-20358) Allow setting variable value from Hive metastore table properties

2018-08-09 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-20358: -- Description: Hive already supports set command as well as variable substitution: {{set

[jira] [Updated] (HIVE-20358) Allow setting variable value from Hive metastore table properties

2018-08-09 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-20358: -- Description: Hive already supports set command as well as variable substitution: {{set

[jira] [Updated] (HIVE-20261) Expose inputPartitionList in QueryPlan

2018-08-02 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-20261: -- Target Version/s: 3.1.0, 2.4.0, 4.0.0 (was: 2.4.0, 3.1.0, 4.0.0) Status: Patch Available

[jira] [Updated] (HIVE-20261) Expose inputPartitionList in QueryPlan

2018-08-02 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-20261: -- Target Version/s: 3.1.0, 2.4.0, 4.0.0 (was: 2.4.0, 3.1.0, 4.0.0) Status: Open (was:

[jira] [Updated] (HIVE-20261) Expose inputPartitionList in QueryPlan

2018-08-02 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-20261: -- Attachment: HIVE-20261.4.patch > Expose inputPartitionList in QueryPlan >

[jira] [Commented] (HIVE-20232) Basic division operator not working for select statement with join

2018-07-31 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16564023#comment-16564023 ] Zheng Shao commented on HIVE-20232: --- Can you simplify your example to a single row in table A and a

[jira] [Updated] (HIVE-20261) Expose inputPartitionList in QueryPlan

2018-07-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-20261: -- Target Version/s: 2.4.0, 3.1.0, 4.0.0 Status: Patch Available (was: Open) > Expose

[jira] [Updated] (HIVE-20261) Expose inputPartitionList in QueryPlan

2018-07-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-20261: -- Attachment: HIVE-20261.3.patch > Expose inputPartitionList in QueryPlan >

[jira] [Updated] (HIVE-20261) Expose inputPartitionList in QueryPlan

2018-07-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-20261: -- Attachment: HIVE-20261.2.patch > Expose inputPartitionList in QueryPlan >

[jira] [Commented] (HIVE-20261) Expose inputPartitionList in QueryPlan

2018-07-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562398#comment-16562398 ] Zheng Shao commented on HIVE-20261: --- Removed unnecessary variable visibility scope changes. > Expose

[jira] [Updated] (HIVE-20261) Expose inputPartitionList in QueryPlan

2018-07-27 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-20261: -- Attachment: HIVE-20261.1.patch > Expose inputPartitionList in QueryPlan >

[jira] [Assigned] (HIVE-20261) Expose inputPartitionList in QueryPlan

2018-07-27 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao reassigned HIVE-20261: - > Expose inputPartitionList in QueryPlan > -- > >

[jira] [Updated] (HIVE-1128) Let max/min handle complex types like struct

2017-10-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-1128: - Description: A lot of users are interested in doing "arg_min" and "arg_max". Basically, return the value

[jira] [Updated] (HIVE-1128) Let max/min handle complex types like struct

2017-10-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-1128: - Description: A lot of users are interested in doing "arg_min" and "arg_max". Basically, return the value

[jira] [Commented] (HIVE-17117) Metalisteners are not notified when threadlocal metaconf is cleanup

2017-07-24 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099059#comment-16099059 ] Zheng Shao commented on HIVE-17117: --- +1 > Metalisteners are not notified when threadlocal metaconf is

[jira] [Commented] (HIVE-11502) Map side aggregation is extremely slow

2015-08-09 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679402#comment-14679402 ] Zheng Shao commented on HIVE-11502: --- Seems like that the new version of Hive introduced

[jira] [Commented] (HIVE-5457) Concurrent calls to getTable() result in: MetaException: org.datanucleus.exceptions.NucleusException: Invalid index 1 for DataStoreMapping. NucleusException: Invalid in

2015-07-31 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649973#comment-14649973 ] Zheng Shao commented on HIVE-5457: -- We hit this problem also in our Hive 0.11 HMS. The

[jira] [Updated] (HIVE-5457) Concurrent calls to getTable() result in: MetaException: org.datanucleus.exceptions.NucleusException: Invalid index 1 for DataStoreMapping. NucleusException: Invalid inde

2015-07-31 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-5457: - Attachment: HIVE-5457.workaround.patch This patch will kill metastore on such error. It's *not* a proper

[jira] [Updated] (HIVE-11414) Fix OOM in MapTask with many input partitions with RCFile

2015-07-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-11414: -- Summary: Fix OOM in MapTask with many input partitions with RCFile (was: Fix OOM in MapTask with many

[jira] [Updated] (HIVE-11414) Fix OOM in MapTask with many input partitions by making ColumnarSerDeBase's cachedLazyStruct weakly referenced

2015-07-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-11414: -- Component/s: File Formats Fix OOM in MapTask with many input partitions by making ColumnarSerDeBase's

[jira] [Updated] (HIVE-11414) Fix OOM in MapTask with many input partitions with RCFile

2015-07-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-11414: -- Description: MapTask hit OOM in the following situation in our production environment: * src: 2048

[jira] [Updated] (HIVE-11414) Fix OOM in MapTask with many input partitions with RCFile

2015-07-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-11414: -- Description: MapTask hit OOM in the following situation in our production environment: * src: 2048

[jira] [Updated] (HIVE-11188) Make ORCFile's String Dictionary more efficient

2015-07-07 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-11188: -- Description: Currently, ORCFile's String Dictionary uses StringRedBlackTree for adding/finding/sorting

[jira] [Updated] (HIVE-11188) Make ORCFile's String Dictionary more efficient

2015-07-06 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-11188: -- Description: Currently, ORCFile's String Dictionary uses StringRedBlackTree for adding/finding/sorting

[jira] [Updated] (HIVE-11188) Make ORCFile's String Dictionary more efficient

2015-07-06 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-11188: -- Priority: Major (was: Minor) Make ORCFile's String Dictionary more efficient