[jira] [Updated] (HIVE-8271) Jackson incompatibility between hadoop-2.4 and hive-14

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8271: -- Status: Patch Available (was: Open) Jackson incompatibility between hadoop-2.4 and hive-14

[jira] [Commented] (HIVE-8270) JDBC uber jar size is way too big - size should be reduced. It is also missing some classes required in secure setup

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150180#comment-14150180 ] Gopal V commented on HIVE-8270: --- Looks like minimizeJar is removing the classes accessed

[jira] [Commented] (HIVE-8240) VectorColumnAssignFactory throws Incompatible Bytes vector column and primitive category VARCHAR

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150298#comment-14150298 ] Gopal V commented on HIVE-8240: --- LGTM - +1, tests pending. VectorColumnAssignFactory throws

[jira] [Updated] (HIVE-8259) Queries in tez fail with exception

2014-09-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8259: -- Description: {code} ], TaskAttempt 3 failed, info=[Error: Failure while running task:java.lang.RuntimeException

[jira] [Commented] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148581#comment-14148581 ] Gopal V commented on HIVE-8188: --- [~navis]: No worries, took a special benchmark run to catch

[jira] [Created] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-09-23 Thread Gopal V (JIRA)
Gopal V created HIVE-8236: - Summary: VectorHashKeyWrapper allocates too many zero sized arrays Key: HIVE-8236 URL: https://issues.apache.org/jira/browse/HIVE-8236 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-09-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8236: -- Attachment: HIVE-8236.1.patch VectorHashKeyWrapper allocates too many zero sized arrays

[jira] [Updated] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-09-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8236: -- Status: Patch Available (was: Open) VectorHashKeyWrapper allocates too many zero sized arrays

[jira] [Commented] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143854#comment-14143854 ] Gopal V commented on HIVE-8156: --- Test failures are unrelated. Committed to trunk, thanks

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Resolution: Fixed Status: Resolved (was: Patch Available) Vectorized reducers need to avoid memory

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Release Note: HIVE-8156: Vectorized reducers need to avoid memory build-up during a single key (Gopal V reviewed

[jira] [Updated] (HIVE-8178) OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo twice

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8178: -- Attachment: HIVE-8178.1.patch OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo twice

[jira] [Updated] (HIVE-8178) OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo twice

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8178: -- Status: Patch Available (was: Open) OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo

[jira] [Commented] (HIVE-8078) ORC Delta encoding corrupts data when delta overflows long

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143991#comment-14143991 ] Gopal V commented on HIVE-8078: --- LGTM - +1 on changes, pending tests. ORC Delta encoding

[jira] [Assigned] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-8188: - Assignee: Gopal V ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

[jira] [Updated] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8188: -- Labels: Performance (was: ) Status: Patch Available (was: Open) ExprNodeGenericFuncEvaluator::_evaluate

[jira] [Updated] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8188: -- Attachment: HIVE-8188.1.patch ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight

[jira] [Updated] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8188: -- Attachment: HIVE-8188.2.patch ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight

[jira] [Created] (HIVE-8210) TezJobMonitor should print time spent in Application

2014-09-20 Thread Gopal V (JIRA)
Gopal V created HIVE-8210: - Summary: TezJobMonitor should print time spent in Application Key: HIVE-8210 URL: https://issues.apache.org/jira/browse/HIVE-8210 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-8210) TezJobMonitor should print time spent in Application (RUNNING)

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8210: -- Summary: TezJobMonitor should print time spent in Application (RUNNING) (was: TezJobMonitor should print time

[jira] [Updated] (HIVE-8210) TezJobMonitor should print time spent in Application (RUNNING)

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8210: -- Attachment: HIVE-8210.1.patch TezJobMonitor should print time spent in Application (RUNNING

[jira] [Updated] (HIVE-8210) TezJobMonitor should print time spent in Application (RUNNING)

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8210: -- Status: Patch Available (was: Open) TezJobMonitor should print time spent in Application (RUNNING

[jira] [Updated] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8188: -- Attachment: udf-deterministic.png ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight

[jira] [Created] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-19 Thread Gopal V (JIRA)
Gopal V created HIVE-8188: - Summary: ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop Key: HIVE-8188 URL: https://issues.apache.org/jira/browse/HIVE-8188 Project: Hive

[jira] [Commented] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14141095#comment-14141095 ] Gopal V commented on HIVE-8188: --- [~prasanth_j]: that is pretty neat, speedup. But that's

[jira] [Commented] (HIVE-8185) hive-jdbc-0.14.0-SNAPSHOT-standalone.jar fails verification for signatures in build

2014-09-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14141130#comment-14141130 ] Gopal V commented on HIVE-8185: --- +1 - LGTM. hive-jdbc-0.14.0-SNAPSHOT-standalone.jar fails

[jira] [Updated] (HIVE-8071) hive shell tries to write hive-exec.jar for each run

2014-09-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8071: -- Resolution: Fixed Fix Version/s: 0.14.0 Release Note: HIVE-8071: Speed up hive shell startup

[jira] [Created] (HIVE-8178) OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo twice

2014-09-18 Thread Gopal V (JIRA)
Gopal V created HIVE-8178: - Summary: OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo twice Key: HIVE-8178 URL: https://issues.apache.org/jira/browse/HIVE-8178 Project: Hive

[jira] [Created] (HIVE-8181) Upgrade JavaEWAH version to allow for unsorted bitset creation

2014-09-18 Thread Gopal V (JIRA)
Gopal V created HIVE-8181: - Summary: Upgrade JavaEWAH version to allow for unsorted bitset creation Key: HIVE-8181 URL: https://issues.apache.org/jira/browse/HIVE-8181 Project: Hive Issue Type: Bug

[jira] [Commented] (HIVE-8181) Upgrade JavaEWAH version to allow for unsorted bitset creation

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139317#comment-14139317 ] Gopal V commented on HIVE-8181: --- This is the JavaEWAH change-set, that fixes the limitation

[jira] [Created] (HIVE-8185) hive-jdbc-0.14.0-SNAPSHOT-standalone.jar fails verification for signatures in build

2014-09-18 Thread Gopal V (JIRA)
Gopal V created HIVE-8185: - Summary: hive-jdbc-0.14.0-SNAPSHOT-standalone.jar fails verification for signatures in build Key: HIVE-8185 URL: https://issues.apache.org/jira/browse/HIVE-8185 Project: Hive

[jira] [Commented] (HIVE-8185) hive-jdbc-0.14.0-SNAPSHOT-standalone.jar fails verification for signatures in build

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139703#comment-14139703 ] Gopal V commented on HIVE-8185: --- {code} 36829 Thu Sep 18 03:17:44 EDT 2014 META-INF/DUMMY.SF

[jira] [Updated] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8158: -- Fix Version/s: 0.14.0 Optimize writeValue/setValue in VectorExpressionWriterFactory

[jira] [Updated] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8158: -- Resolution: Fixed Release Note: HIVE-8158: Optimize writeValue/setValue in VectorExpressionWriterFactory

[jira] [Commented] (HIVE-7359) Stats based compute query replies fail to do simple column transforms

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14140021#comment-14140021 ] Gopal V commented on HIVE-7359: --- It fires a full-table scan instead of being optimized

[jira] [Commented] (HIVE-649) [UDF] now() for getting current time

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14140026#comment-14140026 ] Gopal V commented on HIVE-649: -- UDF NOW() can't be evaluated on the task, it has to be replaced

[jira] [Commented] (HIVE-649) [UDF] now() for getting current time

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14140034#comment-14140034 ] Gopal V commented on HIVE-649: -- Ah, I just hit the need for this and ran the patch - didn't

[jira] [Updated] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8038: -- Resolution: Fixed Release Note: HIVE-8038: Decouple ORC files split calculation logic from fixed-size

[jira] [Updated] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8158: -- Affects Version/s: 0.14.0 Optimize writeValue/setValue in VectorExpressionWriterFactory

[jira] [Updated] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8158: -- Component/s: Vectorization Optimize writeValue/setValue in VectorExpressionWriterFactory

[jira] [Commented] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138158#comment-14138158 ] Gopal V commented on HIVE-8158: --- LGTM - +1. Optimize writeValue/setValue

[jira] [Commented] (HIVE-8071) hive shell tries to write hive-exec.jar for each run

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138325#comment-14138325 ] Gopal V commented on HIVE-8071: --- ?? That is my change-set up there. {code} private boolean

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Resolution: Fixed Release Note: Committed to trunk - thanks [~rpalamut]! Status: Resolved

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Fix Version/s: 0.14.0 Potential null pointer reference in WriterImpl#StreamFactory#createStream

[jira] [Commented] (HIVE-8137) Empty ORC file handling

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135768#comment-14135768 ] Gopal V commented on HIVE-8137: --- The right approach is skip generating splits for such files

[jira] [Commented] (HIVE-8137) Empty ORC file handling

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135790#comment-14135790 ] Gopal V commented on HIVE-8137: --- Hive's CombineInputFormat has pending changes to fix

[jira] [Updated] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8038: -- Attachment: HIVE-8038.3.patch +1 - Patch looks good. For commit - .3.patch, removed a white space change

[jira] [Assigned] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-8090: - Assignee: Gopal V Potential null pointer reference in WriterImpl#StreamFactory#createStream

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Component/s: File Formats Potential null pointer reference in WriterImpl#StreamFactory#createStream

[jira] [Commented] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135847#comment-14135847 ] Gopal V commented on HIVE-8090: --- Test failures look unrelated - +1. Assigned to myself till

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135857#comment-14135857 ] Gopal V commented on HIVE-8038: --- No, there is a 24 hour waiting period after the +1. I

[jira] [Updated] (HIVE-8071) hive shell tries to write hive-exec.jar for each run

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8071: -- Attachment: HIVE-8071.2.patch Rebasing patch to trunk using the local helper function instead of destFs.exists

[jira] [Updated] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8092: -- Component/s: Vectorization Vectorized Tez count(*) returns NULL instead of 0 when result is empty

[jira] [Updated] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8092: -- Component/s: Tez Vectorized Tez count(*) returns NULL instead of 0 when result is empty

[jira] [Updated] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8092: -- Labels: v (was: ) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

[jira] [Updated] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8092: -- Labels: (was: v) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

[jira] [Updated] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8092: -- Affects Version/s: 0.14.0 Vectorized Tez count(*) returns NULL instead of 0 when result is empty

Re: Review Request 25711: Create root scratch dir with 733 instead of 777 perms

2014-09-16 Thread Gopal V
continuing to use it. ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java https://reviews.apache.org/r/25711/#comment93298 ws - nit - Gopal V On Sept. 16, 2014, 8:36 p.m., Vaibhav Gumashta wrote

[jira] [Commented] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136187#comment-14136187 ] Gopal V commented on HIVE-8092: --- LGTM - +1 Vectorized Tez count(*) returns NULL instead

[jira] [Commented] (HIVE-8153) Reduce the verbosity of debug logs in ORC record reader

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136545#comment-14136545 ] Gopal V commented on HIVE-8153: --- LGTM - +1 Reduce the verbosity of debug logs in ORC record

[jira] [Commented] (HIVE-8143) Create root scratch dir with 733 instead of 777 perms

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136675#comment-14136675 ] Gopal V commented on HIVE-8143: --- +1 - works with 777 and 733 /tmp/hive dirs. Create root

Re: Review Request 25711: Create root scratch dir with 733 instead of 777 perms

2014-09-16 Thread Gopal V
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25711/#review53644 --- Ship it! Ship It! - Gopal V On Sept. 16, 2014, 10:20 p.m

[jira] [Created] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
Gopal V created HIVE-8156: - Summary: Vectorized reducers need to avoid memory build-up during a single key Key: HIVE-8156 URL: https://issues.apache.org/jira/browse/HIVE-8156 Project: Hive Issue

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Attachment: HIVE-8156.1.patch Vectorized reducers need to avoid memory build-up during a single key

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Release Note: Cleanup memory within the vectorized reducer loop Status: Patch Available (was: Open

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Status: Open (was: Patch Available) Vectorized reducers need to avoid memory build-up during a single key

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Attachment: HIVE-8156.2.patch Vectorized reducers need to avoid memory build-up during a single key

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Status: Patch Available (was: Open) Vectorized reducers need to avoid memory build-up during a single key

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14134389#comment-14134389 ] Gopal V commented on HIVE-8038: --- [~pankit]: Updated patch looks good, left one comment about

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Attachment: HIVE-8090.4.patch Updated patch to match coding standard. Please follow this next time send

[jira] [Commented] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133362#comment-14133362 ] Gopal V commented on HIVE-8090: --- [~rpalamut]: You patch turns off this feature for ZlibCodec

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Affects Version/s: 0.14.0 Potential null pointer reference in WriterImpl#StreamFactory#createStream

[jira] [Commented] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133426#comment-14133426 ] Gopal V commented on HIVE-8090: --- Nice, that's what I meant - null implies no modifications

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Priority: Minor (was: Major) Potential null pointer reference in WriterImpl#StreamFactory#createStream

[jira] [Commented] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131223#comment-14131223 ] Gopal V commented on HIVE-7156: --- I just re-ran my test with this patch applied the group

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132107#comment-14132107 ] Gopal V commented on HIVE-8038: --- Thanks [~pankit], left some minor comments on the RB. I

[jira] [Updated] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7156: -- Attachment: hive-debug.log.bz2 Group-By operator stat-annotation only uses distinct approx to generate

[jira] [Commented] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132519#comment-14132519 ] Gopal V commented on HIVE-7156: --- [~prasanth_j]: debug logs attached from my 1TB runs

Re: Patches to release branches

2014-09-11 Thread Gopal V
On 9/9/14, 1:52 PM, Mithun Radhakrishnan wrote: 1. For P1 bugs (i.e. involving data corruption, service unavailability, or serious failures without reasonable workarounds), along with a fix for trunk, I move that the current stable release branch also be patched. This will be much easier to

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128768#comment-14128768 ] Gopal V commented on HIVE-8038: --- This is an interesting change-set. bq. 4a.If the split

[jira] [Commented] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129021#comment-14129021 ] Gopal V commented on HIVE-7859: --- I did try BEST_COMPRESSION, but without much improvement

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129205#comment-14129205 ] Gopal V commented on HIVE-8038: --- bq. Example : stripe size 512MB and BLOCK SIZE is 400MB

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129273#comment-14129273 ] Gopal V commented on HIVE-8038: --- Please open a reviews.apache.org reviewboard entry - also

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127417#comment-14127417 ] Gopal V commented on HIVE-7950: --- Can you post the sequence of things you are doing

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127479#comment-14127479 ] Gopal V commented on HIVE-7950: --- This is related to TEZ-1469, which should provide guidance

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127910#comment-14127910 ] Gopal V commented on HIVE-7950: --- The basic part of the problem seems to have been solved

[jira] [Updated] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7859: -- Attachment: HIVE-7859.1.patch Tune zlib compression in ORC to account for the encoding strategy

[jira] [Assigned] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-7859: - Assignee: Gopal V Tune zlib compression in ORC to account for the encoding strategy

[jira] [Updated] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7859: -- Attachment: HIVE-7859.2.patch Updated to work for uncompressed streams as well. Tune zlib compression in ORC

[jira] [Commented] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127946#comment-14127946 ] Gopal V commented on HIVE-7859: --- Tested this with TPC-H 1000 scale inserts. || Type || Time

[jira] [Commented] (HIVE-7926) long-lived daemons for query fragment execution, I/O and caching

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127965#comment-14127965 ] Gopal V commented on HIVE-7926: --- Hoare's 1985 CSP paper would make for good reading

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116310#comment-14116310 ] Gopal V commented on HIVE-7832: --- +1 - TPC-H data loads went from 767 seconds to 540 seconds

[jira] [Commented] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114933#comment-14114933 ] Gopal V commented on HIVE-7907: --- Looks like this has to wait till the 0.5.0-SNAPSHOT gets

[jira] [Created] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
Gopal V created HIVE-7917: - Summary: Hive max reducers count has regressed from a prime number to 999 Key: HIVE-7917 URL: https://issues.apache.org/jira/browse/HIVE-7917 Project: Hive Issue Type

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: HIVE-7917.1.patch Hive max reducers count has regressed from a prime number to 999

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116002#comment-14116002 ] Gopal V commented on HIVE-7832: --- I left some minor comments on RB - the extra configuration

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: (was: HIVE-7917.1.patch) Hive max reducers count has regressed from a prime number to 999

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: HIVE-7917.1.patch Hive max reducers count has regressed from a prime number to 999

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Release Note: Set hive.exec.reducers.max to a high prime number - 1009 Status: Patch Available

[jira] [Created] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
Gopal V created HIVE-7907: - Summary: Bring up tez branch to changes in TEZ-1038, TEZ-1500 Key: HIVE-7907 URL: https://issues.apache.org/jira/browse/HIVE-7907 Project: Hive Issue Type: Sub-task

<    4   5   6   7   8   9   10   11   12   13   >