[jira] [Updated] (HIVE-8071) hive shell tries to write hive-exec.jar for each run

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8071: -- Attachment: HIVE-8071.2.patch Rebasing patch to trunk & using the local helper function instead of destFs.exists

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135857#comment-14135857 ] Gopal V commented on HIVE-8038: --- No, there is a 24 hour waiting period after the +1. I will

[jira] [Commented] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135847#comment-14135847 ] Gopal V commented on HIVE-8090: --- Test failures look unrelated - +1. Assigned to myself till

[jira] [Assigned] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-8090: - Assignee: Gopal V > Potential null pointer reference in WriterImpl#StreamFactory#createStream() >

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Component/s: File Formats > Potential null pointer reference in WriterImpl#StreamFactory#createStream() > ---

[jira] [Updated] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8038: -- Attachment: HIVE-8038.3.patch +1 - Patch looks good. For commit - .3.patch, removed a white space change & a jav

[jira] [Commented] (HIVE-8137) Empty ORC file handling

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135790#comment-14135790 ] Gopal V commented on HIVE-8137: --- Hive's CombineInputFormat has pending changes to fix this -

[jira] [Commented] (HIVE-8137) Empty ORC file handling

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135768#comment-14135768 ] Gopal V commented on HIVE-8137: --- The right approach is skip generating splits for such files.

[jira] [Updated] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8038: -- Status: Open (was: Patch Available) > Decouple ORC files split calculation logic from Filesystem's get file > l

[jira] [Updated] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8038: -- Status: Patch Available (was: Open) Resubmitting to run tests again. > Decouple ORC files split calculation log

[jira] [Updated] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8038: -- Assignee: Pankit Thapar > Decouple ORC files split calculation logic from Filesystem's get file > location imple

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Attachment: HIVE-8090.4.patch Updated patch to match coding standard. Please follow this next time & send a mai

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14134389#comment-14134389 ] Gopal V commented on HIVE-8038: --- [~pankit]: Updated patch looks good, left one comment about

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Priority: Minor (was: Major) > Potential null pointer reference in WriterImpl#StreamFactory#createStream() > ---

[jira] [Commented] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14133426#comment-14133426 ] Gopal V commented on HIVE-8090: --- Nice, that's what I meant - null implies no modifications.

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Affects Version/s: 0.14.0 > Potential null pointer reference in WriterImpl#StreamFactory#createStream() > ---

[jira] [Commented] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14133362#comment-14133362 ] Gopal V commented on HIVE-8090: --- [~rpalamut]: You patch turns off this feature for ZlibCodec,

[jira] [Commented] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132519#comment-14132519 ] Gopal V commented on HIVE-7156: --- [~prasanth_j]: debug logs attached from my 1TB runs. The in

[jira] [Updated] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7156: -- Attachment: hive-debug.log.bz2 > Group-By operator stat-annotation only uses distinct approx to generate > rollu

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132107#comment-14132107 ] Gopal V commented on HIVE-8038: --- Thanks [~pankit], left some minor comments on the RB. I can

[jira] [Commented] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131223#comment-14131223 ] Gopal V commented on HIVE-7156: --- I just re-ran my test with this patch applied & the group-by

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129273#comment-14129273 ] Gopal V commented on HIVE-8038: --- Please open a reviews.apache.org reviewboard entry - also ad

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129205#comment-14129205 ] Gopal V commented on HIVE-8038: --- bq. Example : stripe size 512MB and BLOCK SIZE is 400MB, in

[jira] [Commented] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129021#comment-14129021 ] Gopal V commented on HIVE-7859: --- I did try BEST_COMPRESSION, but without much improvement. T

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14128768#comment-14128768 ] Gopal V commented on HIVE-8038: --- This is an interesting change-set. bq. 4a.If the split spa

[jira] [Commented] (HIVE-7926) long-lived daemons for query fragment execution, I/O and caching

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127965#comment-14127965 ] Gopal V commented on HIVE-7926: --- Hoare's 1985 CSP paper would make for good reading in this c

[jira] [Commented] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127946#comment-14127946 ] Gopal V commented on HIVE-7859: --- Tested this with TPC-H 1000 scale inserts. || Type || Time

[jira] [Updated] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7859: -- Attachment: HIVE-7859.2.patch Updated to work for uncompressed streams as well. > Tune zlib compression in ORC t

[jira] [Assigned] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-7859: - Assignee: Gopal V > Tune zlib compression in ORC to account for the encoding strategy > --

[jira] [Updated] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7859: -- Attachment: HIVE-7859.1.patch > Tune zlib compression in ORC to account for the encoding strategy > -

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127910#comment-14127910 ] Gopal V commented on HIVE-7950: --- The basic part of the problem seems to have been solved, thi

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127479#comment-14127479 ] Gopal V commented on HIVE-7950: --- This is related to TEZ-1469, which should provide guidance.

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127417#comment-14127417 ] Gopal V commented on HIVE-7950: --- Can you post the sequence of things you are doing? As in, h

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116310#comment-14116310 ] Gopal V commented on HIVE-7832: --- +1 - TPC-H data loads went from 767 seconds to 540 seconds.

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: HIVE-7917.1.patch > Hive max reducers count has regressed from a prime number to 999 >

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Release Note: Set hive.exec.reducers.max to a high prime number - 1009 Status: Patch Available (was: O

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: (was: HIVE-7917.1.patch) > Hive max reducers count has regressed from a prime number to 999 > -

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116002#comment-14116002 ] Gopal V commented on HIVE-7832: --- I left some minor comments on RB - the extra configuration v

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: HIVE-7917.1.patch > Hive max reducers count has regressed from a prime number to 999 >

[jira] [Created] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
Gopal V created HIVE-7917: - Summary: Hive max reducers count has regressed from a prime number to 999 Key: HIVE-7917 URL: https://issues.apache.org/jira/browse/HIVE-7917 Project: Hive Issue Type: B

[jira] [Commented] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114933#comment-14114933 ] Gopal V commented on HIVE-7907: --- Looks like this has to wait till the 0.5.0-SNAPSHOT gets upd

[jira] [Updated] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7907: -- Status: Patch Available (was: Open) > Bring up tez branch to changes in TEZ-1038, TEZ-1500 > --

[jira] [Commented] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114795#comment-14114795 ] Gopal V commented on HIVE-7907: --- [~hagleitn]/[~vikram.dixit]: can you take a look at this com

[jira] [Updated] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7907: -- Attachment: HIVE-7907.1-tez.patch > Bring up tez branch to changes in TEZ-1038, TEZ-1500 > -

[jira] [Created] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
Gopal V created HIVE-7907: - Summary: Bring up tez branch to changes in TEZ-1038, TEZ-1500 Key: HIVE-7907 URL: https://issues.apache.org/jira/browse/HIVE-7907 Project: Hive Issue Type: Sub-task

[jira] [Commented] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14108222#comment-14108222 ] Gopal V commented on HIVE-7544: --- This needs rebasing to branch, after the last merge. > Chan

[jira] [Created] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-08-22 Thread Gopal V (JIRA)
Gopal V created HIVE-7859: - Summary: Tune zlib compression in ORC to account for the encoding strategy Key: HIVE-7859 URL: https://issues.apache.org/jira/browse/HIVE-7859 Project: Hive Issue Type: B

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106554#comment-14106554 ] Gopal V commented on HIVE-7832: --- Minor refactoring comments on RB. LGTM +1, pending tests pa

[jira] [Created] (HIVE-7838) Tez getProgress() should return number of failed attempts

2014-08-21 Thread Gopal V (JIRA)
Gopal V created HIVE-7838: - Summary: Tez getProgress() should return number of failed attempts Key: HIVE-7838 URL: https://issues.apache.org/jira/browse/HIVE-7838 Project: Hive Issue Type: Bug

[jira] [Commented] (HIVE-7808) Changes to work against Tez-0.5 RC

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105944#comment-14105944 ] Gopal V commented on HIVE-7808: --- The inc.2 patch was moved to HIVE-7825 and committed. > Cha

[jira] [Commented] (HIVE-7833) Remove unwanted allocation in ORC RunLengthIntegerWriterV2 determine encoding function

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105941#comment-14105941 ] Gopal V commented on HIVE-7833: --- +1 > Remove unwanted allocation in ORC RunLengthIntegerWrit

[jira] [Resolved] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-7825. --- Resolution: Fixed Fix Version/s: tez-branch Committed to tez-branch, thanks [~sseth] > Bring tez-branc

[jira] [Updated] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469

2014-08-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7825: -- Attachment: HIVE-7825.1-tez.patch > Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469 >

[jira] [Updated] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469

2014-08-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7825: -- Summary: Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469 (was: Bring tez-branch up-to the API

[jira] [Created] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472

2014-08-20 Thread Gopal V (JIRA)
Gopal V created HIVE-7825: - Summary: Bring tez-branch up-to the API changes made by TEZ-1472 Key: HIVE-7825 URL: https://issues.apache.org/jira/browse/HIVE-7825 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7808) Changes to work against Tez-0.5 RC

2014-08-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7808: -- Affects Version/s: tez-branch > Changes to work against Tez-0.5 RC > -- > >

[jira] [Updated] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7738: -- Resolution: Fixed Fix Version/s: 0.14.0 Release Note: tez select sum(decimal) from union all of decim

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103254#comment-14103254 ] Gopal V commented on HIVE-7664: --- Sure [~navis], thanks for the work, I didn't want you to dup

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103238#comment-14103238 ] Gopal V commented on HIVE-7664: --- [~navis]: I was originally planning to use VectorColumnAssig

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14101206#comment-14101206 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: LGTM +1 > tez select sum(decimal) from union

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099885#comment-14099885 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: There is no need to attach the patch again -

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099459#comment-14099459 ] Gopal V commented on HIVE-7738: --- Looks like tests ran successfully, the one that failed is pr

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099310#comment-14099310 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: I looked at the patch - you need to do {{git

[jira] [Updated] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7738: -- Description: if run this query using tez engine then hive will throw NPE {code} select sum(a) from ( select ca

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Bring tez-branch up-to the API changes made

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098974#comment-14098974 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: can you re-attach the same patch for the QA t

[jira] [Updated] (HIVE-7617) optimize bytes mapjoin hash table read path wrt serialization, at least for common cases

2014-08-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7617: -- Attachment: hashmap-wb-fixes.png I find that this increased memory usage for small JOINs with this on my VM & I

[jira] [Commented] (HIVE-7723) Explain plan for complex query with lots of partitions is slow due to in-efficient collection used to find a matching ReadEntity

2014-08-13 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096618#comment-14096618 ] Gopal V commented on HIVE-7723: --- [~mmokhtar]: Can you open a review ticket on reviews.apache.

[jira] [Commented] (HIVE-7696) small changes to mapjoin hashtable

2014-08-13 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096336#comment-14096336 ] Gopal V commented on HIVE-7696: --- LGTM - +1 > small changes to mapjoin hashtable > --

[jira] [Commented] (HIVE-7705) there's a useless threadlocal in LBUtils that shows up in perf profiles

2014-08-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095076#comment-14095076 ] Gopal V commented on HIVE-7705: --- [~sershe]: +1, assuming the QA setup is restored & tests run

[jira] [Commented] (HIVE-7705) there's a useless threadlocal in LBUtils that shows up in perf profiles

2014-08-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095077#comment-14095077 ] Gopal V commented on HIVE-7705: --- Oh, in case anyone wants to dig into how ThreadLocals are ob

[jira] [Commented] (HIVE-7696) small changes to mapjoin hashtable

2014-08-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094782#comment-14094782 ] Gopal V commented on HIVE-7696: --- Looks like the HiveQA Jenkins is no longer working for trunk

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Summary: Bring tez-branch up-to the API changes made by TEZ-1372 (was: Bring tez-branch up-to the API changes m

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Status: Patch Available (was: Open) > Bring tez-branch up-to the API changes made by TEZ-1372 > ---

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Status: Open (was: Patch Available) > Bring tez-branch up-to the API changes made by TEZ-1372 > ---

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372, TEZ-1386

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Summary: Bring tez-branch up-to the API changes made by TEZ-1372, TEZ-1386 (was: Bring tez-branch up-to the AP

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Fix Version/s: tez-branch Status: Patch Available (was: Open) > Bring tez-branch up-to the API chang

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Attachment: HIVE-7656.1-tez.patch > Bring tez-branch up-to the API changes made by TEZ-1372 > --

[jira] [Created] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-07 Thread Gopal V (JIRA)
Gopal V created HIVE-7656: - Summary: Bring tez-branch up-to the API changes made by TEZ-1372 Key: HIVE-7656 URL: https://issues.apache.org/jira/browse/HIVE-7656 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7639) Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382

2014-08-07 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7639: -- Status: Patch Available (was: Open) > Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382 > -

[jira] [Updated] (HIVE-7639) Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382

2014-08-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7639: -- Attachment: HIVE-7639.1-tez.patch [~rajesh.balamohan]: can you review these? > Bring tez-branch upto api change

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-08-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Description: Add ability to make use of TezBytesWritableSerialization. NO PRECOMMIT TESTS was:Add ability to

[jira] [Created] (HIVE-7639) Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382

2014-08-06 Thread Gopal V (JIRA)
Gopal V created HIVE-7639: - Summary: Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382 Key: HIVE-7639 URL: https://issues.apache.org/jira/browse/HIVE-7639 Project: Hive Issue Type: S

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-08-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Release Note: TEZ-1288 related changes Status: Patch Available (was: Open) > Changes related to TEZ-1

[jira] [Commented] (HIVE-5718) Support direct fetch for lateral views, sub queries, etc.

2014-08-04 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085851#comment-14085851 ] Gopal V commented on HIVE-5718: --- +1, LGTM. I suggest leaving some comments about the alias.s

[jira] [Commented] (HIVE-7589) Some fixes and improvements to statistics annotation rules

2014-08-04 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085461#comment-14085461 ] Gopal V commented on HIVE-7589: --- [~prasanth_j]: HIVE-7156 isn't critical. We can revisit it,

[jira] [Updated] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041

2014-08-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7601: -- Status: Patch Available (was: Open) > Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-134

[jira] [Updated] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041

2014-08-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7601: -- Attachment: HIVE-7601.1-tez.patch > Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346,

[jira] [Updated] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041

2014-08-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7601: -- Summary: Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041 (was: Bring up te

[jira] [Created] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346

2014-08-03 Thread Gopal V (JIRA)
Gopal V created HIVE-7601: - Summary: Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346 Key: HIVE-7601 URL: https://issues.apache.org/jira/browse/HIVE-7601 Project: Hive Issu

[jira] [Resolved] (HIVE-7427) Changes for EdgeConfigurations

2014-08-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-7427. --- Resolution: Fixed Release Note: Committed to tez branch. > Changes for EdgeConfigurations >

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-07-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Affects Version/s: 0.14.0 > Changes related to TEZ-1288 (FastTezSerialization) > ---

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-07-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Component/s: Tez > Changes related to TEZ-1288 (FastTezSerialization) >

[jira] [Commented] (HIVE-5718) Support direct fetch for lateral views, sub queries, etc.

2014-07-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075992#comment-14075992 ] Gopal V commented on HIVE-5718: --- Sure [~navis]. Traveling at the moment, will do this mid-w

[jira] [Updated] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb

2014-07-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7397: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks [~navis]. {code}

[jira] [Updated] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb

2014-07-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7397: -- Release Note: Set the simple fetch task conversion to "more" with a default threshold of 1Gb (was: Reduce the d

[jira] [Commented] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb

2014-07-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14071793#comment-14071793 ] Gopal V commented on HIVE-7397: --- The test failures are unrelated. > Set the default threshol

[jira] [Commented] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb

2014-07-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14070267#comment-14070267 ] Gopal V commented on HIVE-7397: --- Will fix the null_scan test-case which needs a golden file u

[jira] [Updated] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb

2014-07-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7397: -- Attachment: HIVE-7397.5.patch Cannot reproduce the tez test failures on my machine. Re-uploading for a run befo

[jira] [Commented] (HIVE-7424) HiveException: Error evaluating concat(concat(' ', str2), ' ') in ql.exec.vector.VectorSelectOperator.processOp

2014-07-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065690#comment-14065690 ] Gopal V commented on HIVE-7424: --- Possibly related bug > HiveException: Error evaluating conc

<    4   5   6   7   8   9   10   11   12   13   >