[jira] [Updated] (HIVE-9983) Vectorizer doesn't vectorize (1) partitions with different schema (2) any MapWork with 1 table scans in MR

2015-03-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9983: --- Component/s: Vectorization Vectorizer doesn't vectorize (1) partitions with different schema

[jira] [Updated] (HIVE-9983) Vectorizer doesn't vectorize (1) partitions with different schema anywhere (2) any MapWork with 1 table scans in MR

2015-03-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9983: --- Summary: Vectorizer doesn't vectorize (1) partitions with different schema anywhere (2) any

[jira] [Updated] (HIVE-9986) LLAP: EOFException in reader

2015-03-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9986: --- Fix Version/s: llap LLAP: EOFException in reader

[jira] [Updated] (HIVE-9986) LLAP: EOFException in reader

2015-03-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9986: --- Description: From HIVE-9979 {noformat} 2015-03-16 10:20:51,439

[jira] [Commented] (HIVE-9979) LLAP: LLAP Cached readers for StringDirectTreeReaders over-read data

2015-03-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14364251#comment-14364251 ] Sergey Shelukhin commented on HIVE-9979: Filed HIVE-9986 for the callstack in the

[jira] [Assigned] (HIVE-9979) LLAP: LLAP Cached readers for StringDirectTreeReaders over-read data

2015-03-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-9979: -- Assignee: Sergey Shelukhin (was: Prasanth Jayachandran) LLAP: LLAP Cached readers for

[jira] [Commented] (HIVE-9919) upgrade scripts don't work on some auto-created DBs due to absence of tables

2015-03-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367861#comment-14367861 ] Sergey Shelukhin commented on HIVE-9919: [~thejas] can you take a look at the new

[jira] [Commented] (HIVE-9986) LLAP: EOFException in reader

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366040#comment-14366040 ] Sergey Shelukhin commented on HIVE-9986: May be fixed in HIVE-9978, unless it's a

[jira] [Resolved] (HIVE-9729) LLAP: design and implement proper metadata cache

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-9729. Resolution: Fixed LLAP: design and implement proper metadata cache

[jira] [Updated] (HIVE-9978) LLAP: OrcColumnVectorProducer should handle reading isPresent columns only

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9978: --- Attachment: HIVE-9978.patch LLAP: OrcColumnVectorProducer should handle reading isPresent

[jira] [Commented] (HIVE-10000) 10000 whoooohooo

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366335#comment-14366335 ] Sergey Shelukhin commented on HIVE-1: - Here I was hoping to file some

[jira] [Comment Edited] (HIVE-10000) 10000 whoooohooo

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366335#comment-14366335 ] Sergey Shelukhin edited comment on HIVE-1 at 3/17/15 11:56 PM:

[jira] [Updated] (HIVE-9919) upgrade scripts don't work on some auto-created DBs due to absence of tables

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9919: --- Attachment: HIVE-9919.01.patch Updated the patch to add all the indexes/etc. from all the

[jira] [Updated] (HIVE-9997) minor tweaks for bytes mapjoin hash table

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9997: --- Attachment: HIVE-9997.patch first attempt; need to see HiveQA minor tweaks for bytes mapjoin

[jira] [Commented] (HIVE-9997) minor tweaks for bytes mapjoin hash table

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366272#comment-14366272 ] Sergey Shelukhin commented on HIVE-9997: https://reviews.apache.org/r/32178

[jira] [Commented] (HIVE-10000) 10000 whoooohooo

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366371#comment-14366371 ] Sergey Shelukhin commented on HIVE-1: - Define APIs? :) [~sseth] 1

[jira] [Resolved] (HIVE-9978) LLAP: OrcColumnVectorProducer should handle reading isPresent columns only

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-9978. Resolution: Fixed Fix Version/s: llap committed to branch. Should work now LLAP:

[jira] [Updated] (HIVE-10013) NPE in LLAP logs in heartbeat

2015-03-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10013: Issue Type: Sub-task (was: Bug) Parent: HIVE-7926 NPE in LLAP logs in heartbeat

[jira] [Updated] (HIVE-9979) LLAP: LLAP Cached readers for StringDirectTreeReaders over-read data

2015-03-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9979: --- Attachment: HIVE-9979.patch preliminary patch with some fixes LLAP: LLAP Cached readers for

[jira] [Resolved] (HIVE-10024) LLAP: q file test is broken again

2015-03-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10024. - Resolution: Fixed Fix Version/s: llap Fixed. LLAP: q file test is broken again

[jira] [Assigned] (HIVE-10014) LLAP : investigate showing LLAP IO usage in explain

2015-03-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-10014: --- Assignee: Sergey Shelukhin LLAP : investigate showing LLAP IO usage in explain

[jira] [Resolved] (HIVE-10046) LLAP : disable ORC trace logging for now

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10046. - Resolution: Fixed LLAP : disable ORC trace logging for now

[jira] [Assigned] (HIVE-10046) LLAP : disable ORC trace logging for now

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-10046: --- Assignee: Sergey Shelukhin LLAP : disable ORC trace logging for now

[jira] [Commented] (HIVE-9277) Hybrid Hybrid Grace Hash Join

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372407#comment-14372407 ] Sergey Shelukhin commented on HIVE-9277: WRT logger, I meant why not create a

[jira] [Commented] (HIVE-9277) Hybrid Hybrid Grace Hash Join

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372311#comment-14372311 ] Sergey Shelukhin commented on HIVE-9277: er, on RB Hybrid Hybrid Grace Hash Join

[jira] [Commented] (HIVE-9555) assorted ORC refactorings for LLAP on trunk

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372319#comment-14372319 ] Sergey Shelukhin commented on HIVE-9555: Filed HIVE-10042 as a followup assorted

[jira] [Resolved] (HIVE-9919) upgrade scripts don't work on some auto-created DBs due to absence of tables

2015-03-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-9919. Resolution: Fixed Fix Version/s: 1.2.0 committed to trunk upgrade scripts don't

[jira] [Updated] (HIVE-9555) assorted ORC refactorings for LLAP on trunk

2015-03-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9555: --- Attachment: HIVE-9555.08.patch assorted ORC refactorings for LLAP on trunk

[jira] [Resolved] (HIVE-10014) LLAP : investigate showing LLAP IO usage in explain

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10014. - Resolution: Fixed Fix Version/s: llap thanks! LLAP : investigate showing LLAP IO

[jira] [Updated] (HIVE-8013) CBO:fix checkstyle warnings

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-8013: --- Assignee: (was: Sergey Shelukhin) CBO:fix checkstyle warnings

[jira] [Resolved] (HIVE-8116) clean up q file hive.log

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-8116. Resolution: Won't Fix clean up q file hive.log

[jira] [Updated] (HIVE-10014) LLAP : investigate showing LLAP IO usage in explain

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10014: Attachment: HIVE-10014.patch Outputs only of LLAP IO is enabled. [~ashutoshc] you might be

[jira] [Commented] (HIVE-10034) Variable substitution broken when a query is contained in double quotes

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371737#comment-14371737 ] Sergey Shelukhin commented on HIVE-10034: - {noformat} $ echo 'create table if not

[jira] [Resolved] (HIVE-10034) Variable substitution broken when a query is contained in double quotes

2015-03-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10034. - Resolution: Not a Problem Variable substitution broken when a query is contained in

[jira] [Updated] (HIVE-9979) LLAP: LLAP Cached readers for StringDirectTreeReaders over-read data

2015-03-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9979: --- Assignee: Prasanth Jayachandran (was: Sergey Shelukhin) LLAP: LLAP Cached readers for

[jira] [Commented] (HIVE-9730) make sure logging is never called when not needed in perf-sensitive places

2015-03-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363710#comment-14363710 ] Sergey Shelukhin commented on HIVE-9730: [~gopalv] ping? make sure logging is

[jira] [Updated] (HIVE-9892) various MSSQL upgrade scripts don't work

2015-03-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9892: --- Affects Version/s: 0.13.0 0.14.0 1.0.0 various

[jira] [Updated] (HIVE-9892) various MSSQL upgrade scripts don't work

2015-03-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9892: --- Fix Version/s: 1.1 various MSSQL upgrade scripts don't work

[jira] [Commented] (HIVE-9892) various MSSQL upgrade scripts don't work

2015-03-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351356#comment-14351356 ] Sergey Shelukhin commented on HIVE-9892: no point to run HiveQA, upgrade scripts

[jira] [Updated] (HIVE-9892) various MSSQL upgrade scripts don't work

2015-03-09 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9892: --- Attachment: HIVE-9892.ADDENDUM.patch [~thejas] can you take a look at addendum? The pre-create

[jira] [Commented] (HIVE-9555) assorted ORC refactorings for LLAP on trunk

2015-03-12 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355306#comment-14355306 ] Sergey Shelukhin commented on HIVE-9555: [~prasanth_j] ping? assorted ORC

[jira] [Commented] (HIVE-9420) LLAP: separate decoding thread from read/uncompress thread

2015-03-12 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355307#comment-14355307 ] Sergey Shelukhin commented on HIVE-9420: Updated title according to recent

[jira] [Commented] (HIVE-9729) LLAP: design and implement proper metadata cache

2015-03-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349417#comment-14349417 ] Sergey Shelukhin commented on HIVE-9729: Actually, it seems like one can abstract

[jira] [Commented] (HIVE-9952) fix NPE in CorrelationUtilities

2015-03-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360829#comment-14360829 ] Sergey Shelukhin commented on HIVE-9952: +1 fix NPE in CorrelationUtilities

[jira] [Comment Edited] (HIVE-8746) ORC timestamp columns are sensitive to daylight savings time

2015-03-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360814#comment-14360814 ] Sergey Shelukhin edited comment on HIVE-8746 at 3/13/15 5:59 PM:

[jira] [Commented] (HIVE-9951) VectorizedRCFileRecordReader creates Exception but does not throw it

2015-03-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360836#comment-14360836 ] Sergey Shelukhin commented on HIVE-9951: +1 VectorizedRCFileRecordReader creates

[jira] [Commented] (HIVE-9555) assorted ORC refactorings for LLAP on trunk

2015-03-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360858#comment-14360858 ] Sergey Shelukhin commented on HIVE-9555: [~gopalv] ping? I am ready to commit ;)

[jira] [Updated] (HIVE-9919) upgrade scripts don't work on some auto-created DBs due to absence of tables

2015-03-10 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9919: --- Attachment: HIVE-9919.patch upgrade scripts don't work on some auto-created DBs due to

[jira] [Updated] (HIVE-9555) assorted ORC refactorings for LLAP on trunk

2015-03-10 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9555: --- Attachment: HIVE-9555.07.patch recent CR feedback addressed assorted ORC refactorings for

[jira] [Commented] (HIVE-9555) assorted ORC refactorings for LLAP on trunk

2015-03-10 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355689#comment-14355689 ] Sergey Shelukhin commented on HIVE-9555: Please ignore the one in b/ directory.

[jira] [Updated] (HIVE-9555) assorted ORC refactorings for LLAP on trunk

2015-03-10 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9555: --- Attachment: HIVE-9555.06.patch CR feedback, test fixes, some code changes from recent LLAP

[jira] [Commented] (HIVE-9729) LLAP: design and implement proper metadata cache

2015-03-12 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359786#comment-14359786 ] Sergey Shelukhin commented on HIVE-9729: Most of this is now committed, need to add

[jira] [Commented] (HIVE-9881) LLAP: Print ASCII art of LLAP during daemon startup

2015-03-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349814#comment-14349814 ] Sergey Shelukhin commented on HIVE-9881: Here you go: {noformat} throw new

[jira] [Resolved] (HIVE-10075) LLAP: Object Estimator digs in via a deep hashCode()

2015-03-24 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10075. - Resolution: Fixed Fix Version/s: llap committed LLAP: Object Estimator digs in

[jira] [Commented] (HIVE-10068) LLAP: adjust allocation after decompression

2015-03-24 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379104#comment-14379104 ] Sergey Shelukhin commented on HIVE-10068: - [~gopalv] any opinion? LLAP: adjust

[jira] [Resolved] (HIVE-10067) LLAP: read file ID when generating splits to avoid extra NN call in the tasks

2015-03-24 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10067. - Resolution: Fixed Fix Version/s: llap committed to branch. Tested on the cluster,

[jira] [Commented] (HIVE-10128) LLAP: BytesBytesMultiHashMap does not allow concurrent read-only access

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387388#comment-14387388 ] Sergey Shelukhin commented on HIVE-10128: - https://reviews.apache.org/r/32637/

[jira] [Commented] (HIVE-10128) LLAP: BytesBytesMultiHashMap does not allow concurrent read-only access

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387368#comment-14387368 ] Sergey Shelukhin commented on HIVE-10128: - Meanwhile, already committed to llap

[jira] [Updated] (HIVE-10128) LLAP: BytesBytesMultiHashMap does not allow concurrent read-only access

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10128: Attachment: HIVE-10128.01.patch Patch for trunk. [~ashutoshc] can you review? thanks

[jira] [Updated] (HIVE-10131) LLAP: BytesBytesMultiHashMap and mapjoin container should reuse refs

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10131: Assignee: Matt McCline (was: Sergey Shelukhin) LLAP: BytesBytesMultiHashMap and mapjoin

[jira] [Updated] (HIVE-10131) LLAP: BytesBytesMultiHashMap and mapjoin container should reuse refs

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10131: Description: Refs are always allocated and cleared. Should be reused. Iterator is another

[jira] [Commented] (HIVE-10101) LLAP: enable yourkit profiling of tasks

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387769#comment-14387769 ] Sergey Shelukhin commented on HIVE-10101: - [~gopalv] would you +1 this assuming we

[jira] [Updated] (HIVE-10128) BytesBytesMultiHashMap does not allow concurrent read-only access

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10128: Summary: BytesBytesMultiHashMap does not allow concurrent read-only access (was: LLAP:

[jira] [Commented] (HIVE-10131) LLAP: BytesBytesMultiHashMap and mapjoin container should reuse refs

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387761#comment-14387761 ] Sergey Shelukhin commented on HIVE-10131: - [~mmccline] this is the JIRA. Thanks!

[jira] [Resolved] (HIVE-10112) LLAP: query 17 tasks fail due to mapjoin issue

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10112. - Resolution: Implemented LLAP: query 17 tasks fail due to mapjoin issue

[jira] [Reopened] (HIVE-10112) LLAP: query 17 tasks fail due to mapjoin issue

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reopened HIVE-10112: - LLAP: query 17 tasks fail due to mapjoin issue

[jira] [Updated] (HIVE-10113) LLAP: reducers running in LLAP starve out map retries

2015-03-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10113: Assignee: Siddharth Seth (was: Gunther Hagleitner) LLAP: reducers running in LLAP starve

[jira] [Commented] (HIVE-10103) LLAP: Cancelling tasks fails to stop cache filling threads

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389832#comment-14389832 ] Sergey Shelukhin commented on HIVE-10103: - Main problem is that tez doesn't close

[jira] [Commented] (HIVE-10112) LLAP: query 17 tasks fail due to mapjoin issue

2015-03-26 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383213#comment-14383213 ] Sergey Shelukhin commented on HIVE-10112: - I wonder if recent patch on trunk broke

[jira] [Resolved] (HIVE-10110) LLAP: port updates from HIVE-9555 to llap branch in preparation for trunk merge

2015-03-26 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10110. - Resolution: Fixed Fix Version/s: llap LLAP: port updates from HIVE-9555 to llap

[jira] [Updated] (HIVE-10128) BytesBytesMultiHashMap does not allow concurrent read-only access

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10128: Attachment: HIVE-10128.03.patch BytesBytesMultiHashMap does not allow concurrent read-only

[jira] [Updated] (HIVE-10161) LLAP: ORC file contains compression buffers larger than bufferSize (OR reader has a bug)

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10161: Summary: LLAP: ORC file contains compression buffers larger than bufferSize (OR reader has

[jira] [Updated] (HIVE-10161) LLAP: ORC file contains compression buffers larger than bufferSize (OR reader has a bug)

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10161: Assignee: Prasanth Jayachandran (was: Sergey Shelukhin) LLAP: ORC file contains

[jira] [Commented] (HIVE-10128) BytesBytesMultiHashMap does not allow concurrent read-only access

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388920#comment-14388920 ] Sergey Shelukhin commented on HIVE-10128: - Sorry, use fell thru the cracks when I

[jira] [Commented] (HIVE-10128) BytesBytesMultiHashMap does not allow concurrent read-only access

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388906#comment-14388906 ] Sergey Shelukhin commented on HIVE-10128: - It's used in the updated patch. I'll

[jira] [Commented] (HIVE-10092) LLAP: improve how buffers are locked for split

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389103#comment-14389103 ] Sergey Shelukhin commented on HIVE-10092: - This is not a simple problem...

[jira] [Commented] (HIVE-10128) BytesBytesMultiHashMap does not allow concurrent read-only access

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389026#comment-14389026 ] Sergey Shelukhin commented on HIVE-10128: - Tests failed with a weird issue

[jira] [Assigned] (HIVE-10103) LLAP: Cancelling tasks fails to stop cache filling threads

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-10103: --- Assignee: Sergey Shelukhin LLAP: Cancelling tasks fails to stop cache filling

[jira] [Updated] (HIVE-10092) LLAP: improve how buffers are locked for split

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-10092: Attachment: HIVE-10092.patch Committed to branch... attaching patch here for reference

[jira] [Resolved] (HIVE-10092) LLAP: improve how buffers are locked for split

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-10092. - Resolution: Fixed Fix Version/s: llap [~gopalv] fyi LLAP: improve how buffers

[jira] [Commented] (HIVE-10092) LLAP: improve how buffers are locked for split

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389534#comment-14389534 ] Sergey Shelukhin commented on HIVE-10092: - Separate jira for cache bypassing is

[jira] [Assigned] (HIVE-10111) LLAP: query 7 produces corrupted result with IO enabled

2015-03-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-10111: --- Assignee: Sergey Shelukhin LLAP: query 7 produces corrupted result with IO enabled

[jira] [Updated] (HIVE-9834) VectorGroupByOperator logs too much

2015-03-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9834: --- Attachment: HIVE-9834.patch [~ashutoshc] you appear to have added this. Can you take a look?

[jira] [Updated] (HIVE-9834) VectorGroupByOperator logs too much

2015-03-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9834: --- Priority: Trivial (was: Major) VectorGroupByOperator logs too much

[jira] [Commented] (HIVE-9758) LLAP: fix wrapinputformat for client/server; fix server init to use config

2015-02-27 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14340623#comment-14340623 ] Sergey Shelukhin commented on HIVE-9758: 2 is no longer relevant, this setting

[jira] [Commented] (HIVE-9730) make sure logging is never called when not needed in perf-sensitive places

2015-03-04 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347895#comment-14347895 ] Sergey Shelukhin commented on HIVE-9730: ping? make sure logging is never called

[jira] [Resolved] (HIVE-9844) LLAP: change caches to use unique file ID, not name

2015-03-04 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-9844. Resolution: Fixed Fix Version/s: llap In branch. This actually also fixed a bug in q

[jira] [Commented] (HIVE-3454) Problem with CAST(BIGINT as TIMESTAMP)

2015-03-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346156#comment-14346156 ] Sergey Shelukhin commented on HIVE-3454: Please don't use the static

[jira] [Commented] (HIVE-9843) LLAP: instrument logging for fragments

2015-03-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345944#comment-14345944 ] Sergey Shelukhin commented on HIVE-9843: For now, no need to build stack of

[jira] [Commented] (HIVE-9843) LLAP: instrument logging for fragments

2015-03-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346049#comment-14346049 ] Sergey Shelukhin commented on HIVE-9843: MDC works if you never reuse threads. But,

[jira] [Resolved] (HIVE-9843) LLAP: instrument logging for fragments

2015-03-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-9843. Resolution: Fixed Fix Version/s: llap committed to branch LLAP: instrument logging

[jira] [Commented] (HIVE-9843) LLAP: instrument logging for fragments

2015-03-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345934#comment-14345934 ] Sergey Shelukhin commented on HIVE-9843: We can use NDC or MDC. MDC has a nice

[jira] [Resolved] (HIVE-9640) refactor ORC metadata and index reading out of RecordReaderImpl

2015-02-24 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-9640. Resolution: Duplicate refactor ORC metadata and index reading out of RecordReaderImpl

[jira] [Updated] (HIVE-9730) make sure logging is never called when not needed in perf-sensitive places

2015-02-24 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9730: --- Attachment: HIVE-9730.patch Trunk patch. I think this is applicable enough to be applied to

[jira] [Updated] (HIVE-9730) make sure logging is never called when not needed in perf-sensitive places

2015-02-24 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9730: --- Issue Type: Bug (was: Sub-task) Parent: (was: HIVE-7926) make sure logging is

[jira] [Updated] (HIVE-9758) LLAP: fix wrapinputformat for client/server; fix server init to use config

2015-02-24 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9758: --- Fix Version/s: llap LLAP: fix wrapinputformat for client/server; fix server init to use

[jira] [Commented] (HIVE-9277) Hybrid Hybrid Grace Hash Join

2015-02-25 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337137#comment-14337137 ] Sergey Shelukhin commented on HIVE-9277: Also high level note: I still see stuff

[jira] [Updated] (HIVE-9730) LLAP: make sure logging is never called when not needed

2015-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9730: --- Fix Version/s: llap LLAP: make sure logging is never called when not needed

[jira] [Resolved] (HIVE-9759) LLAP: Update launcher, scheduler to work with Tez changes

2015-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-9759. Resolution: Fixed in branch LLAP: Update launcher, scheduler to work with Tez changes

[jira] [Commented] (HIVE-9741) Refactor MetaStoreDirectSql constructor by removing DB queries out of critical section

2015-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14334192#comment-14334192 ] Sergey Shelukhin commented on HIVE-9741: 1) Why is setDbANSIMode called where it's

  1   2   3   4   5   6   7   8   9   10   >