[jira] [Commented] (HIVE-9555) assorted ORC refactorings for LLAP on trunk

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366783#comment-14366783 ] Gopal V commented on HIVE-9555: --- [~prasanth_j]: I saw that, which is why I so missed Object

[jira] [Commented] (HIVE-10003) MiniTez ut fail with missing configs

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366871#comment-14366871 ] Gopal V commented on HIVE-10003: [~hagleitn]: The LLAP mode is turned on for MiniTez tests

[jira] [Commented] (HIVE-10003) MiniTez ut fail with missing configs

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366904#comment-14366904 ] Gopal V commented on HIVE-10003: [~sseth]: I tried copying your default

[jira] [Commented] (HIVE-10003) MiniTez ut fail with missing configs

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366889#comment-14366889 ] Gopal V commented on HIVE-10003: I had to rebase to reproduce this error, looks like this

[jira] [Updated] (HIVE-10003) MiniTez ut fail with missing configs

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10003: --- Assignee: Siddharth Seth (was: Gopal V) MiniTez ut fail with missing configs

[jira] [Updated] (HIVE-9984) JoinReorder's getOutputSize is exponential

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9984: -- Attachment: HIVE-9984.2.patch I don't think the HashMap is a good idea, IdentityHashMap is safer. Made the

[jira] [Updated] (HIVE-10003) MiniTez ut fail with missing configs

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10003: --- Attachment: HIVE-10003.1.patch MiniTez ut fail with missing configs

[jira] [Updated] (HIVE-10004) yarn service registry should be an optional dependency

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10004: --- Summary: yarn service registry should be an optional dependency (was: yarn service registry should be

[jira] [Commented] (HIVE-9814) LLAP: JMX end points for monitoring metrics

2015-03-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362288#comment-14362288 ] Gopal V commented on HIVE-9814: --- Patch enables 3 new webservices to the LLAP daemon JSON JMX

[jira] [Updated] (HIVE-9814) LLAP: JMX end points for monitoring metrics

2015-03-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9814: -- Attachment: HIVE-9814.wip1.patch LLAP: JMX end points for monitoring metrics

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9976: -- Attachment: llap_vertex_200ms.png Possible race condition in DynamicPartitionPruner for 200ms tasks

[jira] [Commented] (HIVE-9978) LLAP: OrcColumnVectorProducer should handle reading isPresent columns only

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363475#comment-14363475 ] Gopal V commented on HIVE-9978: --- I see comments about this in code from [~sershe]. {code}

[jira] [Updated] (HIVE-9976) LLAP: Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9976: -- Summary: LLAP: Possible race condition in DynamicPartitionPruner for 200ms tasks (was: Possible race condition

[jira] [Updated] (HIVE-9978) LLAP: OrcColumnVectorProducer should handle reading isPresent columns only

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9978: -- Summary: LLAP: OrcColumnVectorProducer should handle reading isPresent columns only (was:

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9976: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7926 Possible race condition in DynamicPartitionPruner

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9976: -- Description: Race condition in the DynamicPartitionPruner between DynamicPartitionPruner::processVertex() and

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9976: -- Description: Race condition in the DynamicPartitionPruner between DynamicPartitionPruner::processVertex() and

[jira] [Commented] (HIVE-9937) LLAP: Vectorized Field-By-Field Serialize / Deserialize to support new Vectorized Map Join

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363496#comment-14363496 ] Gopal V commented on HIVE-9937: --- {code} Caused by: java.lang.NullPointerException at

[jira] [Commented] (HIVE-9937) LLAP: Vectorized Field-By-Field Serialize / Deserialize to support new Vectorized Map Join

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363494#comment-14363494 ] Gopal V commented on HIVE-9937: --- [~mmccline]: Pretty impressive performance difference for a

[jira] [Commented] (HIVE-9979) LLAP: LLAP Cached readers for StringDirectTreeReaders over-read data

2015-03-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363528#comment-14363528 ] Gopal V commented on HIVE-9979: --- Even the String dictionary readers are triggering exceptions

[jira] [Updated] (HIVE-9980) LLAP: Pass additional JVM args via Slider appConfig

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9980: -- Attachment: HIVE-9980.3.patch LLAP: Pass additional JVM args via Slider appConfig

[jira] [Assigned] (HIVE-9984) JoinReorder's getOutputSize is exponential

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-9984: - Assignee: Gopal V (was: Gunther Hagleitner) JoinReorder's getOutputSize is exponential

[jira] [Updated] (HIVE-10003) MiniTez ut fail with missing configs

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10003: --- Fix Version/s: llap MiniTez ut fail with missing configs

[jira] [Commented] (HIVE-9980) LLAP: Pass additional JVM args via Slider appConfig

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14368069#comment-14368069 ] Gopal V commented on HIVE-9980: --- Fixed --help as well. {code} usage: llap -a,--args args

[jira] [Updated] (HIVE-10003) MiniTez ut fail with missing configs

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10003: --- Assignee: Gunther Hagleitner (was: Siddharth Seth) MiniTez ut fail with missing configs

[jira] [Updated] (HIVE-10011) LLAP: NegativeArraySize exception on vector string reader

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10011: --- Summary: LLAP: NegativeArraySize exception on vector string reader (was: LLAP: NegativeArraySize exception

[jira] [Updated] (HIVE-9980) LLAP: Pass additional JVM args via Slider appConfig

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9980: -- Attachment: HIVE-9980.2.patch LLAP: Pass additional JVM args via Slider appConfig

[jira] [Resolved] (HIVE-9980) LLAP: Pass additional JVM args via Slider appConfig

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-9980. --- Resolution: Fixed Fix Version/s: llap Release Note: Committed to branch. LLAP: Pass additional

[jira] [Updated] (HIVE-10047) LLAP: VectorMapJoinOperator gets an over-flow on batchSize of 1024

2015-03-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10047: --- Assignee: Matt McCline LLAP: VectorMapJoinOperator gets an over-flow on batchSize of 1024

[jira] [Commented] (HIVE-9937) LLAP: Vectorized Field-By-Field Serialize / Deserialize to support new Vectorized Map Join

2015-03-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374821#comment-14374821 ] Gopal V commented on HIVE-9937: --- The explain would make more sense to figure out what the

[jira] [Updated] (HIVE-9931) Approximate nDV statistics from ORC bloom filter population

2015-03-11 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9931: -- Labels: ORC (was: ) Approximate nDV statistics from ORC bloom filter population

[jira] [Commented] (HIVE-9915) Allow specifying file format for managed tables

2015-03-11 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357711#comment-14357711 ] Gopal V commented on HIVE-9915: --- LGTM - +1 Allow specifying file format for managed tables

[jira] [Commented] (HIVE-9881) LLAP: Print ASCII art of LLAP during daemon startup

2015-03-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350226#comment-14350226 ] Gopal V commented on HIVE-9881: --- Yes, let's not go all crazy ... a bicycle is a nice

[jira] [Resolved] (HIVE-9884) LLAP: Add llap-daemon to the Tez session if the execution mode is LLAP

2015-03-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-9884. --- Resolution: Fixed Fix Version/s: llap {code} +if(llap.equals(HiveConf.getVar(conf,

[jira] [Updated] (HIVE-9884) LLAP: Add llap-daemon to the Tez session if the execution mode is LLAP

2015-03-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9884: -- Description: Add llap-daemon-site.xml to the TezConf and send the llap-daemon JAR to the app-master, when

[jira] [Updated] (HIVE-9883) LLAP: Slider deploy scripts

2015-03-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9883: -- Summary: LLAP: Slider deploy scripts (was: LLAP: Slider deploy modes) LLAP: Slider deploy scripts

[jira] [Resolved] (HIVE-9883) LLAP: Slider deploy scripts

2015-03-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-9883. --- Resolution: Fixed To use these scripts, configure llap-daemon-site.xml correctly and build a slider installer

[jira] [Commented] (HIVE-9881) LLAP: Print ASCII art of LLAP during daemon startup

2015-03-05 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349757#comment-14349757 ] Gopal V commented on HIVE-9881: --- What happened to the unicorn riding a unicycle? LLAP:

[jira] [Resolved] (HIVE-9773) LLAP: Make sure jar containing the Tez plugins is added as a local resource for the AM

2015-03-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-9773. --- Resolution: Implemented Went in as part of HIVE-9884. LLAP: Make sure jar containing the Tez plugins is

[jira] [Updated] (HIVE-9958) LLAP: YARN registry for Auto-organizing Slider instances

2015-03-13 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9958: -- Attachment: HIVE-9958.patch LLAP: YARN registry for Auto-organizing Slider instances

[jira] [Resolved] (HIVE-9958) LLAP: YARN registry for Auto-organizing Slider instances

2015-03-13 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-9958. --- Resolution: Fixed Release Note: LLAP: YARN registry for Auto-organizing Slider instances (Gopal V) Will

[jira] [Updated] (HIVE-9958) LLAP: YARN registry for Auto-organizing Slider instances

2015-03-13 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9958: -- Attachment: (was: HIVE-9958.patch) LLAP: YARN registry for Auto-organizing Slider instances

[jira] [Commented] (HIVE-9958) LLAP: YARN registry for Auto-organizing Slider instances

2015-03-13 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361190#comment-14361190 ] Gopal V commented on HIVE-9958: --- Thanks [~hagleitn], the patch has a section in the

[jira] [Commented] (HIVE-9756) LLAP: use log4j 2 for llap

2015-03-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359826#comment-14359826 ] Gopal V commented on HIVE-9756: --- [~sseth]: turns out I have to switch Tez over to log4j,

[jira] [Commented] (HIVE-9915) Allow specifying file format for managed tables

2015-03-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359716#comment-14359716 ] Gopal V commented on HIVE-9915: --- [~leftylev]: While reviewing Gunther's patch I ran into some

[jira] [Updated] (HIVE-7428) OrcSplit fails to account for columnar projections in its size estimates

2015-03-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7428: -- Assignee: Prasanth Jayachandran (was: Gopal V) OrcSplit fails to account for columnar projections in its size

[jira] [Updated] (HIVE-9887) LLAP: Add LLAP_DAEMON_LD_PATH to add native libs in

2015-03-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9887: -- Attachment: HIVE-9887.patch LLAP: Add LLAP_DAEMON_LD_PATH to add native libs in

[jira] [Updated] (HIVE-9884) LLAP: Add llap-daemon to the Tez session if the execution mode is LLAP

2015-03-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9884: -- Attachment: HIVE-9884.patch LLAP: Add llap-daemon to the Tez session if the execution mode is LLAP

[jira] [Updated] (HIVE-9883) LLAP: Slider deploy scripts

2015-03-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9883: -- Attachment: HIVE-9883.patch LLAP: Slider deploy scripts --- Key:

[jira] [Updated] (HIVE-10075) LLAP: Object Estimator digs in via a deep hashCode()

2015-03-24 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10075: --- Description: LLAP ObjectEstimator started showing up in profiles, due to the fact that it does a deep

[jira] [Updated] (HIVE-10082) LLAP: UnwrappedRowContainer throws exceptions

2015-03-24 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10082: --- Assignee: Gunther Hagleitner LLAP: UnwrappedRowContainer throws exceptions

[jira] [Updated] (HIVE-10163) CommonMergeJoinOperator calls WritableComparator.get() in the inner loop

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10163: --- Attachment: mergejoin-parallel-lock.png mergejoin-parallel-bt.png CommonMergeJoinOperator

[jira] [Updated] (HIVE-10163) CommonMergeJoinOperator calls WritableComparator.get() in the inner loop

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10163: --- Description: The CommonMergeJoinOperator wastes CPU looking up the correct comparator for each

[jira] [Updated] (HIVE-10163) CommonMergeJoinOperator calls WritableComparator.get() in the inner loop

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10163: --- Attachment: mergejoin-comparekeys.png CommonMergeJoinOperator calls WritableComparator.get() in the inner

[jira] [Commented] (HIVE-10163) CommonMergeJoinOperator calls WritableComparator.get() in the inner loop

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388254#comment-14388254 ] Gopal V commented on HIVE-10163: Nope, it still hits HADOOP-11771 in the processKey().

[jira] [Updated] (HIVE-10162) LLAP: Avoid deserializing the plan 1 times in a single thread

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10162: --- Attachment: deserialize-plan-2.png deserialize-plan-1.png LLAP: Avoid deserializing the plan

[jira] [Commented] (HIVE-10163) CommonMergeJoinOperator calls WritableComparator.get() in the inner loop

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388188#comment-14388188 ] Gopal V commented on HIVE-10163: {{WritableComparator::get()}} --

[jira] [Updated] (HIVE-10164) LLAP: ORC BIGINT SARGs regressed after Parquet PPD fixes (HIVE-8122)

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10164: --- Attachment: orc-sarg-tostring.png LLAP: ORC BIGINT SARGs regressed after Parquet PPD fixes (HIVE-8122)

[jira] [Updated] (HIVE-10175) PartitionPruning lacks a fast-path exit for large IN() queries

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10175: --- Component/s: Query Planning PartitionPruning lacks a fast-path exit for large IN() queries

[jira] [Updated] (HIVE-10175) PartitionPruning lacks a fast-path exit for large IN() queries

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10175: --- Summary: PartitionPruning lacks a fast-path exit for large IN() queries (was: Tez DynamicPartitionPruning

[jira] [Updated] (HIVE-10175) PartitionPruning lacks a fast-path exit for large IN() queries

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10175: --- Description: TezCompiler::runDynamicPartitionPruning() ppr.PartitionPruner() calls the graph walker even if

[jira] [Updated] (HIVE-10175) PartitionPruning lacks a fast-path exit for large IN() queries

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10175: --- Component/s: (was: Query Planning) Physical Optimizer PartitionPruning lacks a

[jira] [Updated] (HIVE-10174) LLAP: ORC MemoryManager is singleton synchronized

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10174: --- Description: ORC MemoryManager::addedRow() checks are bad for LLAP multi-threaded performance.

[jira] [Updated] (HIVE-10174) LLAP: ORC MemoryManager is singleton synchronized

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10174: --- Attachment: orc-memorymanager-2.png orc-memorymanager-1.png LLAP: ORC MemoryManager is

[jira] [Commented] (HIVE-10174) LLAP: ORC MemoryManager is singleton synchronized

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389958#comment-14389958 ] Gopal V commented on HIVE-10174: Performance difference is somewhere along the lines of

[jira] [Commented] (HIVE-10175) PartitionPruning lacks a fast-path exit for large IN() queries

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389994#comment-14389994 ] Gopal V commented on HIVE-10175: {code} METHOD DURATION(ms) parse

[jira] [Updated] (HIVE-10175) PartitionPruning lacks a fast-path exit for large IN() queries

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10175: --- Assignee: Gunther Hagleitner PartitionPruning lacks a fast-path exit for large IN() queries

[jira] [Assigned] (HIVE-10161) LLAP: ORC file contains compression buffers larger than bufferSize (OR reader has a bug)

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-10161: -- Assignee: Gopal V (was: Prasanth Jayachandran) LLAP: ORC file contains compression buffers larger

[jira] [Commented] (HIVE-10161) LLAP: ORC file contains compression buffers larger than bufferSize (OR reader has a bug)

2015-03-31 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389043#comment-14389043 ] Gopal V commented on HIVE-10161: This bug may be due to something else entirely - the

[jira] [Updated] (HIVE-9807) LLAP: Add event logging for execution elements

2015-02-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9807: -- Description: For analysis of runtimes, submit/start delays, interleaving etc. !llap-executors.png! was:For

[jira] [Commented] (HIVE-9807) LLAP: Add event logging for execution elements

2015-02-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341210#comment-14341210 ] Gopal V commented on HIVE-9807: --- Thanks [~sseth], wrote a sample analysis script - the thing

[jira] [Updated] (HIVE-9820) LLAP: Use a share-nothing scoreboard /status implementation

2015-02-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9820: -- Affects Version/s: llap LLAP: Use a share-nothing scoreboard /status implementation

[jira] [Updated] (HIVE-9711) ORC Vectorization DoubleColumnVector.isRepeating=false if all entries are NaN

2015-03-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9711: -- Attachment: HIVE-9711.1.patch ORC Vectorization DoubleColumnVector.isRepeating=false if all entries are NaN

[jira] [Assigned] (HIVE-9711) ORC Vectorization DoubleColumnVector.isRepeating=false if all entries are NaN

2015-03-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-9711: - Assignee: Gopal V ORC Vectorization DoubleColumnVector.isRepeating=false if all entries are NaN

[jira] [Commented] (HIVE-9841) IOException thrown by ORC should include the path of processing file

2015-03-04 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347339#comment-14347339 ] Gopal V commented on HIVE-9841: --- LGTM - +1. IOException thrown by ORC should include the

[jira] [Updated] (HIVE-9841) IOException thrown by ORC should include the path of processing file

2015-03-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9841: -- Attachment: HIVE-9841.2.patch LGTM - +1. Added to perf test, might have a couple of minor changes after

[jira] [Updated] (HIVE-9848) readlink -f is GNU coreutils only (used in bin/hive)

2015-03-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9848: -- Attachment: HIVE-9848.1.patch readlink -f is GNU coreutils only (used in bin/hive)

[jira] [Commented] (HIVE-9730) make sure logging is never called when not needed in perf-sensitive places

2015-02-24 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14335313#comment-14335313 ] Gopal V commented on HIVE-9730: --- [~sershe]: Hold on, before we have checks for Log4JLogger

[jira] [Resolved] (HIVE-9764) LLAP: Update tez dependency in branch

2015-02-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-9764. --- Resolution: Fixed Release Note: Update tez dependency in branch fix build LLAP: Update tez dependency

[jira] [Commented] (HIVE-9937) LLAP: Vectorized Field-By-Field Serialize / Deserialize to support new Vectorized Map Join

2015-03-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382857#comment-14382857 ] Gopal V commented on HIVE-9937: --- [~mmccline]: Ran a few scale tests last night and there

[jira] [Commented] (HIVE-10036) Writing ORC format big table causes OOM - too many fixed sized stream buffers

2015-03-24 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378260#comment-14378260 ] Gopal V commented on HIVE-10036: [~selinazh]: quick q - the netty version hive-1.2 is 4.0.

[jira] [Updated] (HIVE-9980) LLAP: Pass additional JVM args via Slider appConfig

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9980: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7926 LLAP: Pass additional JVM args via Slider appConfig

[jira] [Updated] (HIVE-9980) LLAP: Pass additional JVM args via Slider appConfig

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-9980: -- Attachment: HIVE-9980.1.patch LLAP: Pass additional JVM args via Slider appConfig

[jira] [Resolved] (HIVE-9887) LLAP: Add LLAP_DAEMON_LD_PATH to add native libs in

2015-03-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-9887. --- Resolution: Fixed Committed to branch, with the default value for this data as $(HADOOP_HOME)/lib/native.

[jira] [Updated] (HIVE-10112) LLAP: query 17 tasks fail due to mapjoin issue

2015-03-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10112: --- Assignee: Gunther Hagleitner (was: Sergey Shelukhin) LLAP: query 17 tasks fail due to mapjoin issue

[jira] [Reopened] (HIVE-10128) LLAP: BytesBytesMultiHashMap does not allow concurrent read-only access

2015-03-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reopened HIVE-10128: LLAP: BytesBytesMultiHashMap does not allow concurrent read-only access

[jira] [Updated] (HIVE-10128) LLAP: BytesBytesMultiHashMap does not allow concurrent read-only access

2015-03-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10128: --- Attachment: hashmap-after.png Fix looks good, the hashmap sync points have gone away from the inner loops.

[jira] [Updated] (HIVE-10132) LLAP: Tez heartbeats are delayed by ~500+ ms due to Hadoop IPC client

2015-03-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10132: --- Attachment: HIVE-10132.NOT.A.patch This turns off the client-cache, which uses the socket factory object as

[jira] [Commented] (HIVE-10191) ORC: Cleanup writer per-row synchronization

2015-04-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392278#comment-14392278 ] Gopal V commented on HIVE-10191: [~owen.omalley]/[~prasanth_j]: FYI. ORC: Cleanup writer

[jira] [Commented] (HIVE-10174) LLAP: ORC MemoryManager is singleton synchronized

2015-04-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392343#comment-14392343 ] Gopal V commented on HIVE-10174: That would be a good idea sometime down the line, because

[jira] [Commented] (HIVE-9645) Constant folding case NULL equality

2015-04-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392336#comment-14392336 ] Gopal V commented on HIVE-9645: --- [~ashutoshc]: The latest patch is still breaking type-checks

[jira] [Updated] (HIVE-10163) CommonMergeJoinOperator calls WritableComparator.get() in the inner loop

2015-04-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10163: --- Attachment: (was: HIVE-10163.2.patch) CommonMergeJoinOperator calls WritableComparator.get() in the

[jira] [Updated] (HIVE-10163) CommonMergeJoinOperator calls WritableComparator.get() in the inner loop

2015-04-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10163: --- Attachment: HIVE-10163.2.patch CommonMergeJoinOperator calls WritableComparator.get() in the inner loop

[jira] [Updated] (HIVE-10163) CommonMergeJoinOperator calls WritableComparator.get() in the inner loop

2015-04-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10163: --- Attachment: HIVE-10163.2.patch [~hagleitn]: The thread locking disappeared with your patch, but I found the

[jira] [Commented] (HIVE-10204) vectorMode flags in BaseWork and AbstractOperatorDesc are duplicated

2015-04-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393546#comment-14393546 ] Gopal V commented on HIVE-10204: Wasn't this fixed already with

[jira] [Updated] (HIVE-10220) Disable all non-concurrent access to BytesBytesHashMap

2015-04-11 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10220: --- Attachment: HIVE-10220.2.patch Disable all non-concurrent access to BytesBytesHashMap

[jira] [Updated] (HIVE-10220) Disable all non-concurrent access to BytesBytesHashMap

2015-04-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10220: --- Summary: Disable all non-concurrent access to BytesBytesHashMap (was: Concurrent read access within

[jira] [Commented] (HIVE-10220) Disable all non-concurrent access to BytesBytesHashMap

2015-04-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493783#comment-14493783 ] Gopal V commented on HIVE-10220: Test runs which failed to produce output seems to have

[jira] [Commented] (HIVE-10466) LLAP: fix container sizing configuration for memory

2015-04-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509794#comment-14509794 ] Gopal V commented on HIVE-10466: The current memory script does this - it uses NODE_MEM/2

[jira] [Commented] (HIVE-10235) Loop optimization for SIMD in ColumnDivideColumn.txt

2015-04-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504949#comment-14504949 ] Gopal V commented on HIVE-10235: [~chengxiang li]: Patch LGTM - +1. Not able to see a

  1   2   3   4   5   6   7   8   9   10   >