[jira] [Updated] (HIVE-11460) CTAS : Allows user to create table without explicit column names which fails stats creation on new table

2015-08-04 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11460: --- Labels: function (was: ) > CTAS : Allows user to create table without explicit column names w

[jira] [Updated] (HIVE-11460) CTAS : Allows user to create table without explicit column names which fails stats creation on new table

2015-08-04 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11460: --- Affects Version/s: 0.14.0 > CTAS : Allows user to create table without explicit column names w

[jira] [Updated] (HIVE-11460) CTAS : Allows user to create table without explicit column names which fails stats creation on new table

2015-08-04 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11460: --- Component/s: Hive > CTAS : Allows user to create table without explicit column names which fai

[jira] [Commented] (HIVE-11449) HybridHashTableContainer should throw exception if not enough memory to create the hash tables

2015-08-04 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654340#comment-14654340 ] Mostafa Mokhtar commented on HIVE-11449: [~jdere] I don't agree with throwing an e

[jira] [Commented] (HIVE-11410) Join with subquery containing a group by incorrectly returns no results

2015-07-30 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648523#comment-14648523 ] Mostafa Mokhtar commented on HIVE-11410: [~mmccline] > Join with subquery contain

[jira] [Commented] (HIVE-11366) Avoid right leaning tree hashCode depth during ExprNodeDescEqualityWrapper HashMaps

2015-07-27 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643161#comment-14643161 ] Mostafa Mokhtar commented on HIVE-11366: [~gopalv] Still problematic. {code} Sta

[jira] [Commented] (HIVE-11341) Avoid expensive resizing of ASTNode tree

2015-07-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637282#comment-14637282 ] Mostafa Mokhtar commented on HIVE-11341: [~hagleitn] [~jcamachorodriguez] [~hsubra

[jira] [Updated] (HIVE-11341) Avoid expensive resizing of ASTNode tree

2015-07-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11341: --- Summary: Avoid expensive resizing of ASTNode tree (was: Avoid resizing of ASTNode tree ) >

[jira] [Updated] (HIVE-11341) Avoid resizing of ASTNode tree

2015-07-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11341: --- Description: {code} Stack Trace Sample CountPercentage(%) parse.BaseSemanticAnalyzer

[jira] [Commented] (HIVE-11172) Vectorization wrong results for aggregate query with where clause without group by

2015-07-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636001#comment-14636001 ] Mostafa Mokhtar commented on HIVE-11172: [~hsubramaniyan] Is this getting back por

[jira] [Updated] (HIVE-11330) Add early termination for recursion in StatsRulesProcFactory$FilterStatsRule.evaluateExpression

2015-07-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11330: --- Attachment: HIVE-11330.patch > Add early termination for recursion in > StatsRulesProcFactory

[jira] [Updated] (HIVE-11299) Hive query planning allocating lots of memory and hitting OOMs

2015-07-19 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11299: --- Attachment: HIVE-11299.1.patch > Hive query planning allocating lots of memory and hitting OOM

[jira] [Updated] (HIVE-11299) Hive query planning allocating lots of memory and hitting OOMs

2015-07-17 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11299: --- Attachment: HIVE-11299.patch > Hive query planning allocating lots of memory and hitting OOMs

[jira] [Updated] (HIVE-11299) Hive query planning allocating lots of memory and hitting OOMs

2015-07-17 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11299: --- Attachment: (was: HIVE-11299.patch) > Hive query planning allocating lots of memory and hi

[jira] [Updated] (HIVE-11299) Hive query planning allocating lots of memory and hitting OOMs

2015-07-17 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11299: --- Attachment: HIVE-11299.patch > Hive query planning allocating lots of memory and hitting OOMs

[jira] [Commented] (HIVE-11068) Hive throws OOM in client side

2015-07-10 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622914#comment-14622914 ] Mostafa Mokhtar commented on HIVE-11068: [~jpullokkaran] This is the one I was ref

[jira] [Commented] (HIVE-11211) Reset the static fields in static class JoinStatsRule in StatsRulesProcFactory

2015-07-08 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619379#comment-14619379 ] Mostafa Mokhtar commented on HIVE-11211: [~hagleitn] FYI > Reset the static fiel

[jira] [Commented] (HIVE-11110) Enable HiveJoinAddNotNullRule in CBO

2015-07-06 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615740#comment-14615740 ] Mostafa Mokhtar commented on HIVE-0: [~jpullokkaran] this is the full query

[jira] [Commented] (HIVE-10233) Hive on tez: memory manager for grace hash join

2015-06-24 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600409#comment-14600409 ] Mostafa Mokhtar commented on HIVE-10233: [~vikram.dixit] Yes, issue unrelated. >

[jira] [Commented] (HIVE-10233) Hive on tez: memory manager for grace hash join

2015-06-24 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600332#comment-14600332 ] Mostafa Mokhtar commented on HIVE-10233: [~hagleitn] [~vikram.dixit] On the latest

[jira] [Commented] (HIVE-10233) Hive on tez: memory manager for grace hash join

2015-06-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14597141#comment-14597141 ] Mostafa Mokhtar commented on HIVE-10233: [~hagleitn] Please check comment above.

[jira] [Commented] (HIVE-10233) Hive on tez: memory manager for grace hash join

2015-06-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14597139#comment-14597139 ] Mostafa Mokhtar commented on HIVE-10233: [~gunther] Should totalAvailableMemory be

[jira] [Commented] (HIVE-10233) Hive on tez: memory manager for grace hash join

2015-06-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14597126#comment-14597126 ] Mostafa Mokhtar commented on HIVE-10233: [~hagleitn] [~vikram.dixit] [~wzheng] It

[jira] [Commented] (HIVE-11068) Hive throws OOM in client side

2015-06-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14595427#comment-14595427 ] Mostafa Mokhtar commented on HIVE-11068: [~rajesh.balamohan] Can you upload the hi

[jira] [Updated] (HIVE-11031) ORC concatenation of old files can fail while merging column statistics

2015-06-17 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11031: --- Affects Version/s: 0.13.0 0.14.0 > ORC concatenation of old files can f

[jira] [Updated] (HIVE-11027) Hive on tez: Bucket map joins fail when hashcode goes negative

2015-06-16 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-11027: --- Affects Version/s: 0.13 0.14.0 > Hive on tez: Bucket map joins fail whe

[jira] [Updated] (HIVE-10107) Union All : Vertex missing stats resulting in OOM and in-efficient plans

2015-06-15 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10107: --- Fix Version/s: 1.2.1 > Union All : Vertex missing stats resulting in OOM and in-efficient plan

[jira] [Commented] (HIVE-11004) PermGen OOM error in Hiveserver2

2015-06-15 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586438#comment-14586438 ] Mostafa Mokhtar commented on HIVE-11004: [~martinbenson] Try setting hive.orc.cach

[jira] [Updated] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-06-13 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10704: --- Assignee: Jason Dere (was: Mostafa Mokhtar) > Errors in Tez HashTableLoader when estimated ta

[jira] [Commented] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-06-11 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582700#comment-14582700 ] Mostafa Mokhtar commented on HIVE-10704: Replied to your comments. > Errors in T

[jira] [Commented] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-06-10 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580806#comment-14580806 ] Mostafa Mokhtar commented on HIVE-10704: [~apivovarov] Do you have any more commen

[jira] [Commented] (HIVE-10955) CliDriver leaves tables behind at end of test run

2015-06-06 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576059#comment-14576059 ] Mostafa Mokhtar commented on HIVE-10955: [~ekoifman] Could this be related to the

[jira] [Commented] (HIVE-10936) incorrect result set when hive.vectorized.execution.enabled = true with predicate casting to CHAR or VARCHAR

2015-06-05 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574829#comment-14574829 ] Mostafa Mokhtar commented on HIVE-10936: [~mmccline] FYI > incorrect result set w

[jira] [Commented] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-06-01 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568289#comment-14568289 ] Mostafa Mokhtar commented on HIVE-10704: [~apivovarov] Ping. > Errors in Tez Has

[jira] [Commented] (HIVE-10880) The bucket number is not respected in insert overwrite.

2015-06-01 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567438#comment-14567438 ] Mostafa Mokhtar commented on HIVE-10880: [~ekoifman] > The bucket number is not r

[jira] [Commented] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-05-29 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565796#comment-14565796 ] Mostafa Mokhtar commented on HIVE-10704: [~apivovarov] Any updates? > Errors in T

[jira] [Commented] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-05-28 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14563842#comment-14563842 ] Mostafa Mokhtar commented on HIVE-10704: Table size of 0 is usually an error in th

[jira] [Commented] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-05-28 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14563841#comment-14563841 ] Mostafa Mokhtar commented on HIVE-10704: Table size of 0 is usually an error in th

[jira] [Commented] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-05-26 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560489#comment-14560489 ] Mostafa Mokhtar commented on HIVE-10704: Done, command line rb was giving me some

[jira] [Updated] (HIVE-7723) Explain plan for complex query with lots of partitions is slow due to in-efficient collection used to find a matching ReadEntity

2015-05-26 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-7723: -- Attachment: HIVE-7723.11.patch > Explain plan for complex query with lots of partitions is slow d

[jira] [Updated] (HIVE-7723) Explain plan for complex query with lots of partitions is slow due to in-efficient collection used to find a matching ReadEntity

2015-05-26 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-7723: -- Attachment: (was: HIVE-7723.11.patch) > Explain plan for complex query with lots of partition

[jira] [Commented] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-05-26 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560083#comment-14560083 ] Mostafa Mokhtar commented on HIVE-10704: [~apivovarov] Ditto for this one. > Err

[jira] [Commented] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

2015-05-26 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14559731#comment-14559731 ] Mostafa Mokhtar commented on HIVE-10711: Yes, please. > Tez HashTableLoader att

[jira] [Commented] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

2015-05-26 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14559732#comment-14559732 ] Mostafa Mokhtar commented on HIVE-10711: Yes, please. > Tez HashTableLoader att

[jira] [Updated] (HIVE-7723) Explain plan for complex query with lots of partitions is slow due to in-efficient collection used to find a matching ReadEntity

2015-05-26 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-7723: -- Attachment: HIVE-7723.11.patch > Explain plan for complex query with lots of partitions is slow d

[jira] [Commented] (HIVE-10793) Hybrid Hybrid Grace Hash Join : Don't allocate all hash table memory upfront

2015-05-26 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14559704#comment-14559704 ] Mostafa Mokhtar commented on HIVE-10793: [~sushanth] [~sershe] Can this go to 1.2.

[jira] [Commented] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

2015-05-26 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14559699#comment-14559699 ] Mostafa Mokhtar commented on HIVE-10711: [~sushanth] FYI [~apivovarov] Can you p

[jira] [Commented] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

2015-05-26 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14559618#comment-14559618 ] Mostafa Mokhtar commented on HIVE-10711: [~apivovarov] do you have anymore feedbac

[jira] [Commented] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-05-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14556665#comment-14556665 ] Mostafa Mokhtar commented on HIVE-10704: Test failures are unrelated. > Errors in

[jira] [Commented] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

2015-05-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14556664#comment-14556664 ] Mostafa Mokhtar commented on HIVE-10711: Test failures are unrelated. > Tez HashT

[jira] [Commented] (HIVE-10793) Hybrid Hybrid Grace Hash Join : Don't allocate all hash table memory upfront

2015-05-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14556641#comment-14556641 ] Mostafa Mokhtar commented on HIVE-10793: [~sershe] Updated patch. > Hybrid Hybrid

[jira] [Updated] (HIVE-10793) Hybrid Hybrid Grace Hash Join : Don't allocate all hash table memory upfront

2015-05-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10793: --- Attachment: (was: HIVE-10793.2.patch) > Hybrid Hybrid Grace Hash Join : Don't allocate all

[jira] [Updated] (HIVE-10793) Hybrid Hybrid Grace Hash Join : Don't allocate all hash table memory upfront

2015-05-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10793: --- Attachment: HIVE-10793.2.patch > Hybrid Hybrid Grace Hash Join : Don't allocate all hash table

[jira] [Updated] (HIVE-10793) Hybrid Hybrid Grace Hash Join : Don't allocate all hash table memory upfront

2015-05-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10793: --- Attachment: (was: HIVE-10793.2.patch) > Hybrid Hybrid Grace Hash Join : Don't allocate all

[jira] [Updated] (HIVE-10793) Hybrid Hybrid Grace Hash Join : Don't allocate all hash table memory upfront

2015-05-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10793: --- Attachment: HIVE-10793.2.patch > Hybrid Hybrid Grace Hash Join : Don't allocate all hash table

[jira] [Updated] (HIVE-10793) Hybrid Hybrid Grace Hash Join : Don't allocate all hash table memory upfront

2015-05-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10793: --- Attachment: HIVE-10793.2.patch > Hybrid Hybrid Grace Hash Join : Don't allocate all hash table

[jira] [Commented] (HIVE-10793) Hybrid Hybrid Grace Hash Join : Don't allocate all hash table memory upfront

2015-05-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14556520#comment-14556520 ] Mostafa Mokhtar commented on HIVE-10793: [~sershe] [~vikram.dixit] Sure, I can do

[jira] [Commented] (HIVE-10793) Hybrid Hybrid Grace Hash Join : Don't allocate all hash table memory upfront

2015-05-22 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14556475#comment-14556475 ] Mostafa Mokhtar commented on HIVE-10793: [~sershe] HybridHybrid can create an arbi

[jira] [Updated] (HIVE-10793) Hybrid Hybrid Grace Hash Join : Don't allocate all hash table memory upfront

2015-05-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10793: --- Attachment: HIVE-10793.1.patch > Hybrid Hybrid Grace Hash Join : Don't allocate all hash table

[jira] [Updated] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

2015-05-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10711: --- Attachment: HIVE-10711.4.patch Addressing feedback comments. > Tez HashTableLoader attempts t

[jira] [Updated] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-05-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10704: --- Assignee: Mostafa Mokhtar (was: Jason Dere) > Errors in Tez HashTableLoader when estimated ta

[jira] [Updated] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-05-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10704: --- Attachment: HIVE-10704.3.patch Rebase patch on latest. > Errors in Tez HashTableLoader when

[jira] [Updated] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

2015-05-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10711: --- Attachment: HIVE-10711.3.patch Updated patch based on feedback. > Tez HashTableLoader attempt

[jira] [Updated] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

2015-05-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10711: --- Fix Version/s: 1.2.1 > Tez HashTableLoader attempts to allocate more memory than available whe

[jira] [Updated] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

2015-05-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10711: --- Assignee: Mostafa Mokhtar (was: Jason Dere) > Tez HashTableLoader attempts to allocate more m

[jira] [Updated] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0

2015-05-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10704: --- Fix Version/s: 1.2.1 > Errors in Tez HashTableLoader when estimated table size is 0 >

[jira] [Commented] (HIVE-10722) external table creation with msck in Hive can create unusable partition

2015-05-20 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553133#comment-14553133 ] Mostafa Mokhtar commented on HIVE-10722: [~sershe] Can this be ported to 0.13 as w

[jira] [Commented] (HIVE-10735) LLAP: Cached plan race condition - VectorMapJoinCommonOperator has no closeOp()

2015-05-19 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551135#comment-14551135 ] Mostafa Mokhtar commented on HIVE-10735: [~gopalv] [~hagleitn] Can you add the qu

[jira] [Commented] (HIVE-10746) Hive 0.14.x and Hive 1.2.0 w/ Tez 0.5.3/Tez 0.6.0 Slow group by/order by

2015-05-19 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14550669#comment-14550669 ] Mostafa Mokhtar commented on HIVE-10746: Can you please run "set hive.tez.exec.pri

[jira] [Updated] (HIVE-10628) Incorrect result when vectorized native mapjoin is enabled using null safe operators <=>

2015-05-15 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10628: --- Fix Version/s: 1.2.0 > Incorrect result when vectorized native mapjoin is enabled using null s

[jira] [Commented] (HIVE-8065) Support HDFS encryption functionality on Hive

2015-05-14 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544633#comment-14544633 ] Mostafa Mokhtar commented on HIVE-8065: --- Hi [~spena] These are configs I have, which

[jira] [Commented] (HIVE-10101) LLAP: enable yourkit profiling of tasks

2015-05-13 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543232#comment-14543232 ] Mostafa Mokhtar commented on HIVE-10101: [~sershe] This is an alternative to an AP

[jira] [Commented] (HIVE-10101) LLAP: enable yourkit profiling of tasks

2015-05-13 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14542457#comment-14542457 ] Mostafa Mokhtar commented on HIVE-10101: [~sershe] An un-supported API example for

[jira] [Commented] (HIVE-9069) Simplify filter predicates for CBO

2015-05-13 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14542383#comment-14542383 ] Mostafa Mokhtar commented on HIVE-9069: --- [~jcamachorodriguez] It looks like we either

[jira] [Commented] (HIVE-10101) LLAP: enable yourkit profiling of tasks

2015-05-12 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14541052#comment-14541052 ] Mostafa Mokhtar commented on HIVE-10101: [~sershe] I would rather use JMC which i

[jira] [Commented] (HIVE-10484) Vectorization : RuntimeException "Big Table Retained Mapping duplicate column"

2015-05-11 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538931#comment-14538931 ] Mostafa Mokhtar commented on HIVE-10484: [~prasanth_j] > Vectorization : RuntimeE

[jira] [Commented] (HIVE-8065) Support HDFS encryption functionality on Hive

2015-05-11 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538548#comment-14538548 ] Mostafa Mokhtar commented on HIVE-8065: --- [~spena] I am running on a cluster which ha

[jira] [Commented] (HIVE-10244) Vectorization : TPC-DS Q80 fails with java.lang.ClassCastException when hive.vectorized.execution.reduce.enabled is enabled

2015-05-10 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537537#comment-14537537 ] Mostafa Mokhtar commented on HIVE-10244: [~jpullokkaran] Can you please take a loo

[jira] [Commented] (HIVE-10609) Vectorization : Q64 fails with ClassCastException

2015-05-10 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537338#comment-14537338 ] Mostafa Mokhtar commented on HIVE-10609: [~mmccline] I tried the patch on TPC-DS 2

[jira] [Commented] (HIVE-10609) Vectorization : Q64 fails with ClassCastException

2015-05-08 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536223#comment-14536223 ] Mostafa Mokhtar commented on HIVE-10609: I think the hint from the exception is th

[jira] [Commented] (HIVE-10609) Vectorization : Q64 fails with ClassCastException

2015-05-08 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536222#comment-14536222 ] Mostafa Mokhtar commented on HIVE-10609: [~mmccline] Still repros on latest. First

[jira] [Commented] (HIVE-10609) Vectorization : Q64 fails with ClassCastException

2015-05-08 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536048#comment-14536048 ] Mostafa Mokhtar commented on HIVE-10609: Will verify against latest. Did anything

[jira] [Commented] (HIVE-10609) Vectorization : Q64 fails with ClassCastException

2015-05-08 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535732#comment-14535732 ] Mostafa Mokhtar commented on HIVE-10609: [~sushanth] This fix is needed to keep q

[jira] [Commented] (HIVE-9069) Simplify filter predicates for CBO

2015-05-08 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14534736#comment-14534736 ] Mostafa Mokhtar commented on HIVE-9069: --- [~jcamachorodriguez] Yes, this is correct.

[jira] [Commented] (HIVE-9069) Simplify filter predicates for CBO

2015-05-07 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533971#comment-14533971 ] Mostafa Mokhtar commented on HIVE-9069: --- [~jcamachorodriguez] Check web_sales for in

[jira] [Commented] (HIVE-10484) Vectorization : RuntimeException "Big Table Retained Mapping duplicate column"

2015-05-06 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531089#comment-14531089 ] Mostafa Mokhtar commented on HIVE-10484: [~mmccline] I verified this patch agains

[jira] [Resolved] (HIVE-10446) Hybrid Hybrid Grace Hash Join : java.lang.IllegalArgumentException in Kryo while spilling big table

2015-05-06 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar resolved HIVE-10446. Resolution: Fixed Issue fixed after recent changes to HybridHybrid > Hybrid Hybrid Grace Ha

[jira] [Commented] (HIVE-10484) Vectorization : RuntimeException "Big Table Retained Mapping duplicate column"

2015-05-06 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531024#comment-14531024 ] Mostafa Mokhtar commented on HIVE-10484: [~mmccline] no need. Will try out the pat

[jira] [Updated] (HIVE-10609) Vectorization : Q64 fails with ClassCastException

2015-05-04 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10609: --- Component/s: Vectorization > Vectorization : Q64 fails with ClassCastException > -

[jira] [Commented] (HIVE-10561) Tez session does not always end when CLI is ctrl-c-ed

2015-04-30 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522443#comment-14522443 ] Mostafa Mokhtar commented on HIVE-10561: Even after "exit;" this still happens.

[jira] [Commented] (HIVE-10551) OOM when running query_89 with vectorization on & hybridgrace=false

2015-04-30 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522429#comment-14522429 ] Mostafa Mokhtar commented on HIVE-10551: [~rajesh.balamohan] How many Sort threads

[jira] [Resolved] (HIVE-9712) Row count and data size are set to LONG.MAX when source table has 0 rows

2015-04-30 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar resolved HIVE-9712. --- Resolution: Cannot Reproduce Metastore mismatch. {code} Map 12 Map Operator Tre

[jira] [Commented] (HIVE-9392) JoinStatsRule miscalculates join cardinality as incorrect NDV is used due to column names having duplicated fqColumnName

2015-04-30 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521841#comment-14521841 ] Mostafa Mokhtar commented on HIVE-9392: --- [~pxiong] No, this is not fixed. > JoinStat

[jira] [Commented] (HIVE-10551) OOM when running query_89 with vectorization on & hybridgrace=false

2015-04-30 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521695#comment-14521695 ] Mostafa Mokhtar commented on HIVE-10551: [~rajesh.balamohan] Can you please attac

[jira] [Commented] (HIVE-10530) Aggregate stats cache: bug fixes for RDBMS path

2015-04-29 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520483#comment-14520483 ] Mostafa Mokhtar commented on HIVE-10530: [~hagleitn] [~gopalv] Plan generation for

[jira] [Commented] (HIVE-10530) Aggregate stats cache: bug fixes for RDBMS path

2015-04-29 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520411#comment-14520411 ] Mostafa Mokhtar commented on HIVE-10530: [~vgumashta] [~thejas] Correction, we en

[jira] [Commented] (HIVE-10530) Aggregate stats cache: bug fixes for RDBMS path

2015-04-29 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520348#comment-14520348 ] Mostafa Mokhtar commented on HIVE-10530: [~vgumashta] Now the query is hitting th

[jira] [Updated] (HIVE-10484) Vectorization : RuntimeException "Big Table Retained Mapping duplicate column"

2015-04-24 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10484: --- Summary: Vectorization : RuntimeException "Big Table Retained Mapping duplicate column" (was:

[jira] [Commented] (HIVE-10403) Add n-way join support for Hybrid Grace Hash Join

2015-04-21 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505911#comment-14505911 ] Mostafa Mokhtar commented on HIVE-10403: [~wzheng] Can you please add an RB link?

[jira] [Commented] (HIVE-10410) Apparent race condition in HiveServer2 causing intermittent query failures

2015-04-20 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504025#comment-14504025 ] Mostafa Mokhtar commented on HIVE-10410: [~ekoifman] FYI. > Apparent race conditi

  1   2   >