[jira] [Commented] (HIVE-17196) CM: ReplCopyTask should retain the original file names even if copied from CM path.

2017-09-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162529#comment-16162529 ] Hive QA commented on HIVE-17196: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17496) Bootstrap repl is not cleaning up staging dirs

2017-09-11 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HIVE-17496: -- Status: Patch Available (was: Open) > Bootstrap repl is not cleaning up staging dirs >

[jira] [Updated] (HIVE-17496) Bootstrap repl is not cleaning up staging dirs

2017-09-11 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HIVE-17496: -- Status: Open (was: Patch Available) > Bootstrap repl is not cleaning up staging dirs >

[jira] [Commented] (HIVE-17511) Error while populating orc cache in llap

2017-09-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162507#comment-16162507 ] Ashutosh Chauhan commented on HIVE-17511: - Stack trace: {code} Caused by: java.io.IOException:

[jira] [Commented] (HIVE-17506) Fix standalone-metastore pom.xml to not depend on hive's main pom

2017-09-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162470#comment-16162470 ] Hive QA commented on HIVE-17506: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17495) CachedStore: prewarm improvement (avoid multiple sql calls to read partition column stats), refactoring and caching some aggregate stats

2017-09-11 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162455#comment-16162455 ] Thejas M Nair commented on HIVE-17495: -- [~sershe] The current cache implementation guarantees

[jira] [Updated] (HIVE-17387) implement Tez AM registry in Hive

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17387: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-17495) CachedStore: prewarm improvement (avoid multiple sql calls to read partition column stats), refactoring and caching some aggregate stats

2017-09-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162428#comment-16162428 ] Hive QA commented on HIVE-17495: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17387) implement Tez AM registry in Hive

2017-09-11 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162425#comment-16162425 ] Gunther Hagleitner commented on HIVE-17387: --- +1 > implement Tez AM registry in Hive >

[jira] [Commented] (HIVE-17510) Make comparison of filter predicates in q files deterministic

2017-09-11 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162423#comment-16162423 ] Gopal V commented on HIVE-17510: [~jcamachorodriguez]: I didn't catch the in.test part - Think we've

[jira] [Comment Edited] (HIVE-17510) Make comparison of filter predicates in q files deterministic

2017-09-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162347#comment-16162347 ] Jesus Camacho Rodriguez edited comment on HIVE-17510 at 9/12/17 2:47 AM:

[jira] [Updated] (HIVE-15899) check CTAS over acid table

2017-09-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15899: -- Attachment: HIVE-15899.04.patch > check CTAS over acid table > --- > >

[jira] [Commented] (HIVE-17510) Make comparison of filter predicates in q files deterministic

2017-09-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162347#comment-16162347 ] Jesus Camacho Rodriguez commented on HIVE-17510: [~gopalv], that would make sense:

[jira] [Commented] (HIVE-17488) Move first set of classes to standalone metastore

2017-09-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162343#comment-16162343 ] Hive QA commented on HIVE-17488: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17510) Make comparison of filter predicates in q files deterministic

2017-09-11 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162336#comment-16162336 ] Gopal V commented on HIVE-17510: [~jcamachorodriguez]: I think the Quickstep folks recommended sorting the

[jira] [Updated] (HIVE-17495) CachedStore: prewarm improvement (avoid multiple sql calls to read partition column stats), refactoring and caching some aggregate stats

2017-09-11 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-17495: Summary: CachedStore: prewarm improvement (avoid multiple sql calls to read partition

[jira] [Commented] (HIVE-17496) Bootstrap repl is not cleaning up staging dirs

2017-09-11 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162314#comment-16162314 ] Tao Li commented on HIVE-17496: --- [~daijy] See "HIVE-17496.2.patch" for the added unit test. cc [~thejas] >

[jira] [Updated] (HIVE-17496) Bootstrap repl is not cleaning up staging dirs

2017-09-11 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HIVE-17496: -- Attachment: HIVE-17496.2.patch > Bootstrap repl is not cleaning up staging dirs >

[jira] [Commented] (HIVE-17495) CachedStore: prewarm improvements, refactoring and caching some aggregate stats

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162304#comment-16162304 ] Sergey Shelukhin commented on HIVE-17495: - Separate is ok. Can you change the prewarm to be

[jira] [Commented] (HIVE-17387) implement Tez AM registry in Hive

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162301#comment-16162301 ] Sergey Shelukhin commented on HIVE-17387: - [~hagleitn] ping? > implement Tez AM registry in Hive

[jira] [Comment Edited] (HIVE-17502) Reuse of default session should not throw an exception in LLAP w/ Tez

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162299#comment-16162299 ] Sergey Shelukhin edited comment on HIVE-17502 at 9/12/17 12:45 AM: ---

[jira] [Comment Edited] (HIVE-17502) Reuse of default session should not throw an exception in LLAP w/ Tez

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162299#comment-16162299 ] Sergey Shelukhin edited comment on HIVE-17502 at 9/12/17 12:43 AM: ---

[jira] [Commented] (HIVE-17502) Reuse of default session should not throw an exception in LLAP w/ Tez

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162299#comment-16162299 ] Sergey Shelukhin commented on HIVE-17502: - There may be a bigger problem here. I think the logic

[jira] [Commented] (HIVE-17495) CachedStore: prewarm improvements, refactoring and caching some aggregate stats

2017-09-11 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162296#comment-16162296 ] Vaibhav Gumashta commented on HIVE-17495: - [~sershe] The improvement in prewarm here is to the

[jira] [Updated] (HIVE-17261) Hive use deprecated ParquetInputSplit constructor which blocked parquet dictionary filter

2017-09-11 Thread Junjie Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junjie Chen updated HIVE-17261: --- Attachment: HIVE-17261.8.patch > Hive use deprecated ParquetInputSplit constructor which blocked

[jira] [Commented] (HIVE-17510) Make comparison of filter predicates in q files deterministic

2017-09-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162287#comment-16162287 ] Jesus Camacho Rodriguez commented on HIVE-17510: Expecting quite a 'few' q file changes...

[jira] [Updated] (HIVE-17510) Make comparison of filter predicates in q files deterministic

2017-09-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17510: --- Attachment: HIVE-17510.patch > Make comparison of filter predicates in q

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2017-09-11 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162282#comment-16162282 ] Sahil Takiar commented on HIVE-17486: - Could be a bug in {{CombineEquivalentWorkResolver}}.

[jira] [Updated] (HIVE-17465) Statistics: Drill-down filters don't reduce row-counts progressively

2017-09-11 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17465: --- Status: Patch Available (was: Open) > Statistics: Drill-down filters don't reduce row-counts

[jira] [Updated] (HIVE-17465) Statistics: Drill-down filters don't reduce row-counts progressively

2017-09-11 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17465: --- Status: Open (was: Patch Available) > Statistics: Drill-down filters don't reduce row-counts

[jira] [Updated] (HIVE-17465) Statistics: Drill-down filters don't reduce row-counts progressively

2017-09-11 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17465: --- Attachment: HIVE-17465.2.patch > Statistics: Drill-down filters don't reduce row-counts progressively

[jira] [Updated] (HIVE-17510) Make comparison of filter predicates in q files deterministic

2017-09-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17510: --- Status: Patch Available (was: In Progress) > Make comparison of filter

[jira] [Work started] (HIVE-17510) Make comparison of filter predicates in q files deterministic

2017-09-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-17510 started by Jesus Camacho Rodriguez. -- > Make comparison of filter predicates in q files

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2017-09-11 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162281#comment-16162281 ] Sahil Takiar commented on HIVE-17486: - hmm interesting, I'm curious why

[jira] [Assigned] (HIVE-17510) Make comparison of filter predicates in q files deterministic

2017-09-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez reassigned HIVE-17510: -- > Make comparison of filter predicates in q files deterministic >

[jira] [Commented] (HIVE-13898) don't support add subtract multiply or divide for variable of decimal or double type

2017-09-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162277#comment-16162277 ] Hive QA commented on HIVE-13898: Here are the results of testing the latest attachment:

[jira] [Comment Edited] (HIVE-17495) CachedStore: prewarm improvements, refactoring and caching some aggregate stats

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162268#comment-16162268 ] Sergey Shelukhin edited comment on HIVE-17495 at 9/12/17 12:15 AM: --- Some

[jira] [Commented] (HIVE-17495) CachedStore: prewarm improvements, refactoring and caching some aggregate stats

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162268#comment-16162268 ] Sergey Shelukhin commented on HIVE-17495: - Some minor comments; my main concern - I don't see

[jira] [Commented] (HIVE-17479) Staging directories do not get cleaned up for update/delete queries

2017-09-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162264#comment-16162264 ] Ashutosh Chauhan commented on HIVE-17479: - LGTM. [~ekoifman] Can you please also take a look? >

[jira] [Updated] (HIVE-17472) Drop-partition for multi-level partition fails, if data does not exist.

2017-09-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17472: Attachment: HIVE-17472.3-branch-2.2.patch > Drop-partition for multi-level

[jira] [Updated] (HIVE-17472) Drop-partition for multi-level partition fails, if data does not exist.

2017-09-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17472: Attachment: HIVE-17472.3.patch > Drop-partition for multi-level partition fails, if

[jira] [Commented] (HIVE-17506) Fix standalone-metastore pom.xml to not depend on hive's main pom

2017-09-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162215#comment-16162215 ] Alan Gates commented on HIVE-17506: --- Ok, I can fix that when I'm ready to commit it. > Fix

[jira] [Updated] (HIVE-15212) merge branch into master

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15212: Attachment: HIVE-15212.11.patch Rebasing again; fixing various bugs, incorrect merges and

[jira] [Commented] (HIVE-17138) FileSinkOperator doesn't create empty files for acid path

2017-09-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162213#comment-16162213 ] Eugene Koifman commented on HIVE-17138: --- See also TestTxnNoBuckets.testUnionRemove() {noformat}

[jira] [Commented] (HIVE-17505) hive.optimize.union.remove=true doesn't work with insert into

2017-09-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162207#comment-16162207 ] Eugene Koifman commented on HIVE-17505: --- this may have to do with file merge and move operations not

[jira] [Updated] (HIVE-17472) Drop-partition for multi-level partition fails, if data does not exist.

2017-09-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17472: Attachment: HIVE-17472.3-branch-2.patch > Drop-partition for multi-level partition

[jira] [Updated] (HIVE-17509) CachedStore: investigate and fix bugs related to cache update thread

2017-09-11 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-17509: Description: Concurrency issues reported by [~ashutoshc] in some internal tests. (was:

[jira] [Assigned] (HIVE-17509) CachedStore: investigate and fix bugs related to cache update thread

2017-09-11 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta reassigned HIVE-17509: --- Assignee: Vaibhav Gumashta > CachedStore: investigate and fix bugs related to cache

[jira] [Commented] (HIVE-17430) Add LOAD DATA test for blobstores

2017-09-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162188#comment-16162188 ] Hive QA commented on HIVE-17430: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17506) Fix standalone-metastore pom.xml to not depend on hive's main pom

2017-09-11 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162143#comment-16162143 ] Vihang Karajgaonkar commented on HIVE-17506: Hi [~alangates] took a quick look. The

[jira] [Updated] (HIVE-17196) CM: ReplCopyTask should retain the original file names even if copied from CM path.

2017-09-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-17196: -- Status: Patch Available (was: Open) > CM: ReplCopyTask should retain the original file names even if

[jira] [Updated] (HIVE-17196) CM: ReplCopyTask should retain the original file names even if copied from CM path.

2017-09-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-17196: -- Attachment: HIVE-17196.1.patch > CM: ReplCopyTask should retain the original file names even if copied

[jira] [Updated] (HIVE-17508) Implement pool rules and triggers based on counters

2017-09-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-17508: - Attachment: HIVE-17508.WIP.patch Attaching a WIP patch. This still has to be

[jira] [Updated] (HIVE-17506) Fix standalone-metastore pom.xml to not depend on hive's main pom

2017-09-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17506: -- Status: Patch Available (was: Open) > Fix standalone-metastore pom.xml to not depend on hive's main

[jira] [Updated] (HIVE-17506) Fix standalone-metastore pom.xml to not depend on hive's main pom

2017-09-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17506: -- Attachment: HIVE-17506.patch Attached a patch that builds standalone-metastore as a separate module.

[jira] [Assigned] (HIVE-17508) Implement pool rules and triggers based on counters

2017-09-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-17508: > Implement pool rules and triggers based on counters >

[jira] [Commented] (HIVE-17506) Fix standalone-metastore pom.xml to not depend on hive's main pom

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162108#comment-16162108 ] ASF GitHub Bot commented on HIVE-17506: --- GitHub user alanfgates opened a pull request:

[jira] [Commented] (HIVE-15212) merge branch into master

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162107#comment-16162107 ] Sergey Shelukhin commented on HIVE-15212: - skewjoin test is broken due to some incompatibility

[jira] [Resolved] (HIVE-7292) Hive on Spark

2017-09-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7292. --- Resolution: Done Fix Version/s: 1.1.0 As the feature is already released in Hive and remaining

[jira] [Commented] (HIVE-7292) Hive on Spark

2017-09-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162071#comment-16162071 ] Xuefu Zhang commented on HIVE-7292: --- [~bastrich], thanks for your explanation. In fact, anyone can create

[jira] [Commented] (HIVE-17504) Skip ACID table for replication

2017-09-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162061#comment-16162061 ] Hive QA commented on HIVE-17504: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17495) CachedStore: prewarm improvements, refactoring and caching some aggregate stats

2017-09-11 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162023#comment-16162023 ] Vaibhav Gumashta commented on HIVE-17495: - [~ashutoshc] Done. > CachedStore: prewarm

[jira] [Commented] (HIVE-17495) CachedStore: prewarm improvements, refactoring and caching some aggregate stats

2017-09-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162014#comment-16162014 ] Ashutosh Chauhan commented on HIVE-17495: - Can you please create a RB for this ? > CachedStore:

[jira] [Updated] (HIVE-17495) CachedStore: prewarm improvements, refactoring and caching some aggregate stats

2017-09-11 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-17495: Attachment: HIVE-17495.1.patch > CachedStore: prewarm improvements, refactoring and caching

[jira] [Updated] (HIVE-17495) CachedStore: prewarm improvements, refactoring and caching some aggregate stats

2017-09-11 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-17495: Status: Patch Available (was: Open) > CachedStore: prewarm improvements, refactoring and

[jira] [Commented] (HIVE-17496) Bootstrap repl is not cleaning up staging dirs

2017-09-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161944#comment-16161944 ] Daniel Dai commented on HIVE-17496: --- Sure > Bootstrap repl is not cleaning up staging dirs >

[jira] [Commented] (HIVE-17496) Bootstrap repl is not cleaning up staging dirs

2017-09-11 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161925#comment-16161925 ] Tao Li commented on HIVE-17496: --- [~daijy] I agree that PathUtils should not contain state but should be a

[jira] [Resolved] (HIVE-17280) Data loss in CONCATENATE ORC created by Spark

2017-09-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran resolved HIVE-17280. -- Resolution: Done Fix Version/s: 2.4.0 3.0.0 Fix for

[jira] [Commented] (HIVE-17496) Bootstrap repl is not cleaning up staging dirs

2017-09-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161920#comment-16161920 ] Daniel Dai commented on HIVE-17496: --- Ok, you mean after the "repl load" sql commands finishes, right?

[jira] [Updated] (HIVE-17403) Fail concatenation for unmanaged and transactional tables

2017-09-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-17403: - Fix Version/s: 2.4.0 3.0.0 > Fail concatenation for unmanaged

[jira] [Updated] (HIVE-17403) Fail concatenation for unmanaged and transactional tables

2017-09-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-17403: - Resolution: Fixed Status: Resolved (was: Patch Available) No related

[jira] [Comment Edited] (HIVE-15212) merge branch into master

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161916#comment-16161916 ] Sergey Shelukhin edited comment on HIVE-15212 at 9/11/17 8:20 PM: --

[jira] [Commented] (HIVE-15212) merge branch into master

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161916#comment-16161916 ] Sergey Shelukhin commented on HIVE-15212: - Looking into failures. One is that txn appears to be

[jira] [Assigned] (HIVE-17506) Fix standalone-metastore pom.xml to not depend on hive's main pom

2017-09-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates reassigned HIVE-17506: - > Fix standalone-metastore pom.xml to not depend on hive's main pom >

[jira] [Commented] (HIVE-17403) Fail concatenation for unmanaged and transactional tables

2017-09-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161911#comment-16161911 ] Hive QA commented on HIVE-17403: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17253) Adding SUMMARY statement to HPL/SQL

2017-09-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161871#comment-16161871 ] Alan Gates commented on HIVE-17253: --- +1 for the patch. [~ashutoshc], any thoughts on this since it is

[jira] [Updated] (HIVE-17488) Move first set of classes to standalone metastore

2017-09-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17488: -- Status: Open (was: Patch Available) > Move first set of classes to standalone metastore >

[jira] [Updated] (HIVE-17488) Move first set of classes to standalone metastore

2017-09-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17488: -- Attachment: HIVE-17488.2.patch New version of the patch that fixes the broken TestSchemaTool. > Move

[jira] [Updated] (HIVE-17488) Move first set of classes to standalone metastore

2017-09-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17488: -- Status: Patch Available (was: Open) > Move first set of classes to standalone metastore >

[jira] [Commented] (HIVE-17496) Bootstrap repl is not cleaning up staging dirs

2017-09-11 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161848#comment-16161848 ] Tao Li commented on HIVE-17496: --- [~daijy] The cleanup happens when the SQLOperation is done and the context

[jira] [Commented] (HIVE-17496) Bootstrap repl is not cleaning up staging dirs

2017-09-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161831#comment-16161831 ] Daniel Dai commented on HIVE-17496: --- I see you add staging dirs into the fsScratchDirs, but when Hive

[jira] [Commented] (HIVE-17505) hive.optimize.union.remove=true doesn't work with insert into

2017-09-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161822#comment-16161822 ] Eugene Koifman commented on HIVE-17505: --- The same test on Tez (add the following to TestAcidOnTez)

[jira] [Commented] (HIVE-17479) Staging directories do not get cleaned up for update/delete queries

2017-09-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161809#comment-16161809 ] Jesus Camacho Rodriguez commented on HIVE-17479: [~ashutoshc], could you take a look?

[jira] [Commented] (HIVE-16979) Cache UGI for metastore

2017-09-11 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161807#comment-16161807 ] Tao Li commented on HIVE-16979: --- [~gopalv] Thanks for your previous comments. Regarding the liveness issue

[jira] [Updated] (HIVE-17459) View deletion operation failed to replicate on target cluster

2017-09-11 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-17459: - Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to master.

[jira] [Updated] (HIVE-17459) View deletion operation failed to replicate on target cluster

2017-09-11 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-17459: - Fix Version/s: 3.0.0 > View deletion operation failed to replicate on target cluster >

[jira] [Updated] (HIVE-17505) hive.optimize.union.remove=true doesn't work with insert into

2017-09-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17505: -- Description: add this to TestTxnNoBuckets (not related to Acid - just a repro) {noformat}

[jira] [Updated] (HIVE-13898) don't support add subtract multiply or divide for variable of decimal or double type

2017-09-11 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Tolpeko updated HIVE-13898: -- Affects Version/s: (was: 2.0.1) Status: Patch Available (was: Open) > don't

[jira] [Commented] (HIVE-13898) don't support add subtract multiply or divide for variable of decimal or double type

2017-09-11 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161794#comment-16161794 ] Dmitry Tolpeko commented on HIVE-13898: --- Addition and subtraction are patched by HIVE-17031. >

[jira] [Commented] (HIVE-17430) Add LOAD DATA test for blobstores

2017-09-11 Thread Yuzhou Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161792#comment-16161792 ] Yuzhou Sun commented on HIVE-17430: --- Thanks [~spena] ! Submitted the patch. > Add LOAD DATA test for

[jira] [Updated] (HIVE-13898) don't support add subtract multiply or divide for variable of decimal or double type

2017-09-11 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Tolpeko updated HIVE-13898: -- Attachment: HIVE-13898.1.patch Added tests and refactored code. > don't support add subtract

[jira] [Commented] (HIVE-17459) View deletion operation failed to replicate on target cluster

2017-09-11 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161790#comment-16161790 ] Tao Li commented on HIVE-17459: --- [~thejas] We should be able to get this in now. Thanks. > View deletion

[jira] [Commented] (HIVE-17230) Timestamp format different in HiveCLI and Beeline

2017-09-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161784#comment-16161784 ] Hive QA commented on HIVE-17230: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17430) Add LOAD DATA test for blobstores

2017-09-11 Thread Yuzhou Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuzhou Sun updated HIVE-17430: -- Status: Patch Available (was: Open) > Add LOAD DATA test for blobstores >

[jira] [Commented] (HIVE-17403) Fail concatenation for unmanaged and transactional tables

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161776#comment-16161776 ] Sergey Shelukhin commented on HIVE-17403: - Still +1... > Fail concatenation for unmanaged and

[jira] [Commented] (HIVE-17226) Use strong hashing as security improvement

2017-09-11 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161766#comment-16161766 ] Tao Li commented on HIVE-17226: --- [~thejas] That makes sense. Will do. Thanks! > Use strong hashing as

[jira] [Updated] (HIVE-17504) Skip ACID table for replication

2017-09-11 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HIVE-17504: -- Status: Patch Available (was: Open) > Skip ACID table for replication > --- > >

[jira] [Updated] (HIVE-17214) check/fix conversion of unbucketed non-acid to acid

2017-09-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17214: -- Summary: check/fix conversion of unbucketed non-acid to acid (was: check/fix conversion of

[jira] [Commented] (HIVE-17214) check/fix conversion of non-acid to acid

2017-09-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161762#comment-16161762 ] Eugene Koifman commented on HIVE-17214: --- HIVE-17505 has way to produce "non-standard" layout that

[jira] [Commented] (HIVE-17482) External LLAP client: acquire locks for tables queried directly by LLAP

2017-09-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161759#comment-16161759 ] Sergey Shelukhin commented on HIVE-17482: - {noformat} HiveTxnManager txnManager =

  1   2   >