[jira] [Commented] (HIVE-18361) Extend shared work optimizer to reuse computation beyond work boundaries

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309260#comment-16309260 ] Hive QA commented on HIVE-18361: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HIVE-17896) TopNKey: Create a standalone vectorizable TopNKey operator

2018-01-02 Thread Teddy Choi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teddy Choi updated HIVE-17896: -- Attachment: HIVE-17896.5.patch This fifth patch fixed TestDanglingQOuts failure. I also tested

[jira] [Commented] (HIVE-17929) Use sessionId for HoS Remote Driver Client id

2018-01-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309247#comment-16309247 ] Rui Li commented on HIVE-17929: --- +1 > Use sessionId for HoS Remote Driver Client id >

[jira] [Commented] (HIVE-18360) NPE in TezSessionState

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309243#comment-16309243 ] Hive QA commented on HIVE-18360: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18360) NPE in TezSessionState

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309209#comment-16309209 ] Hive QA commented on HIVE-18360: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309200#comment-16309200 ] Hive QA commented on HIVE-17486: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309171#comment-16309171 ] Hive QA commented on HIVE-17486: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18221) test acid default

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309163#comment-16309163 ] Hive QA commented on HIVE-18221: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18079) Statistics: Allow HyperLogLog to be merged to the lowest-common-denominator bit-size

2018-01-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309158#comment-16309158 ] Gopal V commented on HIVE-18079: With a clean run, will disable CBO rotating that join to make the tez

[jira] [Updated] (HIVE-18079) Statistics: Allow HyperLogLog to be merged to the lowest-common-denominator bit-size

2018-01-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-18079: --- Attachment: HIVE-18079.5.patch Rebase + explain one change to a test. {code} 2018-01-02T20:25:52,726 DEBUG

[jira] [Updated] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18190: -- Attachment: HIVE-18190.07.patch > Consider looking at ORC file schema rather than using

[jira] [Commented] (HIVE-18221) test acid default

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309135#comment-16309135 ] Hive QA commented on HIVE-18221: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18052) Run p-tests on mm tables

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309132#comment-16309132 ] Hive QA commented on HIVE-18052: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309131#comment-16309131 ] Hive QA commented on HIVE-18190: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18052) Run p-tests on mm tables

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309130#comment-16309130 ] Hive QA commented on HIVE-18052: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18361) Extend shared work optimizer to reuse computation beyond work boundaries

2018-01-02 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-18361: --- Attachment: HIVE-18361.patch > Extend shared work optimizer to reuse

[jira] [Updated] (HIVE-18361) Extend shared work optimizer to reuse computation beyond work boundaries

2018-01-02 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-18361: --- Status: Patch Available (was: In Progress) > Extend shared work optimizer to

[jira] [Work started] (HIVE-18361) Extend shared work optimizer to reuse computation beyond work boundaries

2018-01-02 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-18361 started by Jesus Camacho Rodriguez. -- > Extend shared work optimizer to reuse computation beyond

[jira] [Assigned] (HIVE-18361) Extend shared work optimizer to reuse computation beyond work boundaries

2018-01-02 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez reassigned HIVE-18361: -- > Extend shared work optimizer to reuse computation beyond work boundaries

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309089#comment-16309089 ] Hive QA commented on HIVE-17396: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18360) NPE in TezSessionState

2018-01-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18360: Attachment: HIVE-18360.patch A tiny patch. [~prasanth_j] [~jdere] can you take a look? >

[jira] [Updated] (HIVE-18360) NPE in TezSessionState

2018-01-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18360: Status: Patch Available (was: Open) > NPE in TezSessionState > -- > >

[jira] [Assigned] (HIVE-18360) NPE in TezSessionState

2018-01-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-18360: --- > NPE in TezSessionState > -- > > Key: HIVE-18360 >

[jira] [Updated] (HIVE-18269) LLAP: Fast llap io with slow processing pipeline can lead to OOM

2018-01-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18269: Attachment: HIVE-18269.01.patch The patch. I have also attached a patch that I've tested on

[jira] [Updated] (HIVE-18269) LLAP: Fast llap io with slow processing pipeline can lead to OOM

2018-01-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18269: Attachment: HIVE-18269.bad.patch > LLAP: Fast llap io with slow processing pipeline can

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309041#comment-16309041 ] Hive QA commented on HIVE-17396: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18214) Flaky test: TestSparkClient

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309017#comment-16309017 ] Hive QA commented on HIVE-18214: Here are the results of testing the latest attachment:

[jira] [Issue Comment Deleted] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2018-01-02 Thread liyunzhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang updated HIVE-17486: -- Comment: was deleted (was: [~stakiar]: the original purpose to change M->R to M->M->R is to let

[jira] [Updated] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2018-01-02 Thread liyunzhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang updated HIVE-17486: -- Attachment: HIVE-17486.5.patch > Enable SharedWorkOptimizer in tez on HOS >

[jira] [Comment Edited] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2018-01-02 Thread liyunzhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308995#comment-16308995 ] liyunzhang edited comment on HIVE-17486 at 1/3/18 1:40 AM: --- [~stakiar]: the

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2018-01-02 Thread liyunzhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308994#comment-16308994 ] liyunzhang commented on HIVE-17486: --- [~stakiar]: the original purpose to change M->R to M->M->R is to

[jira] [Updated] (HIVE-18221) test acid default

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.20.patch > test acid default > - > >

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2018-01-02 Thread liyunzhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308995#comment-16308995 ] liyunzhang commented on HIVE-17486: --- [~stakiar]: the original purpose to change M->R to M->M->R is to

[jira] [Updated] (HIVE-18052) Run p-tests on mm tables

2018-01-02 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Yeom updated HIVE-18052: -- Attachment: HIVE-18052.13.patch > Run p-tests on mm tables > > >

[jira] [Updated] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18190: -- Attachment: HIVE-18190.06.patch > Consider looking at ORC file schema rather than using

[jira] [Commented] (HIVE-18214) Flaky test: TestSparkClient

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308944#comment-16308944 ] Hive QA commented on HIVE-18214: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18221) test acid default

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308934#comment-16308934 ] Hive QA commented on HIVE-18221: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308932#comment-16308932 ] Hive QA commented on HIVE-18190: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-18358) from_unixtime returns wrong year for Dec 31 timestamps with format 'YYYY'

2018-01-02 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Sherman reassigned HIVE-18358: - Assignee: Andrew Sherman > from_unixtime returns wrong year for Dec 31 timestamps with

[jira] [Updated] (HIVE-17482) External LLAP client: acquire locks for tables queried directly by LLAP

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17482: -- Component/s: Transactions > External LLAP client: acquire locks for tables queried directly by

[jira] [Commented] (HIVE-18358) from_unixtime returns wrong year for Dec 31 timestamps with format 'YYYY'

2018-01-02 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308920#comment-16308920 ] Andrew Sherman commented on HIVE-18358: --- The code that deals with is just

[jira] [Commented] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308892#comment-16308892 ] Hive QA commented on HIVE-18190: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308886#comment-16308886 ] Hive QA commented on HIVE-18326: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-18359) Extend grouping set limits from int to long

2018-01-02 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-18359: > Extend grouping set limits from int to long >

[jira] [Updated] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-02 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17396: --- Attachment: HIVE-17396.2.patch Fix issues reported by Hive QA. > Support DPP with map joins

[jira] [Commented] (HIVE-18255) spark-client jar should be prefixed with hive-

2018-01-02 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308847#comment-16308847 ] Sahil Takiar commented on HIVE-18255: - Test failures look un-related. > spark-client jar should be

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-02 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308835#comment-16308835 ] Sahil Takiar commented on HIVE-16484: - Attaching updated patch. Basically, just rebased the old patch

[jira] [Updated] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-02 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-16484: Attachment: HIVE-16484.8.patch > Investigate SparkLauncher for HoS as alternative to

[jira] [Commented] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308820#comment-16308820 ] Hive QA commented on HIVE-18326: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18255) spark-client jar should be prefixed with hive-

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308805#comment-16308805 ] Hive QA commented on HIVE-18255: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18255) spark-client jar should be prefixed with hive-

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308732#comment-16308732 ] Hive QA commented on HIVE-18255: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18238) Driver execution may not have configuration changing sideeffects

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308707#comment-16308707 ] Hive QA commented on HIVE-18238: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18214) Flaky test: TestSparkClient

2018-01-02 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18214: Status: Patch Available (was: Open) > Flaky test: TestSparkClient > --- >

[jira] [Updated] (HIVE-18214) Flaky test: TestSparkClient

2018-01-02 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18214: Attachment: HIVE-18214.1.patch > Flaky test: TestSparkClient > --- > >

[jira] [Updated] (HIVE-18221) test acid default

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.19.patch > test acid default > - > >

[jira] [Commented] (HIVE-18238) Driver execution may not have configuration changing sideeffects

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308653#comment-16308653 ] Hive QA commented on HIVE-18238: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18336) add Safe Mode

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308654#comment-16308654 ] Eugene Koifman commented on HIVE-18336: --- It would be useful to add optional validation to acid

[jira] [Commented] (HIVE-18356) Fixing license headers in checkstyle

2018-01-02 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308631#comment-16308631 ] Andrew Sherman commented on HIVE-18356: --- +1 LGTM. Thanks for doing this [~pvary] > Fixing license

[jira] [Assigned] (HIVE-17952) Fix license headers to avoid dangling javadoc warnings

2018-01-02 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Sherman reassigned HIVE-17952: - Assignee: Andrew Sherman > Fix license headers to avoid dangling javadoc warnings >

[jira] [Commented] (HIVE-18096) add a user-friendly show plan command

2018-01-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308626#comment-16308626 ] Sergey Shelukhin commented on HIVE-18096: - [~harishjp] ping? > add a user-friendly show plan

[jira] [Commented] (HIVE-18273) add LLAP-level counters for WM

2018-01-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308622#comment-16308622 ] Sergey Shelukhin commented on HIVE-18273: - Test failures appear to be the same as in other JIRAs.

[jira] [Updated] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18190: -- Attachment: HIVE-18190.05.patch > Consider looking at ORC file schema rather than using

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308614#comment-16308614 ] Hive QA commented on HIVE-17396: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16826) Improvements for SeparatedValuesOutputFormat

2018-01-02 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308594#comment-16308594 ] Aihua Xu commented on HIVE-16826: - [~belugabehr] That's great. +1. > Improvements for

[jira] [Updated] (HIVE-18269) LLAP: Fast llap io with slow processing pipeline can lead to OOM

2018-01-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18269: Status: Open (was: Patch Available) > LLAP: Fast llap io with slow processing pipeline can

[jira] [Updated] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

2018-01-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18326: Attachment: HIVE-18326.02.patch Same patch. > LLAP Tez scheduler - only preempt tasks if

[jira] [Commented] (HIVE-15393) Update Guava version

2018-01-02 Thread slim bouguerra (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308573#comment-16308573 ] slim bouguerra commented on HIVE-15393: --- [~kgyrtkirk] Thanks this was working on my laptop and did

[jira] [Commented] (HIVE-15393) Update Guava version

2018-01-02 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308552#comment-16308552 ] Zoltan Haindrich commented on HIVE-15393: - [~bslim] it seems to me that

[jira] [Commented] (HIVE-17486) Enable SharedWorkOptimizer in tez on HOS

2018-01-02 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308547#comment-16308547 ] Sahil Takiar commented on HIVE-17486: - [~kellyzly] {quote} what i want to ask is there any possiblity

[jira] [Commented] (HIVE-16826) Improvements for SeparatedValuesOutputFormat

2018-01-02 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308537#comment-16308537 ] BELUGA BEHR commented on HIVE-16826: [~aihuaxu] I certainly tried to keep it the same...

[jira] [Commented] (HIVE-18344) Remove LinkedList from SharedWorkOptimizer.java

2018-01-02 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308539#comment-16308539 ] BELUGA BEHR commented on HIVE-18344: [~pvary] :) > Remove LinkedList from SharedWorkOptimizer.java >

[jira] [Commented] (HIVE-18348) Hive creates 4 different connection pools to metastore of different size

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308532#comment-16308532 ] Eugene Koifman commented on HIVE-18348: --- It does require 2 pools. connPoolMutex is used to manage

[jira] [Commented] (HIVE-18348) Hive creates 4 different connection pools to metastore of different size

2018-01-02 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308525#comment-16308525 ] Prasanth Jayachandran commented on HIVE-18348: -- [~ekoifman] Does it require 2 separate pools

[jira] [Commented] (HIVE-18356) Fixing license headers in checkstyle

2018-01-02 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308526#comment-16308526 ] Prasanth Jayachandran commented on HIVE-18356: -- +1 > Fixing license headers in checkstyle >

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308519#comment-16308519 ] Hive QA commented on HIVE-17396: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308515#comment-16308515 ] Marcelo Vanzin commented on HIVE-16484: --- That's correct. Using it only with deploy mode == cluster

[jira] [Commented] (HIVE-18348) Hive creates 4 different connection pools to metastore of different size

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308513#comment-16308513 ] Eugene Koifman commented on HIVE-18348: --- TxnHandler needs to use 2 pools otherwise it can deadlock.

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-02 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308510#comment-16308510 ] Sahil Takiar commented on HIVE-16484: - Thanks [~vanzin]. I think I was confused about Spark's

[jira] [Updated] (HIVE-18353) CompactorMR should call jobclient.close() to trigger cleanup

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18353: -- Component/s: Transactions > CompactorMR should call jobclient.close() to trigger cleanup >

[jira] [Commented] (HIVE-18354) Fix test TestAcidOnTez

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308504#comment-16308504 ] Eugene Koifman commented on HIVE-18354: --- it's not clear why stats would cause any changes but the

[jira] [Commented] (HIVE-13000) Hive returns useless parsing error

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308476#comment-16308476 ] Eugene Koifman commented on HIVE-13000: --- There need to be a patch attached that passes the tests.

[jira] [Commented] (HIVE-16826) Improvements for SeparatedValuesOutputFormat

2018-01-02 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308492#comment-16308492 ] Aihua Xu commented on HIVE-16826: - [~belugabehr] Your change is much cleaner. I'm wondering if we have

[jira] [Commented] (HIVE-18354) Fix test TestAcidOnTez

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308484#comment-16308484 ] Hive QA commented on HIVE-18354: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308460#comment-16308460 ] Marcelo Vanzin commented on HIVE-16484: --- {{InProcessLauncher}} works for client mode, but I wouldn't

[jira] [Updated] (HIVE-18294) add switch to make acid table the default

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18294: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-18354) Fix test TestAcidOnTez

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308417#comment-16308417 ] Hive QA commented on HIVE-18354: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HIVE-18255) spark-client jar should be prefixed with hive-

2018-01-02 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18255: Attachment: HIVE-18255.3.patch > spark-client jar should be prefixed with hive- >

[jira] [Updated] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-02 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-16484: Status: Open (was: Patch Available) > Investigate SparkLauncher for HoS as alternative to

[jira] [Updated] (HIVE-18238) Driver execution may not have configuration changing sideeffects

2018-01-02 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18238: Attachment: HIVE-18238.02.patch #2) set {{hive.query.id}} and {{hive.query.string}} at the

[jira] [Commented] (HIVE-18255) spark-client jar should be prefixed with hive-

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308398#comment-16308398 ] Hive QA commented on HIVE-18255: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308400#comment-16308400 ] Hive QA commented on HIVE-16484: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17896) TopNKey: Create a standalone vectorizable TopNKey operator

2018-01-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308397#comment-16308397 ] Hive QA commented on HIVE-17896: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-02 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17396: --- Attachment: HIVE-17396.1.patch > Support DPP with map joins where the source and target

[jira] [Updated] (HIVE-18354) Fix test TestAcidOnTez

2018-01-02 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18354: Status: Patch Available (was: Open) > Fix test TestAcidOnTez > --- >

[jira] [Commented] (HIVE-18354) Fix test TestAcidOnTez

2018-01-02 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308379#comment-16308379 ] Zoltan Haindrich commented on HIVE-18354: - [~ekoifman] could you please take a look? > Fix test

[jira] [Updated] (HIVE-18354) Fix test TestAcidOnTez

2018-01-02 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18354: Description: stats autogather is disabled in this test; because it caused some troubles

[jira] [Updated] (HIVE-18354) Fix test TestAcidOnTez

2018-01-02 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18354: Attachment: HIVE-18354.01.patch #1) remove disabling of autogather; update results in test

[jira] [Commented] (HIVE-18311) Enable smb_mapjoin_8.q for cli driver

2018-01-02 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308358#comment-16308358 ] Sahil Takiar commented on HIVE-18311: - +1 > Enable smb_mapjoin_8.q for cli driver >

[jira] [Updated] (HIVE-18149) Stats: rownum estimation from datasize underestimates in most cases

2018-01-02 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18149: Labels: (was: TODOC3.0) Thank you [~leftylev], I've updated the docs. > Stats: rownum

[jira] [Commented] (HIVE-18149) Stats: rownum estimation from datasize underestimates in most cases

2018-01-02 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308351#comment-16308351 ] Zoltan Haindrich commented on HIVE-18149: - I've added some addendums...I've missed TestAcidOnTez -

  1   2   >