[jira] [Created] (HIVE-17927) Pre-Warm Spark Driver

2017-10-27 Thread Sahil Takiar (JIRA) 
Sahil Takiar created HIVE-17927:
---

 Summary: Pre-Warm Spark Driver
 Key: HIVE-17927
 URL: https://issues.apache.org/jira/browse/HIVE-17927
 Project: Hive
  Issue Type: Improvement
  Components: Spark
Reporter: Sahil Takiar


Hive-on-Spark has an option to pre-warm executors, it would be good to have an 
option to pre-warm the HoS driver.

Basically, submit the HoS application as soon as possible, rather than waiting 
until a query is ready to be submitted. This can help startup time for the 
first query run in a HoS session. The application can be setup in the 
background while queries are being compiled.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Re: Review Request 63343: HIVE-17766

2017-10-27 Thread Jesús Camacho Rodríguez 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63343/
---

(Updated Oct. 28, 2017, 12:16 a.m.)


Review request for hive, Ashutosh Chauhan and Vineet Garg.


Bugs: HIVE-17766
https://issues.apache.org/jira/browse/HIVE-17766


Repository: hive-git


Description
---

HIVE-17766


Diffs (updated)
-

  itests/src/test/resources/testconfiguration.properties 
a4648beae1ec18c88bab35ae3e7f9d9f202e40e5 
  ql/src/java/org/apache/hadoop/hive/ql/exec/CommonJoinOperator.java 
3573d07e9a3bab4dabdc0b73292bd02ad05cbc89 
  ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 
46493ac006d00f2e6c0054da2438c0b01c1e3fd3 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 
5ccb69ac4824a2002b2bddb1ad206cb7acd3ace3 
  ql/src/test/queries/clientpositive/semijoin6.q PRE-CREATION 
  ql/src/test/results/clientpositive/llap/semijoin6.q.out PRE-CREATION 


Diff: https://reviews.apache.org/r/63343/diff/4/

Changes: https://reviews.apache.org/r/63343/diff/3-4/


Testing
---


Thanks,

Jesús Camacho Rodríguez

Review Request 63382: HIVE-17833: Publish split generation counters

2017-10-27 Thread j . prasanth . j 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63382/
---

Review request for hive and Sergey Shelukhin.


Bugs: HIVE-17833
https://issues.apache.org/jira/browse/HIVE-17833


Repository: hive-git


Description
---

HIVE-17833: Publish split generation counters


Diffs
-

  
itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestTriggersTezSessionPoolManager.java
 c227a63e892fdc04c240b08aa0a8085b2072c814 
  itests/src/test/resources/testconfiguration.properties 
a7315a86940919ada980f3666b87c993bafa2c47 
  pom.xml 006e8f8611f4f866ef0e55a61930b6165263b677 
  ql/src/java/org/apache/hadoop/hive/ql/exec/ReduceSinkOperator.java 
92741ee62ced7d54ab94f5fdf15000147150e765 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 
5214688d24e1ac5fd672f8ff55c95382c39da5bb 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTask.java 
2ee8c9359dcf001dbc8441892994f227520862a5 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/HiveInputCounters.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/HiveSplitGenerator.java 
5dd5e80214e0737c61eb347f304756b97d565c94 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/monitoring/TezJobMonitor.java 
5192bd777e31b70acd891ff28b3906d3f3507114 
  ql/src/java/org/apache/hadoop/hive/ql/hooks/PostExecTezSummaryPrinter.java 
45bd6e03d19f2ce4e9c5978688b58301bf91c4f9 
  ql/src/test/queries/clientpositive/tez_input_counters.q PRE-CREATION 
  ql/src/test/results/clientpositive/llap/tez_input_counters.q.out PRE-CREATION 


Diff: https://reviews.apache.org/r/63382/diff/1/


Testing
---


Thanks,

Prasanth_J

Review Request 63381: HIVE-17926: Support triggers for non-pool sessions

2017-10-27 Thread j . prasanth . j 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63381/
---

Review request for hive and Sergey Shelukhin.


Bugs: HIVE-17926
https://issues.apache.org/jira/browse/HIVE-17926


Repository: hive-git


Description
---

HIVE-17926: Support triggers for non-pool sessions


Diffs
-

  
itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestTriggersNoTezSessionPool.java
 PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
b67c933b192c445ef6084d30b6398444d510d953 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
9b4714f1d79d0016e2460386cc38b3f2a162ae0b 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezTask.java 
a1b7cfb15803074e2b19236da03790a189f17ff2 


Diff: https://reviews.apache.org/r/63381/diff/1/


Testing
---


Thanks,

Prasanth_J

Re: Review Request 63230: HIVE-17841 implement applying the resource plan

2017-10-27 Thread j . prasanth . j 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63230/#review189491
---


Ship it!




Ship It!

- Prasanth_J


On Oct. 27, 2017, 10:10 p.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63230/
> ---
> 
> (Updated Oct. 27, 2017, 10:10 p.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 892ebfa166 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AmPluginNode.java 35d380c92b 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/GuaranteedTasksAllocator.java 
> d978a25b14 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/LlapPluginEndpointClientImpl.java
>  45c3e38dcc 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/QueryAllocationManager.java 
> a326db3ab0 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/SessionExpirationTracker.java 
> da93a3a791 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> b67c933b19 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 9b4714f1d7 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> 613522357e 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 144816862d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/UserPoolMapping.java 
> 81d6b859a6 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java 00501eef93 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> d725e90475 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/LlapClusterStateForCompile.java
>  209cf57a6a 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> 59efd43be6 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 258a865fef 
> 
> 
> Diff: https://reviews.apache.org/r/63230/diff/4/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Re: Review Request 63230: HIVE-17841 implement applying the resource plan

2017-10-27 Thread Sergey Shelukhin 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63230/
---

(Updated Oct. 27, 2017, 10:10 p.m.)


Review request for hive and Prasanth_J.


Repository: hive-git


Description
---

see jira


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 892ebfa166 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AmPluginNode.java 35d380c92b 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/GuaranteedTasksAllocator.java 
d978a25b14 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/tez/LlapPluginEndpointClientImpl.java
 45c3e38dcc 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/QueryAllocationManager.java 
a326db3ab0 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/SessionExpirationTracker.java 
da93a3a791 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java b67c933b19 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
9b4714f1d7 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
613522357e 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
144816862d 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/UserPoolMapping.java 
81d6b859a6 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java 00501eef93 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
d725e90475 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/LlapClusterStateForCompile.java
 209cf57a6a 
  ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
59efd43be6 
  ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
258a865fef 


Diff: https://reviews.apache.org/r/63230/diff/4/

Changes: https://reviews.apache.org/r/63230/diff/3-4/


Testing
---


Thanks,

Sergey Shelukhin

[jira] [Created] (HIVE-17926) Support triggers for non-pool sessions

2017-10-27 Thread Prasanth Jayachandran (JIRA) 
Prasanth Jayachandran created HIVE-17926:


 Summary: Support triggers for non-pool sessions
 Key: HIVE-17926
 URL: https://issues.apache.org/jira/browse/HIVE-17926
 Project: Hive
  Issue Type: Sub-task
Affects Versions: 3.0.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran


Current trigger implementation works only with tez session pools. In case when 
tez sessions pools are not used, a new session gets created for every query in 
which case trigger validation does not happen. It will be good to support such 
one-off session case as well.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Re: Review Request 63230: HIVE-17841 implement applying the resource plan

2017-10-27 Thread Sergey Shelukhin 


> On Oct. 27, 2017, 6:24 p.m., Prasanth_J wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java
> > Lines 1306 (patched)
> > 
> >
> > nit: do we know the reason why? may be print some user info from 
> > EventState (if rpName has changed/added or version changed). So its clear 
> > to the user that admin did something to RP that triggered the kill.

Updated. Some of the errors will need to be propagated when killquery usage is 
added in the followup jira


- Sergey


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63230/#review189450
---


On Oct. 27, 2017, 2:43 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63230/
> ---
> 
> (Updated Oct. 27, 2017, 2:43 a.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 892ebfa166 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AmPluginNode.java 35d380c92b 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/GuaranteedTasksAllocator.java 
> d978a25b14 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/LlapPluginEndpointClientImpl.java
>  45c3e38dcc 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/QueryAllocationManager.java 
> a326db3ab0 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/SessionExpirationTracker.java 
> da93a3a791 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> b67c933b19 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 9b4714f1d7 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> 613522357e 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 144816862d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/UserPoolMapping.java 
> 81d6b859a6 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java 00501eef93 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> d725e90475 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/LlapClusterStateForCompile.java
>  209cf57a6a 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> 59efd43be6 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 258a865fef 
> 
> 
> Diff: https://reviews.apache.org/r/63230/diff/3/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Re: Review Request 63346: HIVE-17902 add a notions of default pool and unmanaged mapping

2017-10-27 Thread j . prasanth . j 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63346/#review189486
---


Ship it!




Ship It!

- Prasanth_J


On Oct. 27, 2017, 9:25 p.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63346/
> ---
> 
> (Updated Oct. 27, 2017, 9:25 p.m.)
> 
> 
> Review request for hive, Harish Jaiprakash and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   metastore/scripts/upgrade/derby/046-HIVE-17566.derby.sql 16190dc0a1 
>   metastore/scripts/upgrade/derby/hive-schema-3.0.0.derby.sql 4c35380af4 
>   metastore/scripts/upgrade/hive/hive-schema-3.0.0.hive.sql ca7af06e7a 
>   metastore/scripts/upgrade/mssql/031-HIVE-17566.mssql.sql 0ee0f758f1 
>   metastore/scripts/upgrade/mssql/hive-schema-3.0.0.mssql.sql 86f3e5c4a9 
>   metastore/scripts/upgrade/mysql/046-HIVE-17566.mysql.sql 1affa7a119 
>   metastore/scripts/upgrade/mysql/hive-schema-3.0.0.mysql.sql 2453bb92c6 
>   metastore/scripts/upgrade/oracle/046-HIVE-17566.oracle.sql 0ee0f758f1 
>   metastore/scripts/upgrade/oracle/hive-schema-3.0.0.oracle.sql 47bfc5ae08 
>   metastore/scripts/upgrade/postgres/045-HIVE-17566.postgres.sql aa27a6486b 
>   metastore/scripts/upgrade/postgres/hive-schema-3.0.0.postgres.sql 
> 5c770e2659 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 87f6e1d64e 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/UserPoolMapping.java 
> 81d6b859a6 
>   
> ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/JsonMetaDataFormatter.java
>  f1258bab17 
>   
> ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java
>  9df1b82d62 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 
> dc29b122c9 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g 99ed71a5fa 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g 053393ce51 
>   ql/src/java/org/apache/hadoop/hive/ql/plan/AlterResourcePlanDesc.java 
> f0658a665e 
>   ql/src/test/queries/clientpositive/resourceplan.q 586491dc91 
>   ql/src/test/results/clientpositive/llap/resourceplan.q.out 2231bb566d 
>   
> standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java
>  3deef0ee96 
>   
> standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/model/MWMResourcePlan.java
>  3ff924fe00 
>   standalone-metastore/src/main/resources/package.jdo 296e273ec8 
>   standalone-metastore/src/main/thrift/hive_metastore.thrift 1d455463a6 
> 
> 
> Diff: https://reviews.apache.org/r/63346/diff/2/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Re: Review Request 63346: HIVE-17902 add a notions of default pool and unmanaged mapping

2017-10-27 Thread Sergey Shelukhin 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63346/
---

(Updated Oct. 27, 2017, 9:25 p.m.)


Review request for hive, Harish Jaiprakash and Prasanth_J.


Repository: hive-git


Description
---

see jira


Diffs (updated)
-

  metastore/scripts/upgrade/derby/046-HIVE-17566.derby.sql 16190dc0a1 
  metastore/scripts/upgrade/derby/hive-schema-3.0.0.derby.sql 4c35380af4 
  metastore/scripts/upgrade/hive/hive-schema-3.0.0.hive.sql ca7af06e7a 
  metastore/scripts/upgrade/mssql/031-HIVE-17566.mssql.sql 0ee0f758f1 
  metastore/scripts/upgrade/mssql/hive-schema-3.0.0.mssql.sql 86f3e5c4a9 
  metastore/scripts/upgrade/mysql/046-HIVE-17566.mysql.sql 1affa7a119 
  metastore/scripts/upgrade/mysql/hive-schema-3.0.0.mysql.sql 2453bb92c6 
  metastore/scripts/upgrade/oracle/046-HIVE-17566.oracle.sql 0ee0f758f1 
  metastore/scripts/upgrade/oracle/hive-schema-3.0.0.oracle.sql 47bfc5ae08 
  metastore/scripts/upgrade/postgres/045-HIVE-17566.postgres.sql aa27a6486b 
  metastore/scripts/upgrade/postgres/hive-schema-3.0.0.postgres.sql 5c770e2659 
  ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 87f6e1d64e 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/UserPoolMapping.java 
81d6b859a6 
  
ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/JsonMetaDataFormatter.java
 f1258bab17 
  
ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java
 9df1b82d62 
  ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 
dc29b122c9 
  ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g 99ed71a5fa 
  ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g 053393ce51 
  ql/src/java/org/apache/hadoop/hive/ql/plan/AlterResourcePlanDesc.java 
f0658a665e 
  ql/src/test/queries/clientpositive/resourceplan.q 586491dc91 
  ql/src/test/results/clientpositive/llap/resourceplan.q.out 2231bb566d 
  
standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java
 3deef0ee96 
  
standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/model/MWMResourcePlan.java
 3ff924fe00 
  standalone-metastore/src/main/resources/package.jdo 296e273ec8 
  standalone-metastore/src/main/thrift/hive_metastore.thrift 1d455463a6 


Diff: https://reviews.apache.org/r/63346/diff/2/

Changes: https://reviews.apache.org/r/63346/diff/1-2/


Testing
---


Thanks,

Sergey Shelukhin

Re: Review Request 63346: HIVE-17902 add a notions of default pool and unmanaged mapping

2017-10-27 Thread Sergey Shelukhin 


> On Oct. 27, 2017, 1:10 a.m., Prasanth_J wrote:
> > metastore/scripts/upgrade/mssql/031-HIVE-17566.mssql.sql
> > Lines 7 (patched)
> > 
> >
> > is this NON NULL by default?

I think it's null by default, based on other tables/cols in mssql schema


> On Oct. 27, 2017, 1:10 a.m., Prasanth_J wrote:
> > metastore/scripts/upgrade/mssql/031-HIVE-17566.mssql.sql
> > Line 66 (original), 67 (patched)
> > 
> >
> > if this is NULL, will it use DEFAULT_POOL_ID?

No, it means unmanaged pool. Default pool is if the mapping doesn't exist; we 
want the default if nothing is set up to be WM/LLAP


- Sergey


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63346/#review189384
---


On Oct. 27, 2017, 12:48 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63346/
> ---
> 
> (Updated Oct. 27, 2017, 12:48 a.m.)
> 
> 
> Review request for hive, Harish Jaiprakash and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   metastore/scripts/upgrade/derby/046-HIVE-17566.derby.sql 16190dc0a1 
>   metastore/scripts/upgrade/derby/hive-schema-3.0.0.derby.sql 4c35380af4 
>   metastore/scripts/upgrade/hive/hive-schema-3.0.0.hive.sql ca7af06e7a 
>   metastore/scripts/upgrade/mssql/031-HIVE-17566.mssql.sql 0ee0f758f1 
>   metastore/scripts/upgrade/mssql/hive-schema-3.0.0.mssql.sql 86f3e5c4a9 
>   metastore/scripts/upgrade/mysql/046-HIVE-17566.mysql.sql 1affa7a119 
>   metastore/scripts/upgrade/mysql/hive-schema-3.0.0.mysql.sql 2453bb92c6 
>   metastore/scripts/upgrade/oracle/046-HIVE-17566.oracle.sql 0ee0f758f1 
>   metastore/scripts/upgrade/oracle/hive-schema-3.0.0.oracle.sql 47bfc5ae08 
>   metastore/scripts/upgrade/postgres/045-HIVE-17566.postgres.sql aa27a6486b 
>   metastore/scripts/upgrade/postgres/hive-schema-3.0.0.postgres.sql 
> 5c770e2659 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 87f6e1d64e 
>   
> ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/JsonMetaDataFormatter.java
>  f1258bab17 
>   
> ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java
>  9df1b82d62 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 
> dc29b122c9 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g 99ed71a5fa 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g 053393ce51 
>   ql/src/java/org/apache/hadoop/hive/ql/plan/AlterResourcePlanDesc.java 
> f0658a665e 
>   ql/src/test/queries/clientpositive/resourceplan.q 586491dc91 
>   ql/src/test/results/clientpositive/llap/resourceplan.q.out 2231bb566d 
>   
> standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java
>  3deef0ee96 
>   
> standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/model/MWMResourcePlan.java
>  3ff924fe00 
>   standalone-metastore/src/main/resources/package.jdo 296e273ec8 
>   standalone-metastore/src/main/thrift/hive_metastore.thrift 1d455463a6 
> 
> 
> Diff: https://reviews.apache.org/r/63346/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

[jira] [Created] (HIVE-17925) Fix TestHooks so that it avoids ClassNotFound on teardown

2017-10-27 Thread Owen O'Malley (JIRA) 
Owen O'Malley created HIVE-17925:


 Summary: Fix TestHooks so that it avoids ClassNotFound on teardown
 Key: HIVE-17925
 URL: https://issues.apache.org/jira/browse/HIVE-17925
 Project: Hive
  Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Owen O'Malley


TestHooks gets a ClassNotFound exception during teardown, which messes up some 
following tests.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[Research] 45-min Phone Interview for Research ($20 Gift Card)

2017-10-27 Thread Sangseok You 
Dear Developers of Apache Hive,

I apologies for the spam.
My name is Sangseok You. I am a postdoctoral research fellow who studies how 
open source developers collaborate for their projects.
Our research team is interested in what tools are used and how coordination is 
managed in open source developer teams.

Your participation will involve a verbal interview conversation by phone or 
Skype (approx. 45 minutes).
Experiences, skills, and programming languages in all ranges are welcome.
If you have ever contributed to an open source project (e.g., own a repo, raise 
pull requests, or fix bugs), we will be happy to talk with you.
We provide a $20 Amazon.com gift card for the interview upon completion. We 
look forward to hearing about your experience.


* If you have any questions about the study, please contact Dr. 
Sangseok You (syo...@syr.edu).


  *   If you are interested in the study, please click the link below to sing 
up.
https://goo.gl/forms/G0Tlq2dipaIwuhza2


Thank you very much!!

Best,
Sangseok


Sangseok You, Ph.D.
Postdoctoral Research Fellow
School of Information Studies
T 734.730.4124
syo...@syr.edu

105 Hinds Hall, Syracuse, NY 13244
www.sangseokyou.com

Syracuse University

[jira] [Created] (HIVE-17924) Restore SerDe by reverting HIVE-15167 to unbreak API compatibility

2017-10-27 Thread Owen O'Malley (JIRA) 
Owen O'Malley created HIVE-17924:


 Summary: Restore SerDe by reverting HIVE-15167 to unbreak API 
compatibility
 Key: HIVE-17924
 URL: https://issues.apache.org/jira/browse/HIVE-17924
 Project: Hive
  Issue Type: Bug
Affects Versions: 2.3.0, 2.3.1
Reporter: Owen O'Malley
Assignee: Owen O'Malley


HIVE-15167 broke compatibility badly for very little gain and caused a lot of 
pain for our users. We should revert it and restore the SerDe interface.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Re: Review Request 63230: HIVE-17841 implement applying the resource plan

2017-10-27 Thread j . prasanth . j 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63230/#review189459
---



JIRA is down for indexing. Mostly the changes look good. Left some minor 
comments. Esp. around the error msg when HiveException is thrown for query kill 
(more specific info will be useful for the user and debugging).

- Prasanth_J


On Oct. 27, 2017, 2:43 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63230/
> ---
> 
> (Updated Oct. 27, 2017, 2:43 a.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 892ebfa166 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AmPluginNode.java 35d380c92b 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/GuaranteedTasksAllocator.java 
> d978a25b14 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/LlapPluginEndpointClientImpl.java
>  45c3e38dcc 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/QueryAllocationManager.java 
> a326db3ab0 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/SessionExpirationTracker.java 
> da93a3a791 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> b67c933b19 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 9b4714f1d7 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> 613522357e 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 144816862d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/UserPoolMapping.java 
> 81d6b859a6 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java 00501eef93 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> d725e90475 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/LlapClusterStateForCompile.java
>  209cf57a6a 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> 59efd43be6 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 258a865fef 
> 
> 
> Diff: https://reviews.apache.org/r/63230/diff/3/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Re: Review Request 63230: HIVE-17841 implement applying the resource plan

2017-10-27 Thread j . prasanth . j 


> On Oct. 25, 2017, 9:57 p.m., Prasanth_J wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java
> > Lines 130 (patched)
> > 
> >
> > use notEmpty.awaitUninterruptibly() ? won't wake up for spurious 
> > interrupts. no need to loop with that.
> 
> Sergey Shelukhin wrote:
> Hmm... I don't like setting things to wait forever as I've seen it cause 
> bugs many times in the past. With the loop, it rechecks the pool so it's 
> harder to introduce bugs, although now it's strictly speaking unnecessary to 
> recheck

Makes sense. Will drop it. There is also a potential for lost notification 
which will cause infinite wait.


- Prasanth_J


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63230/#review189249
---


On Oct. 27, 2017, 2:43 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63230/
> ---
> 
> (Updated Oct. 27, 2017, 2:43 a.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 892ebfa166 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AmPluginNode.java 35d380c92b 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/GuaranteedTasksAllocator.java 
> d978a25b14 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/LlapPluginEndpointClientImpl.java
>  45c3e38dcc 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/QueryAllocationManager.java 
> a326db3ab0 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/SessionExpirationTracker.java 
> da93a3a791 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> b67c933b19 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 9b4714f1d7 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> 613522357e 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 144816862d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/UserPoolMapping.java 
> 81d6b859a6 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java 00501eef93 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> d725e90475 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/LlapClusterStateForCompile.java
>  209cf57a6a 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> 59efd43be6 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 258a865fef 
> 
> 
> Diff: https://reviews.apache.org/r/63230/diff/3/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Re: Review Request 63230: HIVE-17841 implement applying the resource plan

2017-10-27 Thread j . prasanth . j 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63230/#review189456
---




ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java
Lines 83 (patched)


Agreed. But you can schedule a new instance of CompletableFuture that 
completeExceptionally after timeout. 
You can compose this instance of timeout CompletableFuture with other 
SettableFutures to single CompletableFuture with acceptEither.

So you either get timeout or some completed future.


- Prasanth_J


On Oct. 27, 2017, 2:43 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63230/
> ---
> 
> (Updated Oct. 27, 2017, 2:43 a.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 892ebfa166 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AmPluginNode.java 35d380c92b 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/GuaranteedTasksAllocator.java 
> d978a25b14 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/LlapPluginEndpointClientImpl.java
>  45c3e38dcc 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/QueryAllocationManager.java 
> a326db3ab0 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/SessionExpirationTracker.java 
> da93a3a791 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> b67c933b19 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 9b4714f1d7 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> 613522357e 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 144816862d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/UserPoolMapping.java 
> 81d6b859a6 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java 00501eef93 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> d725e90475 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/LlapClusterStateForCompile.java
>  209cf57a6a 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> 59efd43be6 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 258a865fef 
> 
> 
> Diff: https://reviews.apache.org/r/63230/diff/3/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Re: Review Request 63230: HIVE-17841 implement applying the resource plan

2017-10-27 Thread j . prasanth . j 


> On Oct. 25, 2017, 9:57 p.m., Prasanth_J wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java
> > Line 98 (original), 110 (patched)
> > 
> >
> > would be cleaner with executor service + thread factory to name the 
> > thread based on idx or session name instead of using FutureTask directly.
> 
> Sergey Shelukhin wrote:
> this makes special casing below difficult, and doesn't seem necessary 
> since these are one-shot thread. Why create an executor service for that and 
> make sure to close it.

How do you know if timeout runnable executed or not? For debugging, better to 
have a log line in TimeoutRunnable.


- Prasanth_J


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63230/#review189249
---


On Oct. 27, 2017, 2:43 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63230/
> ---
> 
> (Updated Oct. 27, 2017, 2:43 a.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 892ebfa166 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AmPluginNode.java 35d380c92b 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/GuaranteedTasksAllocator.java 
> d978a25b14 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/LlapPluginEndpointClientImpl.java
>  45c3e38dcc 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/QueryAllocationManager.java 
> a326db3ab0 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/SessionExpirationTracker.java 
> da93a3a791 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> b67c933b19 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 9b4714f1d7 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> 613522357e 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 144816862d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/UserPoolMapping.java 
> 81d6b859a6 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java 00501eef93 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> d725e90475 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/LlapClusterStateForCompile.java
>  209cf57a6a 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> 59efd43be6 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 258a865fef 
> 
> 
> Diff: https://reviews.apache.org/r/63230/diff/3/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Re: Review Request 63230: HIVE-17841 implement applying the resource plan

2017-10-27 Thread j . prasanth . j 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63230/#review189450
---




ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java
Lines 1306 (patched)


nit: do we know the reason why? may be print some user info from EventState 
(if rpName has changed/added or version changed). So its clear to the user that 
admin did something to RP that triggered the kill.


- Prasanth_J


On Oct. 27, 2017, 2:43 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63230/
> ---
> 
> (Updated Oct. 27, 2017, 2:43 a.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 892ebfa166 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AmPluginNode.java 35d380c92b 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/GuaranteedTasksAllocator.java 
> d978a25b14 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/LlapPluginEndpointClientImpl.java
>  45c3e38dcc 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/QueryAllocationManager.java 
> a326db3ab0 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/SessionExpirationTracker.java 
> da93a3a791 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> b67c933b19 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 9b4714f1d7 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> 613522357e 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 144816862d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/UserPoolMapping.java 
> 81d6b859a6 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java 00501eef93 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> d725e90475 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/LlapClusterStateForCompile.java
>  209cf57a6a 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> 59efd43be6 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 258a865fef 
> 
> 
> Diff: https://reviews.apache.org/r/63230/diff/3/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

[jira] [Created] (HIVE-17923) 'cluster by' should not be needed for a bucketed table

2017-10-27 Thread Eugene Koifman (JIRA) 
Eugene Koifman created HIVE-17923:
-

 Summary: 'cluster by' should not be needed for a bucketed table
 Key: HIVE-17923
 URL: https://issues.apache.org/jira/browse/HIVE-17923
 Project: Hive
  Issue Type: Sub-task
Affects Versions: 3.0.0
Reporter: Eugene Koifman
Priority: Blocker


given 
{noformat}
CREATE TABLE over10k_orc_bucketed(t tinyint,
   si smallint,
   i int,
   b bigint,
   f float,
   d double,
   bo boolean,
   s string,
   ts timestamp,
   `dec` decimal(4,2),
   bin binary) CLUSTERED BY(si) INTO 4 BUCKETS STORED AS ORC;
{noformat}
insert into over10k_orc_bucketed select * from over10k
{noformat}
produces 1 data file (bucket 0).  It should produce 4 based on input data.
{noformat}
insert into over10k_orc_bucketed select * from over10k cluster by si
{noformat}

does the right thing.

acid_vectorization_original.q has the full script



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (HIVE-17922) Enable runWorker() UDF to launch compactor from .q tests

2017-10-27 Thread Eugene Koifman (JIRA) 
Eugene Koifman created HIVE-17922:
-

 Summary: Enable runWorker() UDF to launch compactor from .q tests
 Key: HIVE-17922
 URL: https://issues.apache.org/jira/browse/HIVE-17922
 Project: Hive
  Issue Type: Sub-task
  Components: Test, Transactions
Affects Versions: 3.0.0
Reporter: Eugene Koifman
Assignee: Eugene Koifman


available since HIVE-17458 (via UDFRunWorker.java)

The idea is to be able to do 

{noformat}
alter table over10k_orc_bucketed compact 'major' WITH OVERWRITE TBLPROPERTIES 
("compactor.mapreduce.map.memory.mb"="500","compactor.hive.tez.container.size"="500");

 select runWorker() from mydual;

 show compactions;
{noformat}

but it always fails with
{noformat}
 Invalid resource request, requested memory < 0, or requested memory > max 
configured, requestedMemory=1536, maxMemory=512
{noformat}


ToDo: see if need to fix host name masking in the output from "show compactions"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (HIVE-17921) Aggregation with struct in LLAP produces wrong result

2017-10-27 Thread Eugene Koifman (JIRA) 
Eugene Koifman created HIVE-17921:
-

 Summary: Aggregation with struct in LLAP produces wrong result
 Key: HIVE-17921
 URL: https://issues.apache.org/jira/browse/HIVE-17921
 Project: Hive
  Issue Type: Sub-task
  Components: llap, Transactions
Affects Versions: 3.0.0
Reporter: Eugene Koifman


Consider 
{noformat}
select ROW__ID, count(*) from over10k_orc_bucketed group by ROW__ID having 
count(*) > 1;
{noformat}
 in acid_vectorization_original.q (available since HIVE-17458)

when run using TestMiniLlapCliDriver produces "NULL, N" where N varies from run 
to run.
The right answer is empty results set as can be seen by running
{noformat}
select ROW__ID, * from over10k_orc_bucketed where ROW__ID is null
{noformat}
in the same test.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (HIVE-17920) Vectorized reader does push down projection columns for index access schema

2017-10-27 Thread Ferdinand Xu (JIRA) 
Ferdinand Xu created HIVE-17920:
---

 Summary: Vectorized reader does push down projection columns for 
index access schema
 Key: HIVE-17920
 URL: https://issues.apache.org/jira/browse/HIVE-17920
 Project: Hive
  Issue Type: Sub-task
Reporter: Ferdinand Xu






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)