[jira] [Created] (HIVE-20558) Change default of hive.hashtable.key.count.adjustment to 0.99

2018-09-13 Thread Ashutosh Chauhan (JIRA) 
Ashutosh Chauhan created HIVE-20558:
---

 Summary:  Change default of hive.hashtable.key.count.adjustment to 
0.99
 Key: HIVE-20558
 URL: https://issues.apache.org/jira/browse/HIVE-20558
 Project: Hive
  Issue Type: Improvement
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan


Current default is 2



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20557) Constant Folding: null > (expr) is not constant folded to NULL

2018-09-13 Thread Gopal V (JIRA) 
Gopal V created HIVE-20557:
--

 Summary: Constant Folding: null > (expr) is not constant folded to 
NULL
 Key: HIVE-20557
 URL: https://issues.apache.org/jira/browse/HIVE-20557
 Project: Hive
  Issue Type: Improvement
Reporter: Gopal V


{code}

create temporary table foo(col1 int, col2 int, col3 int, col5 int, col9 int) 
stored as orc;

explain select count(1) from foo where 
CASE WHEN (col5 is not null) THEN (((col1 / col5) > (col9 / col3))) ELSE ((null 
> (col9 / col3))) END;

explain select count(1), max((col9/col3) > null) from foo where 
CASE WHEN (col5 is not null) THEN (((col1 / col5) > (col9 / col3))) ELSE 
(((col9 / col3) > null)) END;
{code}


There's no sane way to write this query, but this is actually generated by CBO 
for an expression which looks like 

{code}
case when t_w_firstyear.year_total > 0 then t_w_secyear.year_total / 
t_w_firstyear.year_total else null end
   > case when t_s_firstyear.year_total > 0 then t_s_secyear.year_total 
/ t_s_firstyear.year_total else null end
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-09-13 Thread Jaume M (JIRA) 
Jaume M created HIVE-20556:
--

 Summary: Expose an API to retrieve the TBL_ID from TBLS in the 
metastore tables
 Key: HIVE-20556
 URL: https://issues.apache.org/jira/browse/HIVE-20556
 Project: Hive
  Issue Type: New Feature
  Components: Metastore, Standalone Metastore
Reporter: Jaume M


We have two options to do this
1) Use the current MTable and add a field for this value
2) Add an independent API call to the metastore that would return the TBL_ID.

Option 1 is preferable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20555) HiveServer2: Preauthenticated subject for http transport is not retained for entire duration of http communication in some cases

2018-09-13 Thread Vaibhav Gumashta (JIRA) 
Vaibhav Gumashta created HIVE-20555:
---

 Summary: HiveServer2: Preauthenticated subject for http transport 
is not retained for entire duration of http communication in some cases
 Key: HIVE-20555
 URL: https://issues.apache.org/jira/browse/HIVE-20555
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2
Affects Versions: 3.1.0, 2.3.2
Reporter: Vaibhav Gumashta


As implemented in HIVE-8705, for http transport, we add the logged in subject's 
credentials in the http header via a request interceptor. The request 
interceptor doesn't seem to be getting used for some http traffic (e.g. knox 
ssl in the same rpc). It would also be better to cache the logged in subject 
for the duration of the whole session.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 68310: HIVE-17040

2018-09-13 Thread Jesús Camacho Rodríguez 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68310/
---

(Updated Sept. 13, 2018, 8:54 p.m.)


Review request for hive and Ashutosh Chauhan.


Bugs: HIVE-17040
https://issues.apache.org/jira/browse/HIVE-17040


Repository: hive-git


Description
---

HIVE-17040


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
aa58d7445ce18c470641558231b635d325454d65 
  itests/src/test/resources/testconfiguration.properties 
3a5aec7d6b8ab624f5f4526cf81e48678eca601f 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/HiveRelOptUtil.java 
268284a6da22755f801be87651f9d4a6d228b24d 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinConstraintsRule.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveProjectJoinTransposeRule.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveProjectMergeRule.java
 07518df9ec1cea1c331846bbe636cf1a039e762f 
  ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 
39f27b10eb0db29f28add4e325101b192ad708d7 
  ql/src/test/queries/clientpositive/join_constraints_optimization.q 
PRE-CREATION 
  ql/src/test/queries/clientpositive/materialized_view_rewrite_1.q 
ee4844277e5dd1d9ea3911ad2e33a9c3f2481344 
  ql/src/test/queries/clientpositive/materialized_view_rewrite_3.q 
4aadd5fb0a4bc74c5bc4088b3d4e62c81bf9cf8b 
  ql/src/test/queries/clientpositive/materialized_view_rewrite_4.q 
dc20b68ba9a9e0bbcb9c414b10b00f3228fe63fe 
  ql/src/test/queries/clientpositive/materialized_view_rewrite_5.q 
0e4fdf49ac04935f6f14c2ceaa0969008b34f926 
  ql/src/test/queries/clientpositive/materialized_view_rewrite_6.q 
4f05f76330cb74be50187e3b175d4675f5ea8763 
  ql/src/test/queries/clientpositive/materialized_view_rewrite_7.q 
59ed5757569a8dde70fe04eb9ec5e8c91b5931bf 
  ql/src/test/queries/clientpositive/materialized_view_rewrite_no_join_opt.q 
PRE-CREATION 
  ql/src/test/queries/clientpositive/materialized_view_rewrite_no_join_opt_2.q 
PRE-CREATION 
  ql/src/test/queries/clientpositive/materialized_view_rewrite_part_1.q 
5a2e74c8a005ae8422c00a998fa3c07183749176 
  ql/src/test/results/clientpositive/ambiguitycheck.q.out 
80c9582fec9754fe56400064ab3f88e3e9ea2da7 
  
ql/src/test/results/clientpositive/beeline/materialized_view_create_rewrite.q.out
 7813aac29465b5193789464fcd32771741a98071 
  ql/src/test/results/clientpositive/druid/druidmini_mv.q.out 
806262d72e687bbdd09b47380eed77c14764c2a5 
  ql/src/test/results/clientpositive/list_bucket_dml_2.q.out 
bd8e215c2207c48ce2e446fcc10333ec0fb4648c 
  ql/src/test/results/clientpositive/list_bucket_dml_4.q.out 
520d48e3d9fa67301852efc9ed1c92494fd528a0 
  ql/src/test/results/clientpositive/list_bucket_dml_9.q.out 
fbd4fde1bd8d2f7379585afe07c018139b7d64e8 
  ql/src/test/results/clientpositive/list_bucket_query_multiskew_1.q.out 
e324cab738c22e31089f437d6e7d8a65160dc5b9 
  ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out 
ec1e54060cb7d380bda4d965fff540d002bd456a 
  ql/src/test/results/clientpositive/list_bucket_query_multiskew_3.q.out 
889f23c6da7e3c7b955b83d44afd1bd048468b49 
  ql/src/test/results/clientpositive/list_bucket_query_oneskew_1.q.out 
dcff8a50370b4ebb07300d4a7d9c34aa84f4ae17 
  ql/src/test/results/clientpositive/list_bucket_query_oneskew_2.q.out 
268051e2acbbabd02206c5a21690fb563a3dcd2b 
  ql/src/test/results/clientpositive/llap/acid_bucket_pruning.q.out 
3951b71227d93469347264362492e64554efee32 
  ql/src/test/results/clientpositive/llap/bucketpruning1.q.out 
55442ad04668a193a2d40b6a3088149f6072b28c 
  ql/src/test/results/clientpositive/llap/current_date_timestamp.q.out 
6831fb2573788033393544b835f1a56d69fb1712 
  ql/src/test/results/clientpositive/llap/join_constraints_optimization.q.out 
PRE-CREATION 
  
ql/src/test/results/clientpositive/llap/materialized_view_create_rewrite.q.out 
71adebb2acad1545c48d45835cd5876434b141b5 
  
ql/src/test/results/clientpositive/llap/materialized_view_create_rewrite_dummy.q.out
 ce1c281bea0bd2a96e67057ee990fa5b45850905 
  
ql/src/test/results/clientpositive/llap/materialized_view_create_rewrite_multi_db.q.out
 98f74379f6275aed90273929c65144e4bbd51a97 
  ql/src/test/results/clientpositive/llap/materialized_view_rewrite_1.q.out 
4d8fa52aa94a77faa9d1d1872afcb016e5a3c438 
  ql/src/test/results/clientpositive/llap/materialized_view_rewrite_2.q.out 
8e54abe61d48ebd3439ee215e88c2186601a4cd3 
  ql/src/test/results/clientpositive/llap/materialized_view_rewrite_3.q.out 
d7536e408798d38970a30226f7248d69a10b0903 
  ql/src/test/results/clientpositive/llap/materialized_view_rewrite_4.q.out 
3fd4c59ee68c3b0df56d070df900fbea31e3f6aa 
  ql/src/test/results/clientpositive/llap/materialized_view_rewrite_5.q.out 
9992409f6aa36f6be18f6b07a6de380b2be18a9a 
  ql/src/test/results/clientpositive/llap/materialized_view_rewrite_6.q.out

Re: Review Request 68310: HIVE-17040

2018-09-13 Thread Jesús Camacho Rodríguez 


> On Sept. 12, 2018, 9:40 p.m., Vineet Garg wrote:
> > common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
> > Lines 2219 (patched)
> > 
> >
> > Should we control all constraint related optimization with one flag and 
> > therefore rename this one to e.g. hive.optimize.constraints.rules or 
> > something?
> > Or do you think it is better for each rule to have seperate conf?

I had not given it much thought. We could have different configuration 
properties, since disabling a rule would only be for debugging purposes and 
probably better to do it selectively. I changed the name to 
hive.optimize.constraints.join , so they all use same prefix 
hive.optimize.constraints .


> On Sept. 12, 2018, 9:40 p.m., Vineet Garg wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinConstraintsRule.java
> > Lines 115 (patched)
> > 
> >
> > Just a minor comment about readability. leftFK, rightFK name gets a bit 
> > confusing may be comment to describe what it represents e.g. they 
> > represents corresponding left, right input which is potential FK

Added comment and changed variable names.


> On Sept. 12, 2018, 9:40 p.m., Vineet Garg wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinConstraintsRule.java
> > Lines 117 (patched)
> > 
> >
> > Not sure what this logic is trying to do. Can you explain? Both of the 
> > inputs are being referenced above so how can we still proceed?

I added a bit of explanation below the condition, I think it should be clearer 
now.


> On Sept. 12, 2018, 9:40 p.m., Vineet Garg wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinConstraintsRule.java
> > Lines 203 (patched)
> > 
> >
> > I didn't understand this part. Irrespective of what input side is being 
> > referenced we assume leftInput to be FK. Lets say rightFK is true i.e. 
> > right side input is being referenced then wouldn't assuing leftInput as FK 
> > side cause issues because we will end up removing right side (PK side) when 
> > there are references to it

This is a left outer join, either we can 1) transform it into inner join if 
operator on top of it references columns from both sides, or 2) remove it if it 
only references columns from the left side. However, the case that you 
describe, i.e., left outer join with operator on top only referencing columns 
from right input, was not covered indeed! I have changed the logic slightly to 
take that into account.


> On Sept. 12, 2018, 9:40 p.m., Vineet Garg wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinConstraintsRule.java
> > Lines 215 (patched)
> > 
> >
> > This whole step 2 can be encapsulated in a utility method. I can see 
> > this being quite useful for other constraint optimizations

Done, moved to HiveRelOptUtil.


> On Sept. 12, 2018, 9:40 p.m., Vineet Garg wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinConstraintsRule.java
> > Lines 253 (patched)
> > 
> >
> > Order by should be safe here as well? (assuming it is represented by 
> > seperate rel node)

Correct, I expect it to be less common, but it may happen. I have changed the 
method accordingly.


> On Sept. 12, 2018, 9:40 p.m., Vineet Garg wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinConstraintsRule.java
> > Lines 261 (patched)
> > 
> >
> > Did't understand this step. Irrespective of the mode or fk-pk 
> > relationship OUTER join is being transformed into INNER?

We transform into INNER to extract the conditions correctly and be able to do 
the corresponding verifications (we cannot pull conditions from below if it is 
an outer join).
If the join is finally transformed, we use the join that we have already 
created. Otherwise, we will not use it at all.


> On Sept. 12, 2018, 9:40 p.m., Vineet Garg wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinConstraintsRule.java
> > Lines 329 (patched)
> > 
> >
> > isn't calling mq.getTableReferences(rightInput) straightforward and 
> > cheaper rather than calling it for join and leftInput and taking the 
> > difference?

The names of the tables are unique, which is important to know the lineage of a 
predicate in point 5.
For instance : A JOIN (B JOIN A).
If we extract from right input, we would get B#0, A#0 for

Re: Review Request 68683: Add new configuration to set the size of the global compile lock

2018-09-13 Thread denys kuzmenko via Review Board 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68683/
---

(Updated Sept. 13, 2018, 8:18 p.m.)


Review request for hive, Zoltan Haindrich, Zoltan Haindrich, and Peter Vary.


Bugs: HIVE-20535
https://issues.apache.org/jira/browse/HIVE-20535


Repository: hive-git


Description
---

When removing the compile lock, it is quite risky to remove it entirely.

It would be good to provide a pool size for the concurrent compilation, so the 
administrator can limit the load


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java aa58d74 
  ql/src/java/org/apache/hadoop/hive/ql/Driver.java dad2035 
  ql/src/test/org/apache/hadoop/hive/ql/CompileLockTest.java PRE-CREATION 


Diff: https://reviews.apache.org/r/68683/diff/2/

Changes: https://reviews.apache.org/r/68683/diff/1-2/


Testing
---

Added CompileLockTest


File Attachments (updated)


HIVE-20535.1.patch
  
https://reviews.apache.org/media/uploaded/files/2018/09/13/41f5a84a-70e5-4882-99c1-1cf98c4364e4__HIVE-20535.1.patch


Thanks,

denys kuzmenko

Re: Review Request 68709: HIVE-20547 HS2: support Tez sessions started by someone else (part 1)

2018-09-13 Thread j . prasanth . j 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68709/#review208608
---


Ship it!




Ship It!

- Prasanth_J


On Sept. 13, 2018, 8:11 p.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68709/
> ---
> 
> (Updated Sept. 13, 2018, 8:11 p.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java aa58d7445c 
>   itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java 
> bfa3d5d7d2 
>   ql/pom.xml d73deba440 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 79cb54e552 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AbstractTriggerValidator.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/KillTriggerActionHandler.java 
> f357775c86 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionState.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionsRegistryClient.java
>  PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSession.java PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> 89954cba67 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 2633390861 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> d3748edb86 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 08e65a4a6d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezTask.java f2ed07add5 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TriggerValidatorRunnable.java 
> 670184b0ac 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java fa2b02e591 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> 5326e3590f 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManagerFederation.java 
> 4b5022a101 
>   ql/src/java/org/apache/hadoop/hive/ql/session/KillQuery.java 01dc7e2cd7 
>   ql/src/java/org/apache/hadoop/hive/ql/session/NullKillQuery.java eac2936719 
>   ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 71e130b608 
>   ql/src/java/org/apache/hadoop/hive/ql/wm/SessionTriggerProvider.java 
> 16106f481b 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> f5ab981f26 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezSessionPool.java 
> d5b683f788 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezTask.java b67aec371d 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 4659ecb97b 
>   service/src/java/org/apache/hive/service/server/KillQueryImpl.java 
> 490a04da67 
> 
> 
> Diff: https://reviews.apache.org/r/68709/diff/2/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Re: Review Request 68709: HIVE-20547 HS2: support Tez sessions started by someone else (part 1)

2018-09-13 Thread Sergey Shelukhin 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68709/
---

(Updated Sept. 13, 2018, 8:11 p.m.)


Review request for hive and Prasanth_J.


Repository: hive-git


Description
---

see jira


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java aa58d7445c 
  itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java bfa3d5d7d2 
  ql/pom.xml d73deba440 
  ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 79cb54e552 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AbstractTriggerValidator.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/KillTriggerActionHandler.java 
f357775c86 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionState.java 
PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionsRegistryClient.java
 PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSession.java PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 89954cba67 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
2633390861 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
d3748edb86 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
08e65a4a6d 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezTask.java f2ed07add5 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TriggerValidatorRunnable.java 
670184b0ac 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java fa2b02e591 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
5326e3590f 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManagerFederation.java 
4b5022a101 
  ql/src/java/org/apache/hadoop/hive/ql/session/KillQuery.java 01dc7e2cd7 
  ql/src/java/org/apache/hadoop/hive/ql/session/NullKillQuery.java eac2936719 
  ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 71e130b608 
  ql/src/java/org/apache/hadoop/hive/ql/wm/SessionTriggerProvider.java 
16106f481b 
  ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
f5ab981f26 
  ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezSessionPool.java 
d5b683f788 
  ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezTask.java b67aec371d 
  ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
4659ecb97b 
  service/src/java/org/apache/hive/service/server/KillQueryImpl.java 490a04da67 


Diff: https://reviews.apache.org/r/68709/diff/2/

Changes: https://reviews.apache.org/r/68709/diff/1-2/


Testing
---


Thanks,

Sergey Shelukhin

[jira] [Created] (HIVE-20554) Unable to drop an external table after renaming it.

2018-09-13 Thread Krishnama Raju K (JIRA) 
Krishnama Raju K created HIVE-20554:
---

 Summary: Unable to drop an external table after renaming it.
 Key: HIVE-20554
 URL: https://issues.apache.org/jira/browse/HIVE-20554
 Project: Hive
  Issue Type: Bug
  Components: Hive, HiveServer2
Affects Versions: 2.1.0, 1.2.0
Reporter: Krishnama Raju K


Unable to drop an external partitioned table after renaming it. Getting the 
following exception, 

 
{noformat}

java.sql.BatchUpdateException: Cannot delete or update a parent row: a foreign 
key constraint fails ("hive"."PART_COL_STATS", CONSTRAINT "PART_COL_STATS_FK" 
FOREIGN KEY ("PART_ID") REFERENCES "PARTITIONS" ("PART_ID")) 
at 
com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:2024)
 
at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1449) 
at com.jolbox.bonecp.StatementHandle.executeBatch(StatementHandle.java:424) 
at 
org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeBatch(ParamLoggingPreparedStatement.java:366)
 
at 
org.datanucleus.store.rdbms.SQLController.processConnectionStatement(SQLController.java:676)
 
at 
org.datanucleus.store.rdbms.SQLController.getStatementForUpdate(SQLController.java:204)
 
at 
org.datanucleus.store.rdbms.SQLController.getStatementForUpdate(SQLController.java:176)
 
at 
org.datanucleus.store.rdbms.scostore.JoinMapStore.clearInternal(JoinMapStore.java:900)
 
at 
org.datanucleus.store.rdbms.scostore.JoinMapStore.clear(JoinMapStore.java:449) 
at org.datanucleus.store.types.wrappers.backed.Map.clear(Map.java:605) 
at 
org.datanucleus.store.rdbms.mapping.java.MapMapping.preDelete(MapMapping.java:252)
 
at 
org.datanucleus.store.rdbms.request.DeleteRequest.execute(DeleteRequest.java:193)
 
at 
org.datanucleus.store.rdbms.RDBMSPersistenceHandler.deleteObjectFromTable(RDBMSPersistenceHandler.java:499)
 
at 
org.datanucleus.store.rdbms.RDBMSPersistenceHandler.deleteObject(RDBMSPersistenceHandler.java:470)
 
at 
org.datanucleus.state.AbstractStateManager.internalDeletePersistent(AbstractStateManager.java:832)
 
at 
org.datanucleus.state.StateManagerImpl.deletePersistent(StateManagerImpl.java:4244)
 
at 
org.datanucleus.ExecutionContextImpl.deleteObjectInternal(ExecutionContextImpl.java:2395)
 
at 
org.datanucleus.ExecutionContextImpl.deleteObjectWork(ExecutionContextImpl.java:2317)
 
at 
org.datanucleus.ExecutionContextImpl.deleteObjects(ExecutionContextImpl.java:2209)
 
at 
org.datanucleus.ExecutionContextThreadedImpl.deleteObjects(ExecutionContextThreadedImpl.java:259)
 
at 
org.datanucleus.store.query.Query.performDeletePersistentAll(Query.java:2133) 
at 
org.datanucleus.store.query.AbstractJavaQuery.performDeletePersistentAll(AbstractJavaQuery.java:114)
 
at org.datanucleus.store.query.Query.deletePersistentAll(Query.java:2085) 
at org.datanucleus.api.jdo.JDOQuery.deletePersistentInternal(JDOQuery.java:441) 
at org.datanucleus.api.jdo.JDOQuery.deletePersistentAll(JDOQuery.java:428) 
at 
org.apache.hadoop.hive.metastore.ObjectStore.dropPartitionsNoTxn(ObjectStore.java:2421)
 
at 
org.apache.hadoop.hive.metastore.ObjectStore.dropPartitions(ObjectStore.java:1805)
 
at sun.reflect.GeneratedMethodAccessor78.invoke(Unknown Source) 
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 
at java.lang.reflect.Method.invoke(Method.java:498) 
at 
org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103) 
at com.sun.proxy.$Proxy10.dropPartitions(Unknown Source) 
at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.dropPartitionsAndGetLocations(HiveMetaStore.java:1838)
 
at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_table_core(HiveMetaStore.java:1673)
 
at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_table_with_environment_context(HiveMetaStore.java:1859)
 
at sun.reflect.GeneratedMethodAccessor110.invoke(Unknown Source) 
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 
at java.lang.reflect.Method.invoke(Method.java:498) 
at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
 
at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:105)
 
at com.sun.proxy.$Proxy12.drop_table_with_environment_context(Unknown Source) 
at 
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_table_with_environment_context.getResult(ThriftHiveMetastore.java:9523)
 
at 
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_table_with_environment_context.getResult(ThriftHiveMetastore.java:9507)
 
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) 
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) 
at 
org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:551)
 
at

Re: Review Request 68709: HIVE-20547 HS2: support Tez sessions started by someone else (part 1)

2018-09-13 Thread j . prasanth . j 


> On Sept. 13, 2018, 8:03 a.m., Prasanth_J wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionsRegistryClient.java
> > Lines 37 (patched)
> > 
> >
> > Yes. Tez needs severals fixes in addition to registry client
> > 1) One that cuts of yarn/RM interaction
> > 2) Registry configs via TezConfiguration
> > 3) Handling DAG recovery for external sessions
> 
> Sergey Shelukhin wrote:
> can you file some Tez jiras for that?

https://issues.apache.org/jira/browse/TEZ-3991


- Prasanth_J


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68709/#review208584
---


On Sept. 13, 2018, 2:19 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68709/
> ---
> 
> (Updated Sept. 13, 2018, 2:19 a.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java aa58d7445c 
>   itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java 
> bfa3d5d7d2 
>   ql/pom.xml a55cbe380d 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AbstractTriggerValidator.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/KillTriggerActionHandler.java 
> f357775c86 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionState.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionsRegistryClient.java
>  PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSession.java PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> 89954cba67 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 2633390861 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> d3748edb86 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 08e65a4a6d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezTask.java f2ed07add5 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TriggerValidatorRunnable.java 
> 670184b0ac 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java fa2b02e591 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> 5326e3590f 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManagerFederation.java 
> 4b5022a101 
>   ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 71e130b608 
>   ql/src/java/org/apache/hadoop/hive/ql/wm/SessionTriggerProvider.java 
> 16106f481b 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> f5ab981f26 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezSessionPool.java 
> d5b683f788 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezTask.java b67aec371d 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 4659ecb97b 
> 
> 
> Diff: https://reviews.apache.org/r/68709/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Re: Review Request 68709: HIVE-20547 HS2: support Tez sessions started by someone else (part 1)

2018-09-13 Thread Sergey Shelukhin 


> On Sept. 13, 2018, 8:03 a.m., Prasanth_J wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionState.java
> > Lines 72 (patched)
> > 
> >
> > These resources may not be required. External sessions are assumed to 
> > have all the resources that it requires.

It's used in Tez object construction... I think Eric told me it was important 
for the reconnect patch to still add the resources. So for now I'll keep this 
in.


> On Sept. 13, 2018, 8:03 a.m., Prasanth_J wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionsRegistryClient.java
> > Lines 37 (patched)
> > 
> >
> > Yes. Tez needs severals fixes in addition to registry client
> > 1) One that cuts of yarn/RM interaction
> > 2) Registry configs via TezConfiguration
> > 3) Handling DAG recovery for external sessions

can you file some Tez jiras for that?


- Sergey


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68709/#review208584
---


On Sept. 13, 2018, 2:19 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68709/
> ---
> 
> (Updated Sept. 13, 2018, 2:19 a.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java aa58d7445c 
>   itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java 
> bfa3d5d7d2 
>   ql/pom.xml a55cbe380d 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AbstractTriggerValidator.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/KillTriggerActionHandler.java 
> f357775c86 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionState.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionsRegistryClient.java
>  PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSession.java PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> 89954cba67 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 2633390861 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> d3748edb86 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 08e65a4a6d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezTask.java f2ed07add5 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TriggerValidatorRunnable.java 
> 670184b0ac 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java fa2b02e591 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> 5326e3590f 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManagerFederation.java 
> 4b5022a101 
>   ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 71e130b608 
>   ql/src/java/org/apache/hadoop/hive/ql/wm/SessionTriggerProvider.java 
> 16106f481b 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> f5ab981f26 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezSessionPool.java 
> d5b683f788 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezTask.java b67aec371d 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 4659ecb97b 
> 
> 
> Diff: https://reviews.apache.org/r/68709/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

[jira] [Created] (HIVE-20553) more acid stats tests

2018-09-13 Thread Eugene Koifman (JIRA) 
Eugene Koifman created HIVE-20553:
-

 Summary: more acid stats tests
 Key: HIVE-20553
 URL: https://issues.apache.org/jira/browse/HIVE-20553
 Project: Hive
  Issue Type: Improvement
  Components: Statistics, Transactions
Affects Versions: 4.0.0
Reporter: Eugene Koifman
Assignee: Eugene Koifman
 Attachments: HIVE-20553.01.patch





--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 68710: HIVE-20544: TOpenSessionReq logs password and username

2018-09-13 Thread Karen Coppage 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68710/
---

(Updated Sept. 13, 2018, 10:11 a.m.)


Review request for hive and Laszlo Pinter.


Bugs: HIVE-20544
https://issues.apache.org/jira/browse/HIVE-20544


Repository: hive-git


Description
---

TOpenSessionReq, if client protocol is unset, both username and password are 
logged. Logging a password is a security risk. This patch would hide it with 
asterisks.


Diffs (updated)
-

  
service-rpc/src/gen/thrift/gen-javabean/org/apache/hive/service/rpc/thrift/TOpenSessionReq.java
 3195e704f3 


Diff: https://reviews.apache.org/r/68710/diff/2/

Changes: https://reviews.apache.org/r/68710/diff/1-2/


Testing
---


Thanks,

Karen Coppage

Re: Review Request 68710: HIVE-20544: TOpenSessionReq logs password and username

2018-09-13 Thread Karen Coppage 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68710/
---

(Updated Sept. 13, 2018, 9:41 a.m.)


Review request for hive and Laszlo Pinter.


Bugs: HIVE-20544
https://issues.apache.org/jira/browse/HIVE-20544


Repository: hive-git


Description
---

TOpenSessionReq, if client protocol is unset, both username and password are 
logged. Logging a password is a security risk. This patch would hide it with 
asterisks.


Diffs
-

  
service-rpc/src/gen/thrift/gen-javabean/org/apache/hive/service/rpc/thrift/TOpenSessionReq.java
 3195e704f3 


Diff: https://reviews.apache.org/r/68710/diff/1/


Testing
---


Thanks,

Karen Coppage

Re: Review Request 68709: HIVE-20547 HS2: support Tez sessions started by someone else (part 1)

2018-09-13 Thread j . prasanth . j 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68709/#review208584
---




ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionState.java
Lines 72 (patched)


These resources may not be required. External sessions are assumed to have 
all the resources that it requires.



ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionState.java
Lines 139 (patched)


should it return the one that doesn't talk to yarn? does "external" also 
mean no yarn/RM interaction everywhere in hive side or will that be in a 
separate jira?



ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionsRegistryClient.java
Lines 37 (patched)


Yes. Tez needs severals fixes in addition to registry client
1) One that cuts of yarn/RM interaction
2) Registry configs via TezConfiguration
3) Handling DAG recovery for external sessions



ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java
Lines 74 (patched)


nit: rename to baseSession?


- Prasanth_J


On Sept. 13, 2018, 2:19 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68709/
> ---
> 
> (Updated Sept. 13, 2018, 2:19 a.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java aa58d7445c 
>   itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java 
> bfa3d5d7d2 
>   ql/pom.xml a55cbe380d 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/AbstractTriggerValidator.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/KillTriggerActionHandler.java 
> f357775c86 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionState.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezExternalSessionsRegistryClient.java
>  PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSession.java PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPool.java 
> 89954cba67 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolManager.java 
> 2633390861 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionPoolSession.java 
> d3748edb86 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 
> 08e65a4a6d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezTask.java f2ed07add5 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TriggerValidatorRunnable.java 
> 670184b0ac 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WmTezSession.java fa2b02e591 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManager.java 
> 5326e3590f 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/tez/WorkloadManagerFederation.java 
> 4b5022a101 
>   ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 71e130b608 
>   ql/src/java/org/apache/hadoop/hive/ql/wm/SessionTriggerProvider.java 
> 16106f481b 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SampleTezSessionState.java 
> f5ab981f26 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezSessionPool.java 
> d5b683f788 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezTask.java b67aec371d 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestWorkloadManager.java 
> 4659ecb97b 
> 
> 
> Diff: https://reviews.apache.org/r/68709/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

[GitHub] hive pull request #433: HIVE-20552: Get Schema from LogicalPlan for HWC (Ted...

2018-09-13 Thread pudidic 
GitHub user pudidic opened a pull request:

https://github.com/apache/hive/pull/433

HIVE-20552: Get Schema from LogicalPlan for HWC (Teddy Choi)



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/pudidic/hive HIVE-20552

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/433.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #433


commit aa51cf24ccfafc61b01b96bd261e315e9d973c8d
Author: Teddy Choi 
Date:   2018-09-13T07:26:16Z

HIVE-20552: Get Schema from LogicalPlan for HWC (Teddy Choi)




---

[jira] [Created] (HIVE-20552) Get Schema from LogicalPlan faster

2018-09-13 Thread Teddy Choi (JIRA) 
Teddy Choi created HIVE-20552:
-

 Summary: Get Schema from LogicalPlan faster
 Key: HIVE-20552
 URL: https://issues.apache.org/jira/browse/HIVE-20552
 Project: Hive
  Issue Type: Test
Reporter: Teddy Choi
Assignee: Teddy Choi


To get the schema of a query faster, it currently needs to compile, optimize, 
and generate a TezPlan, which creates extra overhead when only the LogicalPlan 
is needed.

1. Copy the method \{{HiveMaterializedViewsRegistry.parseQuery}}, making it 
\{{public static}} and putting it in a utility class. 
2. Change the return statement of the method to \{{return 
analyzer.getResultSchema();}}
3. Change the return type of the method to \{{List}}
4. Call the new method from \{{GenericUDTFGetSplits.createPlanFragment}} 
replacing the current code which does this:
{code}
 if(num == 0) {
 //Schema only
 return new PlanFragment(null, schema, null);
 }
{code}
moving the call earlier in \{{getPlanFragment}} ... right after the HiveConf is 
created ... bypassing the code that uses \{{HiveTxnManager}} and \{{Driver}}.
5. Convert the \{{List}} to 
\{{org.apache.hadoop.hive.llap.Schema}}.
6. return from \{{getPlanFragment}} by returning \{{new PlanFragment(null, 
schema, null)}}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20551) Create PreparedStatement query dynamically when IN clause is used

2018-09-13 Thread Laszlo Pinter (JIRA) 
Laszlo Pinter created HIVE-20551:


 Summary: Create PreparedStatement query dynamically when IN clause 
is used
 Key: HIVE-20551
 URL: https://issues.apache.org/jira/browse/HIVE-20551
 Project: Hive
  Issue Type: Bug
Reporter: Laszlo Pinter
Assignee: Laszlo Pinter


In the MetaStoreDirectSql class when IN clause is used, the query statement is 
created via string concatenation, meaning that an attacker could change the 
statement meaning or insert arbitrary SQL commands. 

Since JDBC API allows only one literal for one “?” parameter, PreparedStatement 
doesn’t work for IN clause queries. To create the PreparedStatement query 
dynamically based on the size of the elements in IN clause, the makeParams() 
should be used instead of concatenation. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20550) Switch WebHCat to use beeline to submit Hive queries

2018-09-13 Thread Daniel Dai (JIRA) 
Daniel Dai created HIVE-20550:
-

 Summary: Switch WebHCat to use beeline to submit Hive queries
 Key: HIVE-20550
 URL: https://issues.apache.org/jira/browse/HIVE-20550
 Project: Hive
  Issue Type: Bug
Reporter: Daniel Dai
Assignee: Daniel Dai


Since hive cli is deprecated, we shall switch WebHCat to use beeline instead.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)