Re: Review Request 67800: HIVE-20039

2018-07-02 Thread Deepak Jaiswal 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67800/
---

(Updated July 3, 2018, 6:49 a.m.)


Review request for hive and Gopal V.


Changes
---

Implemented recommended changes.
Added order by in queries for predictable results.


Bugs: HIVE-20039
https://issues.apache.org/jira/browse/HIVE-20039


Repository: hive-git


Description
---

Bucket pruning: Left Outer Join on bucketed table gives wrong result.
The context was reused by all the predicates. Instead use TS op directly.


Diffs (updated)
-

  
data/files/bucket_pruning/l3_clarity__l3_monthly_dw_factplan_datajoin_1_s2_2018022300104_1/00_0
 PRE-CREATION 
  
data/files/bucket_pruning/l3_clarity__l3_monthly_dw_factplan_dw_stg_2018022300104_1/00_0
 PRE-CREATION 
  data/files/bucket_pruning/l3_clarity__l3_snap_number_2018022300104/00_0 
PRE-CREATION 
  data/files/bucket_pruning/l3_monthly_dw_dimplan/56_0 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/FixedBucketPruningOptimizer.java
 2debacacb5 
  ql/src/test/queries/clientpositive/tez_fixed_bucket_pruning.q PRE-CREATION 
  ql/src/test/results/clientpositive/llap/tez_fixed_bucket_pruning.q.out 
PRE-CREATION 


Diff: https://reviews.apache.org/r/67800/diff/2/

Changes: https://reviews.apache.org/r/67800/diff/1-2/


Testing
---


Thanks,

Deepak Jaiswal

Re: Review Request 67800: HIVE-20039

2018-07-02 Thread Deepak Jaiswal 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67800/#review205652
---




ql/src/java/org/apache/hadoop/hive/ql/optimizer/FixedBucketPruningOptimizer.java
Lines 90 (patched)


Is it even possible to change bucket count for a partition of in a table?
As far as I can see bucket number is a table wide property.


- Deepak Jaiswal


On July 3, 2018, 12:23 a.m., Deepak Jaiswal wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/67800/
> ---
> 
> (Updated July 3, 2018, 12:23 a.m.)
> 
> 
> Review request for hive and Gopal V.
> 
> 
> Bugs: HIVE-20039
> https://issues.apache.org/jira/browse/HIVE-20039
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Bucket pruning: Left Outer Join on bucketed table gives wrong result.
> The context was reused by all the predicates. Instead use TS op directly.
> 
> 
> Diffs
> -
> 
>   
> data/files/bucket_pruning/l3_clarity__l3_monthly_dw_factplan_datajoin_1_s2_2018022300104_1/00_0
>  PRE-CREATION 
>   
> data/files/bucket_pruning/l3_clarity__l3_monthly_dw_factplan_dw_stg_2018022300104_1/00_0
>  PRE-CREATION 
>   data/files/bucket_pruning/l3_clarity__l3_snap_number_2018022300104/00_0 
> PRE-CREATION 
>   data/files/bucket_pruning/l3_monthly_dw_dimplan/56_0 PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/FixedBucketPruningOptimizer.java
>  2debacacb5 
>   ql/src/test/queries/clientpositive/tez_fixed_bucket_pruning.q PRE-CREATION 
>   ql/src/test/results/clientpositive/llap/tez_fixed_bucket_pruning.q.out 
> PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/67800/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Deepak Jaiswal
> 
>

[jira] [Created] (HIVE-20062) TestReplicationScenarios doesn't clean injection properly, causing bizarre interdependent failures

2018-07-02 Thread Sergey Shelukhin (JIRA) 
Sergey Shelukhin created HIVE-20062:
---

 Summary: TestReplicationScenarios doesn't clean injection 
properly, causing bizarre interdependent failures
 Key: HIVE-20062
 URL: https://issues.apache.org/jira/browse/HIVE-20062
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Sergey Shelukhin






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20061) add a flag to turn off txn stats

2018-07-02 Thread Sergey Shelukhin (JIRA) 
Sergey Shelukhin created HIVE-20061:
---

 Summary: add a flag to turn off txn stats
 Key: HIVE-20061
 URL: https://issues.apache.org/jira/browse/HIVE-20061
 Project: Hive
  Issue Type: Sub-task
Reporter: Sergey Shelukhin






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 67800: HIVE-20039

2018-07-02 Thread Gopal V 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67800/#review205649
---




ql/src/java/org/apache/hadoop/hive/ql/optimizer/FixedBucketPruningOptimizer.java
Lines 90 (patched)


This needs the pruned partition list loop (to make sure all partitions have 
the same bucket-count).

This is probably something we can prevent from happening in Bucketing 
version = 2 so that tables with new bucketing version will never allow an 

ALTER TABLE clustered by (id) buckets 

from changing a partition's bucket count.


- Gopal V


On July 3, 2018, 12:23 a.m., Deepak Jaiswal wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/67800/
> ---
> 
> (Updated July 3, 2018, 12:23 a.m.)
> 
> 
> Review request for hive and Gopal V.
> 
> 
> Bugs: HIVE-20039
> https://issues.apache.org/jira/browse/HIVE-20039
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Bucket pruning: Left Outer Join on bucketed table gives wrong result.
> The context was reused by all the predicates. Instead use TS op directly.
> 
> 
> Diffs
> -
> 
>   
> data/files/bucket_pruning/l3_clarity__l3_monthly_dw_factplan_datajoin_1_s2_2018022300104_1/00_0
>  PRE-CREATION 
>   
> data/files/bucket_pruning/l3_clarity__l3_monthly_dw_factplan_dw_stg_2018022300104_1/00_0
>  PRE-CREATION 
>   data/files/bucket_pruning/l3_clarity__l3_snap_number_2018022300104/00_0 
> PRE-CREATION 
>   data/files/bucket_pruning/l3_monthly_dw_dimplan/56_0 PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/FixedBucketPruningOptimizer.java
>  2debacacb5 
>   ql/src/test/queries/clientpositive/tez_fixed_bucket_pruning.q PRE-CREATION 
>   ql/src/test/results/clientpositive/llap/tez_fixed_bucket_pruning.q.out 
> PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/67800/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Deepak Jaiswal
> 
>

Review Request 67801: HIVE-19337 Partition whitelist regex doesn't work (and never did)

2018-07-02 Thread Alexander Kolbasov 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67801/
---

Review request for hive, Andrew Sherman, Janaki Lahorani, Peter Vary, Sahil 
Takiar, and Vihang Karajgaonkar.


Bugs: HIVE-19337
https://issues.apache.org/jira/browse/HIVE-19337


Repository: hive-git


Description
---

HIVE-19337 Partition whitelist regex doesn't work (and never did)


Diffs
-

  metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 
ba46e63839e4b02d325007b16756ccd8f3240f63 


Diff: https://reviews.apache.org/r/67801/diff/1/


Testing
---


Thanks,

Alexander Kolbasov

Review Request 67800: HIVE-20039

2018-07-02 Thread Deepak Jaiswal 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67800/
---

Review request for hive and Gopal V.


Bugs: HIVE-20039
https://issues.apache.org/jira/browse/HIVE-20039


Repository: hive-git


Description
---

Bucket pruning: Left Outer Join on bucketed table gives wrong result.
The context was reused by all the predicates. Instead use TS op directly.


Diffs
-

  
data/files/bucket_pruning/l3_clarity__l3_monthly_dw_factplan_datajoin_1_s2_2018022300104_1/00_0
 PRE-CREATION 
  
data/files/bucket_pruning/l3_clarity__l3_monthly_dw_factplan_dw_stg_2018022300104_1/00_0
 PRE-CREATION 
  data/files/bucket_pruning/l3_clarity__l3_snap_number_2018022300104/00_0 
PRE-CREATION 
  data/files/bucket_pruning/l3_monthly_dw_dimplan/56_0 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/FixedBucketPruningOptimizer.java
 2debacacb5 
  ql/src/test/queries/clientpositive/tez_fixed_bucket_pruning.q PRE-CREATION 
  ql/src/test/results/clientpositive/llap/tez_fixed_bucket_pruning.q.out 
PRE-CREATION 


Diff: https://reviews.apache.org/r/67800/diff/1/


Testing
---


Thanks,

Deepak Jaiswal

[DISCUSS] Storage-API 2.7 release

2018-07-02 Thread Deepak Jaiswal 
All,

The upcoming branch-3.1 will need changes from storage-api. I propose to create 
new release of storage-api.
Please let me know your thoughts on this. I am working on the release candidate.

Regards,
Deepak

Re: Review Request 67731: HIVE-19902: Provide Metastore micro-benchmarks

2018-07-02 Thread Alexander Kolbasov 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67731/
---

(Updated July 2, 2018, 11:42 p.m.)


Review request for hive, Andrew Sherman, Alan Gates, Janaki Lahorani, Marta 
Kuczora, Peter Vary, Sahil Takiar, and Vihang Karajgaonkar.


Changes
---

Re-merged with master and added option to list benchmarks


Bugs: HIVE-19902
https://issues.apache.org/jira/browse/HIVE-19902


Repository: hive-git


Description
---

HIVE-19902: Provide Metastore micro-benchmarks


Diffs (updated)
-

  metastore-tools/data/conf/.keepme PRE-CREATION 
  metastore-tools/metastore-benchmarks/README.md PRE-CREATION 
  metastore-tools/metastore-benchmarks/pom.xml PRE-CREATION 
  
metastore-tools/metastore-benchmarks/src/main/java/org/apache/hadoop/hive/metastore/tools/BenchData.java
 PRE-CREATION 
  
metastore-tools/metastore-benchmarks/src/main/java/org/apache/hadoop/hive/metastore/tools/BenchmarkSuite.java
 PRE-CREATION 
  
metastore-tools/metastore-benchmarks/src/main/java/org/apache/hadoop/hive/metastore/tools/BenchmarkTool.java
 PRE-CREATION 
  
metastore-tools/metastore-benchmarks/src/main/java/org/apache/hadoop/hive/metastore/tools/HMSBenchmarks.java
 PRE-CREATION 
  
metastore-tools/metastore-benchmarks/src/main/java/org/apache/hadoop/hive/metastore/tools/MicroBenchmark.java
 PRE-CREATION 
  metastore-tools/metastore-benchmarks/src/main/resources/log4j.properties 
PRE-CREATION 
  metastore-tools/metastore-benchmarks/src/main/resources/log4j2.xml 
PRE-CREATION 
  metastore-tools/metastore-cli/README.md PRE-CREATION 
  metastore-tools/metastore-cli/pom.xml PRE-CREATION 
  
metastore-tools/metastore-cli/src/main/java/org/apache/hadoop/hive/metastore/tools/HMSTool.java
 PRE-CREATION 
  metastore-tools/pom.xml PRE-CREATION 
  metastore-tools/tools-common/pom.xml PRE-CREATION 
  
metastore-tools/tools-common/src/main/java/org/apache/hadoop/hive/metastore/tools/Constants.java
 PRE-CREATION 
  
metastore-tools/tools-common/src/main/java/org/apache/hadoop/hive/metastore/tools/HMSClient.java
 PRE-CREATION 
  
metastore-tools/tools-common/src/main/java/org/apache/hadoop/hive/metastore/tools/Util.java
 PRE-CREATION 
  
metastore-tools/tools-common/src/test/java/org/apache/hadoop/hive/metastore/tools/HMSClientTest.java
 PRE-CREATION 
  
metastore-tools/tools-common/src/test/java/org/apache/hadoop/hive/metastore/tools/UtilTest.java
 PRE-CREATION 
  pom.xml 5202248315f771385aa0aaa0d13907f00f3e329d 


Diff: https://reviews.apache.org/r/67731/diff/2/

Changes: https://reviews.apache.org/r/67731/diff/1-2/


Testing
---


Thanks,

Alexander Kolbasov

[GitHub] hive pull request #389: HIVE-20001: With doas set to true, running select qu...

2018-07-02 Thread beltran 
GitHub user beltran opened a pull request:

https://github.com/apache/hive/pull/389

HIVE-20001: With doas set to true, running select query as hrt_qa use…

…r on external table fails due to permission denied to read 
/warehouse/tablespace/managed directory

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/beltran/hive HIVE-20001-3

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/389.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #389


commit 764d76de31f83b2c5985ad29410135faf4e32998
Author: Jaume Marhuenda 
Date:   2018-07-01T03:47:15Z

HIVE-20001: With doas set to true, running select query as hrt_qa user on 
external table fails due to permission denied to read 
/warehouse/tablespace/managed directory




---

[jira] [Created] (HIVE-20060) Refactor HiveSchemaTool and MetastoreSchemaTool

2018-07-02 Thread Alan Gates (JIRA) 
Alan Gates created HIVE-20060:
-

 Summary: Refactor HiveSchemaTool and MetastoreSchemaTool
 Key: HIVE-20060
 URL: https://issues.apache.org/jira/browse/HIVE-20060
 Project: Hive
  Issue Type: Task
  Components: Beeline, Metastore
Reporter: Alan Gates
Assignee: Alan Gates


These two classes are 95% the same.  Now that HIVE-19711 has split 
HiveSchemaTool into multiple components it will be much easier to refactor 
these so that there is only one version of the code that each shares.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20059) Hive streaming should try shade prefix unconditionally on exception

2018-07-02 Thread Prasanth Jayachandran (JIRA) 
Prasanth Jayachandran created HIVE-20059:


 Summary: Hive streaming should try shade prefix unconditionally on 
exception
 Key: HIVE-20059
 URL: https://issues.apache.org/jira/browse/HIVE-20059
 Project: Hive
  Issue Type: Bug
  Components: Streaming
Affects Versions: 3.1.0, 4.0.0, 3.2.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran
 Attachments: HIVE-20059.1.patch

AbstractRecordWriter tries hive.classloader.shade.prefix on 
ClassNotFoundException but there are instances where OrcOutputFormat from old 
hive version gets loaded resulting in ClassCastException. I think we should try 
shadeprefix when defined and when any exception is thrown. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] hive pull request #388: HIVE-20057: Fix Hive table conversion DESCRIBE table...

2018-07-02 Thread animenon 
GitHub user animenon opened a pull request:

https://github.com/apache/hive/pull/388

HIVE-20057: Fix Hive table conversion DESCRIBE table bug

Fix for #HIVE-20057

Issue: `Table Type` wrongly shown as `MANAGED_TABLE` after converting table 
from MANAGED to EXTERNAL using ` ALTER TABLE t SET TBLPROPERTIES 
('EXTERNAL'='True')` 

_(this is shown correctly only for `'EXTERNAL'='TRUE`)_


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/animenon/hive patch-1

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/388.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #388


commit 1a9674645c3b4e3080f5278f6bea3126b1cebbac
Author: Anirudh 
Date:   2018-07-02T19:53:03Z

HIVE-20057: Fix Hive table conversion DESCRIBE table bug

`equals` to `equalsIgnoreCase`




---

[jira] [Created] (HIVE-20058) Backport HIVE-19711 (HiveSchemaTool refactor) to branch-3

2018-07-02 Thread Alan Gates (JIRA) 
Alan Gates created HIVE-20058:
-

 Summary: Backport HIVE-19711 (HiveSchemaTool refactor) to branch-3
 Key: HIVE-20058
 URL: https://issues.apache.org/jira/browse/HIVE-20058
 Project: Hive
  Issue Type: Task
  Components: Beeline
Reporter: Alan Gates
Assignee: Alan Gates






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] hive pull request #387: HIVE-20001: With doas set to true, running select qu...

2018-07-02 Thread beltran 
Github user beltran closed the pull request at:

https://github.com/apache/hive/pull/387


---

[jira] [Created] (HIVE-20057) or ALTER TABLE t SET TBLPROPERTIES ('EXTERNAL'='TRUE'); `TBL_TYPE` attribute change

2018-07-02 Thread Anirudh (JIRA) 
Anirudh created HIVE-20057:
--

 Summary: or ALTER TABLE t SET TBLPROPERTIES ('EXTERNAL'='TRUE'); 
`TBL_TYPE` attribute change
 Key: HIVE-20057
 URL: https://issues.apache.org/jira/browse/HIVE-20057
 Project: Hive
  Issue Type: Bug
  Components: Standalone Metastore
Affects Versions: All Versions
Reporter: Anirudh
Assignee: Anirudh


Hive EXTERNAL table shown as MANAGED after conversion using 

 

    ALTER TABLE t SET TBLPROPERTIES ('EXTERNAL'='TRUE')

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20056) SparkPartitionPruner shouldn't be triggered by Spark tasks

2018-07-02 Thread Sahil Takiar (JIRA) 
Sahil Takiar created HIVE-20056:
---

 Summary: SparkPartitionPruner shouldn't be triggered by Spark tasks
 Key: HIVE-20056
 URL: https://issues.apache.org/jira/browse/HIVE-20056
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Sahil Takiar
Assignee: Sahil Takiar


It looks like {{SparkDynamicPartitionPruner}} is being called by every Spark 
task because it gets created whenever {{getRecordReader}} is called on the 
associated {{InputFormat}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20055) SQL injection via metastore ACID APIs (and maybe queries, although that's unlikely)

2018-07-02 Thread Sergey Shelukhin (JIRA) 
Sergey Shelukhin created HIVE-20055:
---

 Summary: SQL injection via metastore ACID APIs (and maybe queries, 
although that's unlikely)
 Key: HIVE-20055
 URL: https://issues.apache.org/jira/browse/HIVE-20055
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Thejas M Nair


[~thejas] asked me to create this JIRA based on my earlier email :)

{noformat}
This might be doable with a specially crafted query, I’m not sure what APIs 
calls have what checks (e.g. via Hive parser) that would prevent the below.
However, for remote metastore (default on many clusters currently, afaik it’s 
the default for ACID) we expose thrift API that accepts strings e.g. 
get_valid_write_ids.
That passes the string table names to TxnHandler::getValidWriteIdsForTable, 
that inserts them into the query string w/quoteString call; quoteString doesn’t 
do any validation.

Some ready made delete statements also exist e.g.  "delete from REPL_TXN_MAP 
where RTM_SRC_TXN_ID = " + sourceTxnId + " and RTM_REPL_POLICY = " + 
quoteString(rqst.getReplPolicy());
I think my replication policy might be {' OR '1' = '1} ;)

So, SQL injection might be possible thru these APIs.
I wonder if this class should be switched to parameter based execution? 
DirectSQL could be used as an example, although that uses DataNucleus direct 
sql feature… at least we need some checks on these.
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20054) Propagate ExecutionExceptions from the driver thread to the client

2018-07-02 Thread Sahil Takiar (JIRA) 
Sahil Takiar created HIVE-20054:
---

 Summary: Propagate ExecutionExceptions from the driver thread to 
the client
 Key: HIVE-20054
 URL: https://issues.apache.org/jira/browse/HIVE-20054
 Project: Hive
  Issue Type: Sub-task
Reporter: Sahil Takiar


In {{AbstractSparkClient}} we have the following code:

{code:java}
   try {
  driverFuture.get();
} catch (InterruptedException ie) {
  // Give up.
  LOG.warn("Interrupted before driver thread was finished.", ie);
} catch (ExecutionException ee) {
  LOG.error("Driver thread failed", ee);
}
{code}

If the driver {{Future}} throws an {{ExecutionException}} the error is simply 
logged, and a {{RuntimeException}} is thrown with the generic message "Error 
while waiting for Remote Spark Driver to connect back to HiveServer2."

We should propagate the {{ExecutionException}} to the client.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20053) Separate Hive Security from SessionState

2018-07-02 Thread Aihua Xu (JIRA) 
Aihua Xu created HIVE-20053:
---

 Summary: Separate Hive Security from SessionState
 Key: HIVE-20053
 URL: https://issues.apache.org/jira/browse/HIVE-20053
 Project: Hive
  Issue Type: Improvement
  Components: Security
Affects Versions: 3.0.0
Reporter: Aihua Xu


Right now we have Hive security classes associated with SessionState. When 
HiveServer2 starts, the service session will initialize it and later each 
session will need to reinitialize it. Since such security configuration is on 
service level, we should move security info out out SessionState and make it 
Singleton so we can initialize it once.

And also, since SessionState.setupAuth()  - to setup authentication and 
authorization is not synchronized, we could run into concurrency issue if 
queries or meta operations are run within same session. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 67636: HIVE-19176 : Add HoS support to progress bar on Beeline client.

2018-07-02 Thread Sahil Takiar 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67636/#review205643
---


Ship it!




Ship It!

- Sahil Takiar


On June 22, 2018, 8:01 p.m., Bharathkrishna Guruvayoor Murali wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/67636/
> ---
> 
> (Updated June 22, 2018, 8:01 p.m.)
> 
> 
> Review request for hive, Peter Vary, Sahil Takiar, and Vihang Karajgaonkar.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> This logic is similar to the RenderStrategy used in Tez to print the progress 
> bar.
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
> e7f5fc0c6a3d527671c354db8ef2c9772aab6dd0 
>   jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java 
> ad8d1a7f1cca3a763bb7c07335998ab7d39d7598 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/LocalSparkJobMonitor.java
>  2a6c33bfd4824c96e7004cd1ecce48c62c97d685 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/RemoteSparkJobMonitor.java
>  004b50ba95934280cf302055a46a5d984b421e07 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/RenderStrategy.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobMonitor.java 
> 3531ac25a9959aacd5766a9a42316890c68a1cd5 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/spark/TestSparkTask.java 
> 368fa9f1fa3ccc8b78cc4f9e98acf352cbc1c4c3 
>   
> ql/src/test/org/apache/hadoop/hive/ql/exec/spark/status/TestSparkJobMonitor.java
>  e66354f0869738bd3cf0eb831c13fa6af1eda256 
>   service/src/java/org/apache/hive/service/ServiceUtils.java 
> 226e43244df10c22143b91f92ef312e56739d036 
>   
> service/src/java/org/apache/hive/service/cli/SparkProgressMonitorStatusMapper.java
>  PRE-CREATION 
>   service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java 
> 68fe8d8aa143fafbfc611253ce3a12065016a537 
> 
> 
> Diff: https://reviews.apache.org/r/67636/diff/3/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Bharathkrishna Guruvayoor Murali
> 
>

[GitHub] hive pull request #387: HIVE-20001: With doas set to true, running select qu...

2018-07-02 Thread beltran 
GitHub user beltran opened a pull request:

https://github.com/apache/hive/pull/387

HIVE-20001: With doas set to true, running select query as hrt_qa use…

…r on external table fails due to permission denied to read 
/warehouse/tablespace/managed directory

Special attention to whether the appropriate create/upgrade sql scripts  
have been modified.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/beltran/hive HIVE-20001-2

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/387.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #387


commit 7b722374af80172f947f78a80a11565d13ddd4a7
Author: Jaume Marhuenda 
Date:   2018-07-01T03:47:15Z

HIVE-20001: With doas set to true, running select query as hrt_qa user on 
external table fails due to permission denied to read 
/warehouse/tablespace/managed directory




---

[GitHub] hive pull request #386: HIVE-20052: Arrow serde should fill ArrowColumnVecto...

2018-07-02 Thread pudidic 
GitHub user pudidic opened a pull request:

https://github.com/apache/hive/pull/386

HIVE-20052: Arrow serde should fill ArrowColumnVector(Decimal) with t…

…he given schema precision/scale (Teddy Choi)

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/pudidic/hive HIVE-20052

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/386.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #386


commit 574485f81609820601bb20557de50143ec56a0d7
Author: Teddy Choi 
Date:   2018-07-02T16:41:40Z

HIVE-20052: Arrow serde should fill ArrowColumnVector(Decimal) with the 
given schema precision/scale (Teddy Choi)




---

[jira] [Created] (HIVE-20052) Arrow serde should fill ArrowColumnVector(Decimal) with the given schema precision/scale

2018-07-02 Thread Teddy Choi (JIRA) 
Teddy Choi created HIVE-20052:
-

 Summary: Arrow serde should fill ArrowColumnVector(Decimal) with 
the given schema precision/scale
 Key: HIVE-20052
 URL: https://issues.apache.org/jira/browse/HIVE-20052
 Project: Hive
  Issue Type: Bug
  Components: Serializers/Deserializers
Reporter: Teddy Choi
Assignee: Teddy Choi


Arrow serde should fill ArrowColumnVector with given precision and scale. When 
it serializes negative values into Arrow, it throws exceptions that the 
precision of the value is not same with the precision of Arrow decimal vector.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HIVE-20051) Skip authorization for temp tables

2018-07-02 Thread Zoltan Haindrich (JIRA) 
Zoltan Haindrich created HIVE-20051:
---

 Summary: Skip authorization for temp tables
 Key: HIVE-20051
 URL: https://issues.apache.org/jira/browse/HIVE-20051
 Project: Hive
  Issue Type: Bug
Reporter: Zoltan Haindrich
Assignee: Zoltan Haindrich






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] hive pull request #385: HIVE-17840: HiveMetaStore eats exception if transact...

2018-07-02 Thread sankarh 
GitHub user sankarh opened a pull request:

https://github.com/apache/hive/pull/385

HIVE-17840: HiveMetaStore eats exception if 
transactionalListeners.notifyEvent fail.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sankarh/hive HIVE-17840

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/385.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #385


commit 0dbccfe51b83fa1f1842d96fb133be0c5bef4ebf
Author: Sankar Hariappan 
Date:   2018-07-02T11:09:51Z

HIVE-17840: HiveMetaStore eats exception if 
transactionalListeners.notifyEvent fail.




---