Rajesh Balamohan created HIVE-13735:
---------------------------------------
Summary: Query involving only partition columns need not launch
mr/tez job
Key: HIVE-13735
URL: https://issues.apache.org/jira/browse/HIVE-13735
Project: Hive
Issue Type: Bug
Reporter: Rajesh Balamohan
codebase: hive master
dataset: tpc-ds 10 TB scale
e.g queries:
{noformat}
hive> show partitions web_sales;
...
...
Time taken: 0.13 seconds, Fetched: 1824 row(s)
hive> select distinct ws_sold_date_sk from web_sales;
----------------------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING
FAILED KILLED
----------------------------------------------------------------------------------------------
Map 1 .......... container SUCCEEDED 1 1 0 0
0 0
Reducer 2 ...... container SUCCEEDED 1 1 0 0
0 0
----------------------------------------------------------------------------------------------
VERTICES: 02/02 [==========================>>] 100% ELAPSED TIME: 2.70 s
----------------------------------------------------------------------------------------------
Status: DAG finished successfully in 2.70 seconds
..
Time taken: 3.964 seconds, Fetched: 1824 row(s)
hive> select distinct ws_sold_date_sk from web_sales order by ws_sold_date_sk;
----------------------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING
FAILED KILLED
----------------------------------------------------------------------------------------------
Map 1 .......... container SUCCEEDED 801 801 0 0
0 0
Reducer 2 ...... container SUCCEEDED 1 1 0 0
0 0
Reducer 3 ...... container SUCCEEDED 1 1 0 0
0 0
----------------------------------------------------------------------------------------------
VERTICES: 03/03 [==========================>>] 100% ELAPSED TIME: 23.05 s
----------------------------------------------------------------------------------------------
Status: DAG finished successfully in 23.05 seconds
...
Time taken: 27.095 seconds, Fetched: 1824 row(s)
{noformat}
since the info is already available in metastore, it might not need to launch
these jobs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
