[jira] [Created] (HIVE-9821) Having the consistent physical execution plan , which using explain command with disable CBO and enable CBO.
asko created HIVE-9821:
--
Summary: Having the consistent physical execution plan , which
using explain command with disable CBO and enable CBO.
Key: HIVE-9821
URL: https://issues.apache.org/jira/browse/HIVE-9821
Project: Hive
Issue Type: Bug
Components: CBO
Affects Versions: 0.14.0
Reporter: asko
Priority: Critical
bq. Test case is( JOIN sub tree had been flatten after CBO in final plan stage
of calcite optimizer) :
{quote}
--set hive.cbo.enable=true;
--ANALYZE TABLE customer COMPUTE STATISTICS for columns;
--ANALYZE TABLE orders COMPUTE STATISTICS for columns;
--ANALYZE TABLE lineitem COMPUTE STATISTICS for columns;
--ANALYZE TABLE region COMPUTE STATISTICS for columns;
--ANALYZE TABLE supplier COMPUTE STATISTICS for columns;
--ANALYZE TABLE partsupp COMPUTE STATISTICS for columns;
--ANALYZE TABLE part COMPUTE STATISTICS for columns;
--ANALYZE TABLE nation COMPUTE STATISTICS for columns;
explain select
o_year, sum(case when nation = 'BRAZIL' then volume else 0.0 end) /
sum(volume) as mkt_share
from
(
select
year(o_orderdate) as o_year, l_extendedprice * (1-l_discount) as volume,
n2.n_name as nation
from
nation n1 join region r
on n1.n_regionkey = r.r_regionkey and r.r_name = 'AMERICA'
join customer c
on c.c_nationkey = n1.n_nationkey
join orders o
on c.c_custkey = o.o_custkey
join lineitem l
on l.l_orderkey = o.o_orderkey and o.o_orderdate = '1995-01-01'
and o.o_orderdate '1996-12-31'
join part p
on p.p_partkey = l.l_partkey and p.p_type = 'ECONOMY ANODIZED STEEL'
join supplier s
on s.s_suppkey = l.l_suppkey
join nation n2
on s.s_nationkey = n2.n_nationkey
) all_nation
group by o_year
order by o_year;
{quote}
bq. This test from had modified q8 in TPC-H_full . Uncomment could enable CBO.
twice run results are same :
{quote}
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-2 depends on stages: Stage-1, Stage-7
Stage-3 depends on stages: Stage-2, Stage-10
Stage-4 depends on stages: Stage-3
Stage-5 depends on stages: Stage-4
Stage-7 is a root stage
Stage-9 is a root stage
Stage-10 depends on stages: Stage-9, Stage-12
Stage-12 is a root stage
Stage-0 depends on stages: Stage-5
STAGE PLANS:
Stage: Stage-1
Map Reduce
Map Operator Tree:
TableScan
alias: l
Statistics: Num rows: 27137974 Data size: 759863296 Basic stats:
COMPLETE Column stats: NONE
Filter Operator
predicate: ((l_partkey is not null and l_suppkey is not null) and
l_orderkey is not null) (type: boolean)
Statistics: Num rows: 3392247 Data size: 94982919 Basic stats:
COMPLETE Column stats: NONE
Select Operator
expressions: l_orderkey (type: int), l_partkey (type: int),
l_suppkey (type: int), l_extendedprice (type: double), l_discount (type: double)
outputColumnNames: _col0, _col1, _col2, _col3, _col4
Statistics: Num rows: 3392247 Data size: 94982919 Basic stats:
COMPLETE Column stats: NONE
Reduce Output Operator
key expressions: _col1 (type: int)
sort order: +
Map-reduce partition columns: _col1 (type: int)
Statistics: Num rows: 3392247 Data size: 94982919 Basic
stats: COMPLETE Column stats: NONE
value expressions: _col0 (type: int), _col2 (type: int),
_col3 (type: double), _col4 (type: double)
TableScan
alias: p
Statistics: Num rows: 928322 Data size: 24136384 Basic stats:
COMPLETE Column stats: NONE
Filter Operator
predicate: ((p_type = 'ECONOMY ANODIZED STEEL') and p_partkey is
not null) (type: boolean)
Statistics: Num rows: 232081 Data size: 6034109 Basic stats:
COMPLETE Column stats: NONE
Select Operator
expressions: p_partkey (type: int)
outputColumnNames: _col0
Statistics: Num rows: 232081 Data size: 6034109 Basic stats:
COMPLETE Column stats: NONE
Reduce Output Operator
key expressions: _col0 (type: int)
sort order: +
Map-reduce partition columns: _col0 (type: int)
Statistics: Num rows: 232081 Data size: 6034109 Basic stats:
COMPLETE Column stats: NONE
Reduce Operator Tree:
Join Operator
condition map:
Inner Join 0 to 1
keys:
0 _col1 (type: int)
1 _col0 (type: int)
outputColumnNames: _col0, _col2, _col3, _col4
Statistics: Num rows: 3731471 Data size: 104481213 Basic stats:
COMPLETE Column stats: NONE
File Output Operator
compressed: false
table:
input format:
[jira] [Created] (HIVE-9820) LLAP: Use a share-nothing scoreboard /status implementation
Gopal V created HIVE-9820: - Summary: LLAP: Use a share-nothing scoreboard /status implementation Key: HIVE-9820 URL: https://issues.apache.org/jira/browse/HIVE-9820 Project: Hive Issue Type: Sub-task Reporter: Gopal V To prevent thread-conflicts in executor information, the Apache HTTP servers use a share-nothing data structure known as a scoreboard. This is read by various systems like mod_status to read out the current state of executors available for PHP (and similar mod_* engines). The /status output is traditionally periodically read by the load-balancers to route requests away from busy machines. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 31404: HIVE-9744 Move common arguments validation and value extraction code to GenericUDF
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31404/ --- (Updated Feb. 28, 2015, 1:38 a.m.) Review request for hive, Jason Dere and Thejas Nair. Changes --- rebase to the latest codebase Bugs: HIVE-9744 https://issues.apache.org/jira/browse/HIVE-9744 Repository: hive-git Description --- HIVE-9744 Move common arguments validation and value extraction code to GenericUDF Diffs (updated) - common/src/java/org/apache/hive/common/util/DateUtils.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDF.java 8a0f573648c51c4945be8ffec4a0b06dfa7061c8 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAddMonths.java c5968835a74195bea6b31a5c7b7346907fed5ce0 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFInitCap.java 406fcd608a13fadb8902bf273932acb05a0f3bbe ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLastDay.java 3a43c571ae3a83924a00413181a62ce6f4408125 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLevenshtein.java 4c9f9b1567c89e2175acd970ad12a1fd37492607 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFNextDay.java 38f08b74609a4018221ca3f5b92cf33799604d60 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFAddMonths.java 4ccae97a227257294d69f728426f425d060ef0c7 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFLastDay.java 4b233a6966bbdf6902c53f2aaf53cc0eb422b205 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFLevenshtein.java 5346e45a6befb18f63ea24212295016fe06f2ca0 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFNextDay.java e2ec551d4ae39d521680ee93c791f14f27811270 ql/src/test/results/clientnegative/udf_add_months_error_1.q.out 8226ac6fe89c38fcc14edeea215cd5cce7258683 ql/src/test/results/clientnegative/udf_add_months_error_2.q.out f00949e9a12285cc91032215372975753c1f3b4a ql/src/test/results/clientnegative/udf_last_day_error_1.q.out 6e718a0c15e84d89b1cfe7f36231e472ff03c37f ql/src/test/results/clientnegative/udf_last_day_error_2.q.out dc8e3d14f14205ce65355cd53a95cfc788f45fe0 ql/src/test/results/clientnegative/udf_next_day_error_1.q.out c67b9c42f7e7fdf20caa34d028b02fd4819e8343 ql/src/test/results/clientnegative/udf_next_day_error_2.q.out e3cb6a447bf7bd9f09648e46ace1bcba4da55339 Diff: https://reviews.apache.org/r/31404/diff/ Testing --- Thanks, Alexander Pivovarov
[jira] [Created] (HIVE-9811) Hive on Tez leaks WorkMap objects
Oleg Danilov created HIVE-9811: -- Summary: Hive on Tez leaks WorkMap objects Key: HIVE-9811 URL: https://issues.apache.org/jira/browse/HIVE-9811 Project: Hive Issue Type: Bug Components: Tez Reporter: Oleg Danilov TezTask doesn't fully clean gWorkMap, so as result Hive leaks WorkMap objects. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 30437: Implement MONTHS_BETWEEN aligned with Oracle one
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30437/ --- (Updated Feb. 27, 2015, 6:45 p.m.) Review request for hive. Changes --- patch V4, addressed most recent comments. Repository: hive-git Description --- This is used to track work to build Oracle like months_between. Here's semantics: MONTHS_BETWEEN returns number of months between dates date1 and date2. If date1 is later than date2, then the result is positive. If date1 is earlier than date2, then the result is negative. If date1 and date2 are either the same days of the month or both last days of months, then the result is always an integer. Otherwise Oracle Database calculates the fractional portion of the result based on a 31-day month and considers the difference in time components date1 and date2. https://issues.apache.org/jira/browse/HIVE-9518 Diffs (updated) - ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java bfeb33c ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFDateDiff.java 403cf11 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFDateDiffBase.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFMonthsBetween.java PRE-CREATION ql/src/test/org/apache/hadoop/hive/ql/udf/TestGenericUDFMonthsBetween.java PRE-CREATION ql/src/test/queries/clientnegative/udf_datediff_error1.q PRE-CREATION ql/src/test/queries/clientnegative/udf_datediff_error2.q PRE-CREATION ql/src/test/queries/clientnegative/udf_months_between_error1.q PRE-CREATION ql/src/test/queries/clientnegative/udf_months_between_error2.q PRE-CREATION ql/src/test/queries/clientpositive/udf_datediff.q 30718fe ql/src/test/queries/clientpositive/udf_months_between.q PRE-CREATION ql/src/test/results/clientnegative/udf_datediff_error1.q.out PRE-CREATION ql/src/test/results/clientnegative/udf_datediff_error2.q.out PRE-CREATION ql/src/test/results/clientnegative/udf_months_between_error1.q.out PRE-CREATION ql/src/test/results/clientnegative/udf_months_between_error2.q.out PRE-CREATION ql/src/test/results/clientpositive/show_functions.q.out d4b0650 ql/src/test/results/clientpositive/show_functions.q.out.orig d79106f ql/src/test/results/clientpositive/udf_datediff.q.out 86f30f6 ql/src/test/results/clientpositive/udf_months_between.q.out PRE-CREATION Diff: https://reviews.apache.org/r/30437/diff/ Testing --- SEE ALSO ql/src/test/TestGenericUDFMonthsBetween.java Thanks, XIAOBING ZHOU
[jira] [Created] (HIVE-9812) Merge trunk to Spark branch 02/27/2015 [Spark Branch]
Xuefu Zhang created HIVE-9812: - Summary: Merge trunk to Spark branch 02/27/2015 [Spark Branch] Key: HIVE-9812 URL: https://issues.apache.org/jira/browse/HIVE-9812 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Xuefu Zhang Assignee: Xuefu Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 31530: HIVE-9809 Fix FindBugs found bugs in hive-exec
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31530/ --- (Updated Feb. 27, 2015, 7:27 p.m.) Review request for hive, Brock Noland, Alan Gates, Jason Dere, Thejas Nair, and Xuefu Zhang. Changes --- removed changes in *Desc and *Operator clases Bugs: HIVE-9809 https://issues.apache.org/jira/browse/HIVE-9809 Repository: hive-git Description --- HIVE-9809 Fix FindBugs found bugs in hive-exec Diffs (updated) - ql/src/java/org/apache/hadoop/hive/ql/QueryPlan.java 8e1e6e2b4f29a2499845df1f565dbb6859b262a8 ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 089bd941f391f33ead3bd638854624fe20186065 ql/src/java/org/apache/hadoop/hive/ql/exec/DefaultUDAFEvaluatorResolver.java c2f9fa78db3a233fe9d53d641b3956c9a863d53c ql/src/java/org/apache/hadoop/hive/ql/exec/DemuxOperator.java 48ce67ad8bbea0fd32a306e6ac0bd8676438f65b ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionTask.java a5722bfcb195139761b03443841bdcd3f37b5b1a ql/src/java/org/apache/hadoop/hive/ql/exec/ScriptOperator.java 6f6f5fa6fe8e84d62f1a0e6ac191f82b488b7554 ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java d0693efb1b95353497fdc67f0684a1549e5faa14 ql/src/java/org/apache/hadoop/hive/ql/exec/mr/HadoopJobExecHelper.java 6a6593c3ac4890d7e169b5af6608aee66679933a ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkUtilities.java a93f1f21a7ec10b58713678fdd0a31307f6fb182 ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobMonitor.java b7e81423233bebedad04fdeaa7aa228e407df335 ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezJobMonitor.java 64b1e420a1447e5548fb0beb395758bd461f4675 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/CuckooSetBytes.java fe75ce3d3b14b84d023612c00554729e793dc677 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/CuckooSetLong.java 5779fb35d7ffbc67917cdcd66b1c57baa3e2bff3 ql/src/java/org/apache/hadoop/hive/ql/io/VectorizedRCFileRecordReader.java 597aef6af1bfcf228bc39103c204330337641678 ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/CorrelationUtilities.java 17364c3c78189b48b57dcb17c3fe7828204cd80f ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/ListBucketingPruner.java 33b6e8614372fa41f368867088ad87ac4c41a339 ql/src/java/org/apache/hadoop/hive/ql/plan/AbstractOperatorDesc.java 52280ccce9742ab03cea6c7957da17752c0b404e ql/src/java/org/apache/hadoop/hive/ql/plan/BaseWork.java 1737a347fbb5237774d7661498246a37139103b1 ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/Initiator.java 0249a1c098e2b9b363ebadffb9d6278c59f33119 ql/src/java/org/apache/hadoop/hive/ql/udf/UDFJson.java 66778e049f4dde82b0ea96ba5c5b9282ff01c0bd ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/WindowingTableFunction.java cebaf45cdb1094238624d5fde018a3bdaf19c2f0 ql/src/test/org/apache/hadoop/hive/ql/exec/vector/TestVectorizedRowBatch.java 78cd5cd0234792fa0d9c1ed4e9acadca182f8d8d ql/src/test/org/apache/hadoop/hive/ql/exec/vector/TestVectorizedRowBatchCtx.java f7fea17b6037bab15fe53f8c8ef51e92c95de4e5 ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestFileDump.java 00afdac274d390dc6605c266b29a0ae490c54910 Diff: https://reviews.apache.org/r/31530/diff/ Testing --- Thanks, Alexander Pivovarov
Re: Review Request 30335: Build UDF TRUNC to implement FIRST_DAY as compared with LAST_DAY
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30335/ --- (Updated Feb. 27, 2015, 7:22 p.m.) Review request for hive. Changes --- 1. removed commented code block 2. remove redundant code, arguments[1] != null Repository: hive-git Description --- Hive already supports LAST_DAY UDF, in some cases, FIRST_DAY is necessary to do date/timestamp related computation. This JIRA is to track such an implementation. https://issues.apache.org/jira/browse/HIVE-9480 Diffs (updated) - ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java bfeb33c ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFTrunc.java PRE-CREATION ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFTrunc.java PRE-CREATION ql/src/test/queries/clientnegative/udf_trunc_error1.q PRE-CREATION ql/src/test/queries/clientnegative/udf_trunc_error2.q PRE-CREATION ql/src/test/queries/clientpositive/udf_trunc.q PRE-CREATION ql/src/test/results/clientnegative/udf_trunc_error1.q.out PRE-CREATION ql/src/test/results/clientnegative/udf_trunc_error2.q.out PRE-CREATION ql/src/test/results/clientpositive/show_functions.q.out d4b0650 ql/src/test/results/clientpositive/udf_trunc.q.out PRE-CREATION Diff: https://reviews.apache.org/r/30335/diff/ Testing --- Unit tests done in ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFFirstDay.java Thanks, XIAOBING ZHOU
[jira] [Created] (HIVE-9813) Hive JDBC - DatabaseMetaData.getColumns method cannot find classes added with add jar command
Yongzhi Chen created HIVE-9813:
--
Summary: Hive JDBC - DatabaseMetaData.getColumns method cannot
find classes added with add jar command
Key: HIVE-9813
URL: https://issues.apache.org/jira/browse/HIVE-9813
Project: Hive
Issue Type: Bug
Components: Metastore
Reporter: Yongzhi Chen
Execute following JDBC client program:
{code}
import java.sql.*;
public class TestAddJar {
private static Connection makeConnection(String connString, String
classPath) throws ClassNotFoundException, SQLException
{
System.out.println(Current Connection info: + connString);
Class.forName(classPath);
System.out.println(Current driver info: + classPath);
return DriverManager.getConnection(connString);
}
public static void main(String[] args)
{
if(2 != args.length)
{
System.out.println(Two arguments needed: connection string, path
to jar to be added (include jar name));
System.out.println(Example: java -jar TestApp.jar
jdbc:hive2://192.168.111.111 /tmp/json-serde-1.3-jar-with-dependencies.jar);
return;
}
Connection conn;
try
{
conn = makeConnection(args[0], org.apache.hive.jdbc.HiveDriver);
System.out.println(---);
System.out.println(DONE);
System.out.println(---);
System.out.println(Execute query: add jar + args[1] + ;);
Statement stmt = conn.createStatement();
int c = stmt.executeUpdate(add jar + args[1]);
System.out.println(Returned value is: [ + c + ]\n);
System.out.println(---);
final String createTableQry = Create table if not exists
json_test(id int, content string) +
row format serde 'org.openx.data.jsonserde.JsonSerDe';
System.out.println(Execute query: + createTableQry + ;);
stmt.execute(createTableQry);
System.out.println(---);
System.out.println(getColumn()
Call---\n);
DatabaseMetaData md = conn.getMetaData();
System.out.println(Test get all column in a schema:);
ResultSet rs = md.getColumns(Hive, default, json_test, null);
while (rs.next()) {
System.out.println(rs.getString(1));
}
conn.close();
}
catch (ClassNotFoundException e)
{
e.printStackTrace();
}
catch (SQLException e)
{
e.printStackTrace();
}
}
}
{code}
Get Exception, and from metastore log:
7:41:30.316 PM ERROR hive.log
error in initSerDe: java.lang.ClassNotFoundException Class
org.openx.data.jsonserde.JsonSerDe not found
java.lang.ClassNotFoundException: Class org.openx.data.jsonserde.JsonSerDe not
found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1803)
at
org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:183)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_fields(HiveMetaStore.java:2487)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_schema(HiveMetaStore.java:2542)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:105)
at com.sun.proxy.$Proxy5.get_schema(Unknown Source)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_schema.getResult(ThriftHiveMetastore.java:6425)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_schema.getResult(ThriftHiveMetastore.java:6409)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at
org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110)
at
org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:107)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:556)
at
org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118)
at
Re: Review Request 30437: Implement MONTHS_BETWEEN aligned with Oracle one
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30437/#review74555 --- ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFDateDiff.java https://reviews.apache.org/r/30437/#comment121151 remove spaces pls ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFDateDiff.java https://reviews.apache.org/r/30437/#comment121153 remove spaces pls ql/src/test/queries/clientpositive/udf_months_between.q https://reviews.apache.org/r/30437/#comment121155 remove spaces pls 88 89 ql/src/test/results/clientnegative/udf_months_between_error1.q.out https://reviews.apache.org/r/30437/#comment121156 1st instead of 1-th ql/src/test/queries/clientpositive/udf_datediff.q https://reviews.apache.org/r/30437/#comment121150 can you remove spaces pls? lines 90 91 ql/src/test/results/clientnegative/udf_datediff_error1.q.out https://reviews.apache.org/r/30437/#comment121158 1st instead of 1-th. ql/src/test/results/clientnegative/udf_datediff_error2.q.out https://reviews.apache.org/r/30437/#comment121157 1st instead of 1-th - Alexander Pivovarov On Feb. 27, 2015, 6:45 p.m., XIAOBING ZHOU wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30437/ --- (Updated Feb. 27, 2015, 6:45 p.m.) Review request for hive. Repository: hive-git Description --- This is used to track work to build Oracle like months_between. Here's semantics: MONTHS_BETWEEN returns number of months between dates date1 and date2. If date1 is later than date2, then the result is positive. If date1 is earlier than date2, then the result is negative. If date1 and date2 are either the same days of the month or both last days of months, then the result is always an integer. Otherwise Oracle Database calculates the fractional portion of the result based on a 31-day month and considers the difference in time components date1 and date2. https://issues.apache.org/jira/browse/HIVE-9518 Diffs - ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java bfeb33c ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFDateDiff.java 403cf11 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFDateDiffBase.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFMonthsBetween.java PRE-CREATION ql/src/test/org/apache/hadoop/hive/ql/udf/TestGenericUDFMonthsBetween.java PRE-CREATION ql/src/test/queries/clientnegative/udf_datediff_error1.q PRE-CREATION ql/src/test/queries/clientnegative/udf_datediff_error2.q PRE-CREATION ql/src/test/queries/clientnegative/udf_months_between_error1.q PRE-CREATION ql/src/test/queries/clientnegative/udf_months_between_error2.q PRE-CREATION ql/src/test/queries/clientpositive/udf_datediff.q 30718fe ql/src/test/queries/clientpositive/udf_months_between.q PRE-CREATION ql/src/test/results/clientnegative/udf_datediff_error1.q.out PRE-CREATION ql/src/test/results/clientnegative/udf_datediff_error2.q.out PRE-CREATION ql/src/test/results/clientnegative/udf_months_between_error1.q.out PRE-CREATION ql/src/test/results/clientnegative/udf_months_between_error2.q.out PRE-CREATION ql/src/test/results/clientpositive/show_functions.q.out d4b0650 ql/src/test/results/clientpositive/show_functions.q.out.orig d79106f ql/src/test/results/clientpositive/udf_datediff.q.out 86f30f6 ql/src/test/results/clientpositive/udf_months_between.q.out PRE-CREATION Diff: https://reviews.apache.org/r/30437/diff/ Testing --- SEE ALSO ql/src/test/TestGenericUDFMonthsBetween.java Thanks, XIAOBING ZHOU
[jira] [Created] (HIVE-9814) LLAP: JMX end points for monitoring metrics
Gopal V created HIVE-9814: - Summary: LLAP: JMX end points for monitoring metrics Key: HIVE-9814 URL: https://issues.apache.org/jira/browse/HIVE-9814 Project: Hive Issue Type: Sub-task Components: Diagnosability Affects Versions: llap Reporter: Gopal V Assignee: Gopal V -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 31404: HIVE-9744 Move common arguments validation and value extraction code to GenericUDF
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31404/#review74584 --- ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDF.java https://reviews.apache.org/r/31404/#comment121194 Hmm, this member ends up being a part of all GenericUDFs, but is only used by the methods that use these new convertDate methods. Makes me wonder if we should package these changes (plus array of Converters) as a separate utility class. What do you think of that? Not a necessary change, we can leave it as it is and can always revisit this later. - Jason Dere On Feb. 27, 2015, 12:11 a.m., Alexander Pivovarov wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31404/ --- (Updated Feb. 27, 2015, 12:11 a.m.) Review request for hive, Jason Dere and Thejas Nair. Bugs: HIVE-9744 https://issues.apache.org/jira/browse/HIVE-9744 Repository: hive-git Description --- HIVE-9744 Move common arguments validation and value extraction code to GenericUDF Diffs - ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDF.java 8a0f573648c51c4945be8ffec4a0b06dfa7061c8 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAddMonths.java c5968835a74195bea6b31a5c7b7346907fed5ce0 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFInitCap.java 406fcd608a13fadb8902bf273932acb05a0f3bbe ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLastDay.java 3a43c571ae3a83924a00413181a62ce6f4408125 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLevenstein.java de41793ba3925aa9e1ad9623d92881c57791f047 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFNextDay.java 38f08b74609a4018221ca3f5b92cf33799604d60 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFAddMonths.java 4ccae97a227257294d69f728426f425d060ef0c7 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFLastDay.java 4b233a6966bbdf6902c53f2aaf53cc0eb422b205 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFLevenshtein.java e674d9f38cf7b5cdffcad6eca07dba74ff1e834b ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFNextDay.java e2ec551d4ae39d521680ee93c791f14f27811270 ql/src/test/results/clientnegative/udf_add_months_error_1.q.out 8226ac6fe89c38fcc14edeea215cd5cce7258683 ql/src/test/results/clientnegative/udf_add_months_error_2.q.out f00949e9a12285cc91032215372975753c1f3b4a ql/src/test/results/clientnegative/udf_last_day_error_1.q.out 6e718a0c15e84d89b1cfe7f36231e472ff03c37f ql/src/test/results/clientnegative/udf_last_day_error_2.q.out dc8e3d14f14205ce65355cd53a95cfc788f45fe0 ql/src/test/results/clientnegative/udf_next_day_error_1.q.out c67b9c42f7e7fdf20caa34d028b02fd4819e8343 ql/src/test/results/clientnegative/udf_next_day_error_2.q.out e3cb6a447bf7bd9f09648e46ace1bcba4da55339 Diff: https://reviews.apache.org/r/31404/diff/ Testing --- Thanks, Alexander Pivovarov
[jira] [Created] (HIVE-9816) LLAP: Distinguish between memory used by executors and the cache
Siddharth Seth created HIVE-9816: Summary: LLAP: Distinguish between memory used by executors and the cache Key: HIVE-9816 URL: https://issues.apache.org/jira/browse/HIVE-9816 Project: Hive Issue Type: Sub-task Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: llap -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-9815) Metastote columnSERDE_PARAMS.PARAM_VALUE limited to 4000 bytes
Naveen Gangam created HIVE-9815:
---
Summary: Metastote columnSERDE_PARAMS.PARAM_VALUE limited to
4000 bytes
Key: HIVE-9815
URL: https://issues.apache.org/jira/browse/HIVE-9815
Project: Hive
Issue Type: Bug
Components: Metastore
Affects Versions: 0.14.0
Reporter: Naveen Gangam
Assignee: Naveen Gangam
Priority: Critical
Currently, in the hive metastore schema, the length of the column
SERDE_PARAMS.PARAM_VALUE is set to 4000 bytes. This is not enough for users
that have a key with a value larger than 4000 bytes. Say something like
hbase.columns.mapping.
I am not a database historian but appears that this limitation may have been
put in place because Oracle's varchar2 was restricted to 4k bytes for a long
time until recently.
According to the following documentation, even today Oracle DB's varchar2 only
supports a max size of 4000 unless a configuration parameter MAX_STRING_SIZE is
set to EXTENDED.
http://docs.oracle.com/database/121/SQLRF/sql_elements001.htm#SQLRF55623
{code}
MAX_STRING_SIZE=EXTENDED
{code}
Postgres supports a max of 1GB for character datatype according to
http://www.postgresql.org/docs/8.3/static/datatype-character.html
MySQL can support upto 65535 bytes for the entire row. So long as the PARAM_KEY
value + PARAM_VALUE is less than 65535, we should be good.
http://dev.mysql.com/doc/refman/5.0/en/char.html
SQL Server's varchar max length is 8000 and can go beyond using varchar(max).
http://dev.mysql.com/doc/refman/5.0/en/char.html
Derby's varchar can be upto 32672 bytes.
https://db.apache.org/derby/docs/10.7/ref/rrefsqlj41207.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Review Request 31560: HIVE-9817 fix DateFormat pattern in hive-exec
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31560/ --- Review request for hive. Bugs: HIVE-9817 https://issues.apache.org/jira/browse/HIVE-9817 Repository: hive-git Description --- HIVE-9817 fix DateFormat pattern in hive-exec Diffs - ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 04864b97c9d4ed13b4249297d6c5e90fcc54a931 ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java 9f3df991d6e8f450cdada28ddb03449aac897487 ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/ASTBuilder.java 4b1f5c19ac95fea399aac694715c231ab4a2d03f Diff: https://reviews.apache.org/r/31560/diff/ Testing --- Thanks, Alexander Pivovarov
[jira] [Created] (HIVE-9817) fix DateFormat pattern in hive-exec
Alexander Pivovarov created HIVE-9817: - Summary: fix DateFormat pattern in hive-exec Key: HIVE-9817 URL: https://issues.apache.org/jira/browse/HIVE-9817 Project: Hive Issue Type: Bug Reporter: Alexander Pivovarov Assignee: Alexander Pivovarov Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Review Request 31530: HIVE-9809 Fix FindBugs found bugs in hive-exec
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31530/ --- Review request for hive, Brock Noland, Alan Gates, Jason Dere, Thejas Nair, and Xuefu Zhang. Bugs: HIVE-9809 https://issues.apache.org/jira/browse/HIVE-9809 Repository: hive-git Description --- HIVE-9809 Fix FindBugs found bugs in hive-exec Diffs - ql/src/java/org/apache/hadoop/hive/ql/QueryPlan.java 8e1e6e2b4f29a2499845df1f565dbb6859b262a8 ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 089bd941f391f33ead3bd638854624fe20186065 ql/src/java/org/apache/hadoop/hive/ql/exec/DefaultUDAFEvaluatorResolver.java c2f9fa78db3a233fe9d53d641b3956c9a863d53c ql/src/java/org/apache/hadoop/hive/ql/exec/DemuxOperator.java 48ce67ad8bbea0fd32a306e6ac0bd8676438f65b ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionTask.java a5722bfcb195139761b03443841bdcd3f37b5b1a ql/src/java/org/apache/hadoop/hive/ql/exec/HashTableSinkOperator.java 80ce96a19dd2e3f59cebb5bbc6bfa322ce3faa37 ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinOperator.java c6bfd03c1d647ff008f2ad94bc81b31eb5a5f7cf ql/src/java/org/apache/hadoop/hive/ql/exec/ReduceSinkOperator.java bc915294f62dc543afa503e79a65655c960939cd ql/src/java/org/apache/hadoop/hive/ql/exec/ScriptOperator.java 6f6f5fa6fe8e84d62f1a0e6ac191f82b488b7554 ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java d0693efb1b95353497fdc67f0684a1549e5faa14 ql/src/java/org/apache/hadoop/hive/ql/exec/mr/HadoopJobExecHelper.java 6a6593c3ac4890d7e169b5af6608aee66679933a ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkUtilities.java a93f1f21a7ec10b58713678fdd0a31307f6fb182 ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobMonitor.java b7e81423233bebedad04fdeaa7aa228e407df335 ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezJobMonitor.java 64b1e420a1447e5548fb0beb395758bd461f4675 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/CuckooSetBytes.java fe75ce3d3b14b84d023612c00554729e793dc677 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/CuckooSetLong.java 5779fb35d7ffbc67917cdcd66b1c57baa3e2bff3 ql/src/java/org/apache/hadoop/hive/ql/io/VectorizedRCFileRecordReader.java 597aef6af1bfcf228bc39103c204330337641678 ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/CorrelationUtilities.java 17364c3c78189b48b57dcb17c3fe7828204cd80f ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/ListBucketingPruner.java 33b6e8614372fa41f368867088ad87ac4c41a339 ql/src/java/org/apache/hadoop/hive/ql/plan/BaseWork.java 1737a347fbb5237774d7661498246a37139103b1 ql/src/java/org/apache/hadoop/hive/ql/plan/HashTableSinkDesc.java 03ef70485b71c70fccae3b4ac501120f606a4936 ql/src/java/org/apache/hadoop/hive/ql/plan/JoinDesc.java 990608a4864b9fac2d5bb308b0f7a01faf6088fd ql/src/java/org/apache/hadoop/hive/ql/plan/MapJoinDesc.java 9fdd417a5f6dc7199658351b3b149484105e2815 ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/Initiator.java 0249a1c098e2b9b363ebadffb9d6278c59f33119 ql/src/java/org/apache/hadoop/hive/ql/udf/UDFJson.java 66778e049f4dde82b0ea96ba5c5b9282ff01c0bd ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/WindowingTableFunction.java cebaf45cdb1094238624d5fde018a3bdaf19c2f0 ql/src/test/org/apache/hadoop/hive/ql/exec/vector/TestVectorizedRowBatch.java 78cd5cd0234792fa0d9c1ed4e9acadca182f8d8d ql/src/test/org/apache/hadoop/hive/ql/exec/vector/TestVectorizedRowBatchCtx.java f7fea17b6037bab15fe53f8c8ef51e92c95de4e5 ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestFileDump.java 00afdac274d390dc6605c266b29a0ae490c54910 Diff: https://reviews.apache.org/r/31530/diff/ Testing --- Thanks, Alexander Pivovarov
[jira] [Created] (HIVE-9810) LLAP: prep object registry for multi threading
Gunther Hagleitner created HIVE-9810: Summary: LLAP: prep object registry for multi threading Key: HIVE-9810 URL: https://issues.apache.org/jira/browse/HIVE-9810 Project: Hive Issue Type: Sub-task Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner The object registry relies on the fact that only one thread at a time is active in a container. With llap that's not the case. There's multiple threads that will try to generate the same cache object at the time, etc. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-9819) Add timeout check inside the HMS server
Dong Chen created HIVE-9819: --- Summary: Add timeout check inside the HMS server Key: HIVE-9819 URL: https://issues.apache.org/jira/browse/HIVE-9819 Project: Hive Issue Type: Sub-task Reporter: Dong Chen Assignee: Dong Chen In HIVE-9253, a timeout check mechanism is added for long running methods in HMS server. We should add this check to each of the inner loops inside the HMS server. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 31404: HIVE-9744 Move common arguments validation and value extraction code to GenericUDF
On Feb. 27, 2015, 9:01 p.m., Jason Dere wrote: ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDF.java, line 70 https://reviews.apache.org/r/31404/diff/2-3/?file=878673#file878673line70 Hmm, this member ends up being a part of all GenericUDFs, but is only used by the methods that use these new convertDate methods. Makes me wonder if we should package these changes (plus array of Converters) as a separate utility class. What do you think of that? Not a necessary change, we can leave it as it is and can always revisit this later. Added thread-safe DateUtils class which caches SimpleDateFormat(-MM-dd) for each thread. - Alexander --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31404/#review74584 --- On Feb. 27, 2015, 12:11 a.m., Alexander Pivovarov wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31404/ --- (Updated Feb. 27, 2015, 12:11 a.m.) Review request for hive, Jason Dere and Thejas Nair. Bugs: HIVE-9744 https://issues.apache.org/jira/browse/HIVE-9744 Repository: hive-git Description --- HIVE-9744 Move common arguments validation and value extraction code to GenericUDF Diffs - ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDF.java 8a0f573648c51c4945be8ffec4a0b06dfa7061c8 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAddMonths.java c5968835a74195bea6b31a5c7b7346907fed5ce0 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFInitCap.java 406fcd608a13fadb8902bf273932acb05a0f3bbe ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLastDay.java 3a43c571ae3a83924a00413181a62ce6f4408125 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLevenstein.java de41793ba3925aa9e1ad9623d92881c57791f047 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFNextDay.java 38f08b74609a4018221ca3f5b92cf33799604d60 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFAddMonths.java 4ccae97a227257294d69f728426f425d060ef0c7 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFLastDay.java 4b233a6966bbdf6902c53f2aaf53cc0eb422b205 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFLevenshtein.java e674d9f38cf7b5cdffcad6eca07dba74ff1e834b ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFNextDay.java e2ec551d4ae39d521680ee93c791f14f27811270 ql/src/test/results/clientnegative/udf_add_months_error_1.q.out 8226ac6fe89c38fcc14edeea215cd5cce7258683 ql/src/test/results/clientnegative/udf_add_months_error_2.q.out f00949e9a12285cc91032215372975753c1f3b4a ql/src/test/results/clientnegative/udf_last_day_error_1.q.out 6e718a0c15e84d89b1cfe7f36231e472ff03c37f ql/src/test/results/clientnegative/udf_last_day_error_2.q.out dc8e3d14f14205ce65355cd53a95cfc788f45fe0 ql/src/test/results/clientnegative/udf_next_day_error_1.q.out c67b9c42f7e7fdf20caa34d028b02fd4819e8343 ql/src/test/results/clientnegative/udf_next_day_error_2.q.out e3cb6a447bf7bd9f09648e46ace1bcba4da55339 Diff: https://reviews.apache.org/r/31404/diff/ Testing --- Thanks, Alexander Pivovarov
Re: Review Request 31404: HIVE-9744 Move common arguments validation and value extraction code to GenericUDF
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31404/ --- (Updated Feb. 28, 2015, 1:28 a.m.) Review request for hive, Jason Dere and Thejas Nair. Changes --- added DateUtils Bugs: HIVE-9744 https://issues.apache.org/jira/browse/HIVE-9744 Repository: hive-git Description --- HIVE-9744 Move common arguments validation and value extraction code to GenericUDF Diffs (updated) - common/src/java/org/apache/hive/common/util/DateUtils.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDF.java 8a0f573648c51c4945be8ffec4a0b06dfa7061c8 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAddMonths.java c5968835a74195bea6b31a5c7b7346907fed5ce0 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFInitCap.java 406fcd608a13fadb8902bf273932acb05a0f3bbe ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLastDay.java 3a43c571ae3a83924a00413181a62ce6f4408125 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLevenstein.java de41793ba3925aa9e1ad9623d92881c57791f047 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFNextDay.java 38f08b74609a4018221ca3f5b92cf33799604d60 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFAddMonths.java 4ccae97a227257294d69f728426f425d060ef0c7 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFLastDay.java 4b233a6966bbdf6902c53f2aaf53cc0eb422b205 ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFLevenshtein.java e674d9f38cf7b5cdffcad6eca07dba74ff1e834b ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFNextDay.java e2ec551d4ae39d521680ee93c791f14f27811270 ql/src/test/results/clientnegative/udf_add_months_error_1.q.out 8226ac6fe89c38fcc14edeea215cd5cce7258683 ql/src/test/results/clientnegative/udf_add_months_error_2.q.out f00949e9a12285cc91032215372975753c1f3b4a ql/src/test/results/clientnegative/udf_last_day_error_1.q.out 6e718a0c15e84d89b1cfe7f36231e472ff03c37f ql/src/test/results/clientnegative/udf_last_day_error_2.q.out dc8e3d14f14205ce65355cd53a95cfc788f45fe0 ql/src/test/results/clientnegative/udf_next_day_error_1.q.out c67b9c42f7e7fdf20caa34d028b02fd4819e8343 ql/src/test/results/clientnegative/udf_next_day_error_2.q.out e3cb6a447bf7bd9f09648e46ace1bcba4da55339 Diff: https://reviews.apache.org/r/31404/diff/ Testing --- Thanks, Alexander Pivovarov
Re: Review Request 30638: HIVE-9432
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30638/ --- (Updated Feb. 27, 2015, 10:15 a.m.) Review request for hive. Changes --- Rebased patch. Bugs: HIVE-9432 https://issues.apache.org/jira/browse/HIVE-9432 Repository: hive-git Description --- CBO (Calcite Return Path): Removing QB from ParseContext Diffs (updated) - ql/src/java/org/apache/hadoop/hive/ql/QueryProperties.java 5dab17148c5d63fdb5f65e9ddf31536852e00a68 ql/src/java/org/apache/hadoop/hive/ql/exec/StatsNoJobTask.java 868cf04a5a5b51044b6b6690ff81f3b3906c7b1b ql/src/java/org/apache/hadoop/hive/ql/exec/StatsTask.java 6922f89112283303e340e9ec41189266a2ac ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTask.java 1342afeade74c5e49bcb0b35ad4cb037d913ffd6 ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java 2e1929e23f119a13889a00b3d682ba782e4f2382 ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRTableScan1.java 0ea81abe5b7ee38f02468ff71f4795b81fe4c49b ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java 1aec3074bbacc164021105f34b50d5a807ae70e4 ql/src/java/org/apache/hadoop/hive/ql/optimizer/SimpleFetchAggregation.java 31c83f2ba693e15dc74f4e663300898f1bd3e49e ql/src/java/org/apache/hadoop/hive/ql/optimizer/SimpleFetchOptimizer.java 986e33bdb09cd0f3455ae2364877b8719676a3c1 ql/src/java/org/apache/hadoop/hive/ql/optimizer/SortedDynPartitionOptimizer.java 0d19be671ffb9c46f7e4a4130f2042cc14ddfceb ql/src/java/org/apache/hadoop/hive/ql/optimizer/StatsOptimizer.java f69b7aabb9b6e035849368fcaead68f1a14a42f4 ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java 6b4e06eb5125e30df6f7bb2b54a6d3b582f4abb5 ql/src/java/org/apache/hadoop/hive/ql/parse/ColumnStatsSemanticAnalyzer.java 8979b4c3472476799f0b0ce7c87f88b692a8b106 ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 7ac0551d4946c62fdf2b7a66f2ba060ecf1a0ccb ql/src/java/org/apache/hadoop/hive/ql/parse/ExportSemanticAnalyzer.java e5e6a550c21cdc4f7a73a8fe3636f1dc5c3cf79a ql/src/java/org/apache/hadoop/hive/ql/parse/LoadSemanticAnalyzer.java 7efad0ce2672dd7036deb8bdea827c5657a45338 ql/src/java/org/apache/hadoop/hive/ql/parse/ParseContext.java 3c6d88a6de7dca4e554cb32b8f40bfb688ccd8c8 ql/src/java/org/apache/hadoop/hive/ql/parse/ProcessAnalyzeTable.java 61592c1e1b982cb6e9d93f9a1ca2014370f6f1c6 ql/src/java/org/apache/hadoop/hive/ql/parse/QBParseInfo.java 54ab25ffd16314b25b9de91459bd312604c3bf83 ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 3497f37d61a80a71920898b3e1610c2cd1c69400 ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java 6ef09cdcbad01f30423a2dd7e7dac7cb59ecad2d ql/src/java/org/apache/hadoop/hive/ql/parse/spark/SparkProcessAnalyzeTable.java 0a037609b572a4589e08f095c398040bc431da61 ql/src/java/org/apache/hadoop/hive/ql/plan/StatsNoJobWork.java 3e5a6074c7432b49b91def865c09a86d16955832 ql/src/java/org/apache/hadoop/hive/ql/plan/StatsWork.java 66d4d4ac02618f8adaa51e2a620005004dceca84 ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java 0e85990f5abc4aa3072ed53f8397e858f5b4062d Diff: https://reviews.apache.org/r/30638/diff/ Testing --- Existing tests. Thanks, Jesús Camacho Rodríguez
Re: [ANNOUNCE] New Hive PMC Member - Sergey Shelukhin
Congratulations Sergey! Well deserved! On Fri, Feb 27, 2015 at 1:51 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Congratulations and keep up the great work! +Vinod On Feb 25, 2015, at 8:43 AM, Carl Steinbach c...@apache.org wrote: I am pleased to announce that Sergey Shelukhin has been elected to the Hive Project Management Committee. Please join me in congratulating Sergey! Thanks. - Carl -- Swarnim
[jira] [Created] (HIVE-9818) Print error messages on stderr instead of stdout
Mark Grover created HIVE-9818:
-
Summary: Print error messages on stderr instead of stdout
Key: HIVE-9818
URL: https://issues.apache.org/jira/browse/HIVE-9818
Project: Hive
Issue Type: Bug
Components: HCatalog
Affects Versions: 1.0.0
Reporter: Mark Grover
hcat script (see
[here|https://github.com/apache/hive/blob/trunk/hcatalog/bin/hcat#L103], for
example) prints error messages via echo which go on stdout the way they are
written. This is bad because downstream projects using it receive error
messages as expected output instead of actually receiving nothing (see
SQOOP-2147 as example).
We need to put error messages on stdout. Something like:
{code}
2 echo This is an error message
{code}
instead of a simple echo that we have been using so far.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
