[jira] [Created] (HIVE-22746) Make TypeCheckProcFactory generic
Jesus Camacho Rodriguez created HIVE-22746:
--
Summary: Make TypeCheckProcFactory generic
Key: HIVE-22746
URL: https://issues.apache.org/jira/browse/HIVE-22746
Project: Hive
Issue Type: Improvement
Components: CBO
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez
{{TypeCheckProcFactory}} is responsible for processing AST nodes and generating
ExprNode objects from them. When we generate the expressions for Calcite
planning, we go through a {{AST node -> ExprNode -> RexNode}} transformation.
We would like to avoid the overhead of going through the ExprNode, and thus
generate directly the RexNode from the AST.
To do that, the first step is to make {{TypeCheckProcFactory}} generic, so it
can receive an expression factory and create expressions in different realms.
For the time being, the only factory implementation is the ExprNode factory.
Thus, this patch focuses mainly on refactoring {{TypeCheckProcFactory}} without
breaking anything that is already working.
In a follow-up patch, we will create a {{RexNode}} factory and use it when we
parse the query in CalcitePlanner.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-22745) Config option to turn off read locks
Ashutosh Chauhan created HIVE-22745: --- Summary: Config option to turn off read locks Key: HIVE-22745 URL: https://issues.apache.org/jira/browse/HIVE-22745 Project: Hive Issue Type: Improvement Components: Transactions Reporter: Ashutosh Chauhan Although its not recommended but in perf critical scenario this option may be exercised. We have observed lock acquisition to take long time in heavily loaded system. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22744) TezTask for the vertex with more than one outedge should have proportional sort memory
Ramesh Kumar Thangarajan created HIVE-22744: --- Summary: TezTask for the vertex with more than one outedge should have proportional sort memory Key: HIVE-22744 URL: https://issues.apache.org/jira/browse/HIVE-22744 Project: Hive Issue Type: Bug Reporter: Ramesh Kumar Thangarajan Assignee: Ramesh Kumar Thangarajan TezTask for the vertex with more than one outedge should have proportional sort memory -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22743) Enable Fast LLAP-IO path for tables with schema evolution case appending columns.
Slim Bouguerra created HIVE-22743: - Summary: Enable Fast LLAP-IO path for tables with schema evolution case appending columns. Key: HIVE-22743 URL: https://issues.apache.org/jira/browse/HIVE-22743 Project: Hive Issue Type: Improvement Reporter: Slim Bouguerra Assignee: Slim Bouguerra -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22742) Skip Class loader forking, when needed.
Slim Bouguerra created HIVE-22742: - Summary: Skip Class loader forking, when needed. Key: HIVE-22742 URL: https://issues.apache.org/jira/browse/HIVE-22742 Project: Hive Issue Type: Improvement Reporter: Slim Bouguerra -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: HIVE-22066: Upgrade Apache parent POM to version 21
Hello Team, This ticket and patch is still waiting out there. Any help would be greatly appreciated. Thanks. On Mon, Dec 9, 2019 at 2:38 PM David Mollitor wrote: > Hello Gang, > > I have taken up the task of upgrading all of the Hive POM files to upgrade > the version of the Apache parent POM from which they inherent. > > I have hit a snag though and I would like to ask your support. > > The upgraded POM files builds locally for me but I cannot get it to pass > upstream. I tracked the problem back to how YETUS is implemented. YETUS's > first phase checks out and builds the 'master' branch of the project and > performs some sanity checks. It builds the root project and all of its > modules. For its second phase, it applies the submitted patch and builds > the project again. However, YETUS does not build from the root POM file on > the second phase. It only builds from directory of each module. This is > problematic since my patch updates the parent POM file. It looks to me > that YETUS will only build the parent POM file during phase 2 if the POM > file was modified to change the version number of the project. I am not > incrementing the version here, I am hoping to get this into Hive 4.0. > > I would like to propose that we merge the latest patch I have provided and > work out any issues that may arise after the fact. Future builds should > succeed since YETUS will build the modified root POM file for future builds. > > Thanks >
[jira] [Created] (HIVE-22741) Speed up ObjectStore method getTableMeta
Zoltan Chovan created HIVE-22741: Summary: Speed up ObjectStore method getTableMeta Key: HIVE-22741 URL: https://issues.apache.org/jira/browse/HIVE-22741 Project: Hive Issue Type: Improvement Reporter: Zoltan Chovan Assignee: Zoltan Chovan -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: Review Request 71761: HIVE-22489
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71761/ --- (Updated Jan. 17, 2020, 1:58 p.m.) Review request for hive, Jesús Camacho Rodríguez and Zoltan Haindrich. Bugs: HIVE-22489 https://issues.apache.org/jira/browse/HIVE-22489 Repository: hive-git Description --- Reduce Sink operator orders nulls first === 1. Set the default null sort order by hive config when creating Reduce Sink Desc. 2. Hash join uses `org.apache.hadoop.hive.serde2.binarysortable.fast.BinarySortableSerializeWrite` or `BinarySortableDeserializeRead` for selializing keys. For bigtable keys always ascending and nulls first ordering was hardcoded. This patch changes this behaviour to use the `Operator.getConf().TableDesc.getProperties()` (in this case `MapJoinOperator`) to setup ordering in `BinarySortableSerializeWrite` 3. Use null ordering set in ReduceRecordSource at Reduce phase when comparing keys in `CommonMergeJoinOperator` (This is the null ordering of the children Reduce Sink operators) Diffs (updated) - accumulo-handler/src/test/results/positive/accumulo_queries.q.out 7c552621f2 contrib/src/test/results/clientpositive/udaf_example_group_concat.q.out 6846720d95 hbase-handler/src/test/results/positive/hbase_queries.q.out a32ef81a7b itests/hive-blobstore/src/test/results/clientpositive/write_final_output_blobstore.q.out e997fa65cf kudu-handler/src/test/results/positive/kudu_complex_queries.q.out 73fc3e514f ql/src/java/org/apache/hadoop/hive/ql/exec/CommonMergeJoinOperator.java 3974627a24 ql/src/java/org/apache/hadoop/hive/ql/exec/tez/ReduceRecordSource.java 72446afeda ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/VectorMapJoinCommonOperator.java 2380d936f2 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/VectorMapJoinInnerBigOnlyMultiKeyOperator.java f587517b08 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/VectorMapJoinInnerMultiKeyOperator.java cdee3fd957 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/VectorMapJoinLeftSemiMultiKeyOperator.java e5d9fdae19 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/VectorMapJoinOuterMultiKeyOperator.java 29c531bd51 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/fast/VectorMapJoinFastLongHashMap.java a4cda921a5 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/fast/VectorMapJoinFastLongHashMultiSet.java 43f093d906 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/fast/VectorMapJoinFastLongHashSet.java 8dce5b82d3 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/fast/VectorMapJoinFastLongHashTable.java a35401d9b2 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/fast/VectorMapJoinFastStringCommon.java 1b108a8c14 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/fast/VectorMapJoinFastStringHashMap.java 446feb2526 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/fast/VectorMapJoinFastStringHashMultiSet.java c28ef9be2b ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/fast/VectorMapJoinFastStringHashSet.java 17bd5fda93 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/fast/VectorMapJoinFastTableContainer.java 4ab8902a3f ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/optimized/VectorMapJoinOptimizedCreateHashTable.java 21c355cb42 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/optimized/VectorMapJoinOptimizedLongCommon.java de1ee15c3b ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/optimized/VectorMapJoinOptimizedLongHashMap.java 42573f0898 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/optimized/VectorMapJoinOptimizedLongHashMultiSet.java 829a03737d ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/optimized/VectorMapJoinOptimizedLongHashSet.java 18e1435019 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/optimized/VectorMapJoinOptimizedStringCommon.java da0e8365b1 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/optimized/VectorMapJoinOptimizedStringHashMap.java 6c4d8a81d1 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/optimized/VectorMapJoinOptimizedStringHashMultiSet.java a6b754c7eb ql/src/java/org/apache/hadoop/hive/ql/exec/vector/mapjoin/optimized/VectorMapJoinOptimizedStringHashSet.java fdcd83dde7 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/reducesink/VectorReduceSinkCommonOperator.java 5c409e4573 ql/src/java/org/apache/hadoop/hive/ql/optimizer/CountDistinctRewriteProc.java a50ad78e8f ql/src/java/org/apache/hadoop/hive/ql/optimizer/DynamicPartitionPruningOptimization.java 0f95d7788c ql/src/java/org/apache/hadoop/hive/ql/optimizer/ReduceSinkMapJoinProc.java 89b55001f0
Re: Review Request 72013: HIVE-22735
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72013/ --- (Updated Jan. 17, 2020, 12:49 p.m.) Review request for hive and Jesús Camacho Rodríguez. Bugs: HIVE-22735 https://issues.apache.org/jira/browse/HIVE-22735 Repository: hive-git Description --- TopNKey operator deduplication == When creating a TopNKeyDesc ignore `ExprNodeConstantDesc` type columns Diffs (updated) - ql/src/java/org/apache/hadoop/hive/ql/plan/TopNKeyDesc.java a9e2a527df ql/src/test/results/clientpositive/llap/topnkey_grouping_sets.q.out b1ec8d8847 ql/src/test/results/clientpositive/llap/topnkey_grouping_sets_functions.q.out 0ec6e6de43 ql/src/test/results/clientpositive/llap/topnkey_grouping_sets_order.q.out d3ff1a6256 ql/src/test/results/clientpositive/llap/vector_groupby_grouping_sets_limit.q.out 3addfb9a88 ql/src/test/results/clientpositive/perf/tez/constraints/query14.q.out 44da18ad40 ql/src/test/results/clientpositive/perf/tez/constraints/query27.q.out 4eb41168bc ql/src/test/results/clientpositive/perf/tez/constraints/query5.q.out f78b2faf7c ql/src/test/results/clientpositive/perf/tez/constraints/query77.q.out 40810d45dc ql/src/test/results/clientpositive/perf/tez/constraints/query80.q.out 462eed8942 ql/src/test/results/clientpositive/perf/tez/query14.q.out da6b74d147 ql/src/test/results/clientpositive/perf/tez/query27.q.out 62fbeda71e ql/src/test/results/clientpositive/perf/tez/query5.q.out 34bbb51ef9 ql/src/test/results/clientpositive/perf/tez/query77.q.out 6b9c5b4e16 ql/src/test/results/clientpositive/perf/tez/query80.q.out 30f77de916 Diff: https://reviews.apache.org/r/72013/diff/2/ Changes: https://reviews.apache.org/r/72013/diff/1-2/ Testing --- mvn test -Dtest.output.overwrite -DskipSparkTests -Dtest=TestMiniLlapLocalCliDriver -Dqfile=topnkey.q,topnkey_dedup.q,topnkey_grouping_sets_functions.q,topnkey_grouping_sets_order.q,topnkey_order_null.q,vector_topnkey.q -pl itests/qtest -Pitests Thanks, Krisztian Kasa
If Hive Metastore is compatibility with MariaDB version 10.x.?
Hi all. Could you please help? Customer asked if Hive Metastore is compatible with MariaDB version 10.x. He is going to use 10.4.10-MariaDB MariaDB Server. -- Oleksiy
