Mark Bukhner created HUDI-6567:
----------------------------------
Summary: ExpressionEvaluators numeric types conversion support
Key: HUDI-6567
URL: https://issues.apache.org/jira/browse/HUDI-6567
Project: Apache Hudi
Issue Type: Improvement
Components: flink, metadata
Reporter: Mark Bukhner
Fix For: 0.14.0
Attachments: types_conversion.png
Example:
{code:java}
table tbl (a: bigint){code}
data skipping work only if both types are the same. If we use
{code:java}
select * from tbl where a > 10{code}
data skipping will not work, we have to explicit cast:
{code:java}
select * from tbl where a > cast(10 as bigint){code}
Problem may be solved converting all numeric types to BigDecimal (without
information lose):
!https://issues.apache.org/jira/secure/temporaryattachment/d1eebd31f6934ed08acc16e0c7c26a4d6f49938e/temp4637828566423743788_types_conversion.png!
by 20 lines of source code, without necessity of adding new rule or filter in
flink engine (which can support more complex types conversion, such as string
-> integer, but i think there is no need in such conversions)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)