[
https://issues.apache.org/jira/browse/HUDI-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Bukhner updated HUDI-6567:
-------------------------------
Description:
Example:
{code:java}
table tbl (a: bigint){code}
data skipping work only if both types are the same. If we use
{code:java}
select * from tbl where a > 10{code}
data skipping will not work, we have to explicit cast:
{code:java}
select * from tbl where a > cast(10 as bigint){code}
Problem may be solved converting all numeric types to BigDecimal (without
information lose):
!types_conversion.png!
by 20 lines of source code, without necessity of adding new rule or filter in
flink engine (which can support more complex types conversion, such as string
-> integer, but i think there is no need in such conversions)
was:
Example:
{code:java}
table tbl (a: bigint){code}
data skipping work only if both types are the same. If we use
{code:java}
select * from tbl where a > 10{code}
data skipping will not work, we have to explicit cast:
{code:java}
select * from tbl where a > cast(10 as bigint){code}
Problem may be solved converting all numeric types to BigDecimal (without
information lose):
!https://issues.apache.org/jira/secure/temporaryattachment/d1eebd31f6934ed08acc16e0c7c26a4d6f49938e/temp4637828566423743788_types_conversion.png!
by 20 lines of source code, without necessity of adding new rule or filter in
flink engine (which can support more complex types conversion, such as string
-> integer, but i think there is no need in such conversions)
> ExpressionEvaluators numeric types conversion support
> -----------------------------------------------------
>
> Key: HUDI-6567
> URL: https://issues.apache.org/jira/browse/HUDI-6567
> Project: Apache Hudi
> Issue Type: Improvement
> Components: flink, metadata
> Reporter: Mark Bukhner
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.14.0
>
> Attachments: types_conversion.png
>
>
> Example:
> {code:java}
> table tbl (a: bigint){code}
>
> data skipping work only if both types are the same. If we use
> {code:java}
> select * from tbl where a > 10{code}
> data skipping will not work, we have to explicit cast:
> {code:java}
> select * from tbl where a > cast(10 as bigint){code}
>
> Problem may be solved converting all numeric types to BigDecimal (without
> information lose):
> !types_conversion.png!
> by 20 lines of source code, without necessity of adding new rule or filter in
> flink engine (which can support more complex types conversion, such as string
> -> integer, but i think there is no need in such conversions)
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
