Xianghu Wang created HUDI-1946:
----------------------------------
Summary: Enhance SqlQueryBasedTransformer to allow user use
wildcard to represent all the columns
Key: HUDI-1946
URL: https://issues.apache.org/jira/browse/HUDI-1946
Project: Apache Hudi
Issue Type: New Feature
Reporter: Xianghu Wang
Assignee: Xianghu Wang
Fix For: 0.9.0
When the user wants to derive one or more columns from the existing columns and
the
existing columns are all needed, the user needs to spell all the columns they
need in the SQL.
This will be very troublesome and time-consuming when we have dozens or
hundreds of columns. we can save trouble by using a wildcard in the SQL to
represent all the columns.
that means if we have "id", "name", "age", "ts" these four columns already and
we want to add a new column driver from ts, we can use
"select *, FROM_UNIXTIME(ts / 1000, 'yyyyMMdd') as dt from table_name"
to represent
"select id, name, age, ts, FROM_UNIXTIME(ts / 1000, 'yyyyMMdd') as dt from
table_name"
--
This message was sent by Atlassian Jira
(v8.3.4#803005)