Paul Rogers created DRILL-7601:
----------------------------------
Summary: Shift column conversion to reader from scan framework
Key: DRILL-7601
URL: https://issues.apache.org/jira/browse/DRILL-7601
Project: Apache Drill
Issue Type: Improvement
Affects Versions: 1.17.0
Reporter: Paul Rogers
Assignee: Paul Rogers
Fix For: 1.18.0
At the time we implemented provided schemas with the text reader, the best path
forward appeared to be to perform column type conversions within the scan
framework including deep in the column writer structure.
Experience with other readers has shown that the text reader is a special case:
it always writes strings, which Drill-provided converters can parse into other
types. Other readers, however are not so simple: they often have their own
source structures which must be mated to a column reader, and so conversion is
generally best done in the reader where it can be specific to the nuances of
each reader.
This ticket asks to restructure the conversion code to fit the
reader-does-conversion pattern.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
