[
https://issues.apache.org/jira/browse/DRILL-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17950393#comment-17950393
]
ASF GitHub Bot commented on DRILL-8474:
---------------------------------------
cgivre opened a new pull request, #2989:
URL: https://github.com/apache/drill/pull/2989
# [DRILL-8474](https://issues.apache.org/jira/browse/DRILL-8474): Add
Daffodil Format Plugin to Drill
## Description
This PR replaces: https://github.com/apache/drill/pull/2836 which is closed.
That was to retain history/comments while squashing numerous debug-related
commits together into this PR. This PR also replaces
https://github.com/apache/drill/pull/2909.
## Documentation
New format-daffodil module created
Still uses absolute paths for the schemaFileURI.
(which is cheating. Wouldn't work in a true distributed drill environment.)
We have yet to work out how to enable Drill to provide access for DFDL
schemas in XML form with include/import to be resolved.
The input data stream is, however, being accessed in the proper Drill
manner. Gunzip happened automatically. Nice.
Note: Fix boxed Boolean vs. boolean problem. Don't use boxed primitives in
Format config objects.
Test show this works for data as complex as having nested repeating
sub-records.
These DFDL types are supported:
int
long
short
byte
boolean
double
float (does not work. Bug DAFFODIL-2367)
hexBinary
string
TBD: feature is incomplete still. It will require substantial documentation
for users.
## Testing
See tests under src/test in the new daffodil contrib module.
> Add Daffodil Format Plugin
> --------------------------
>
> Key: DRILL-8474
> URL: https://issues.apache.org/jira/browse/DRILL-8474
> Project: Apache Drill
> Issue Type: New Feature
> Affects Versions: 1.21.1
> Reporter: Charles Givre
> Priority: Major
> Fix For: 1.22.0
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
