cgivre commented on PR #2836:
URL: https://github.com/apache/drill/pull/2836#issuecomment-1877962587

   @mbeckerle I had a thought about your TODO list.   See inline.
   
   > This is ready for a next review. All the scalar types are now implemented 
with typed setter calls.
   > 
   > The prior review comments have all been addressed I believe.
   > 
   > Remaining things to do include:
   > 
   > 1. How to get the compiled DFDL schema object so it can be loaded by 
daffodil out at the distributed Drill nodes.
   
   I was thinking about this and I remembered something that might be useful.  
Drill has support for User Defined Functions (UDF) which are written in Java.  
To add a UDF to Drill, you also have to write some Java classes in a particular 
way, and include the JARs.   Much like the DFDL class files, the UDF JARs must 
be accessible to all nodes of a Drill cluster. 
   
   Additionally, Drill has the capability of adding UDFs dynamically.   This 
feature was added here: https://github.com/apache/drill/pull/574.  Anyway, I 
wonder if we could use a similar mechanism to load and store the DFDL files so 
that they are accessible to all Drill nodes.  What do you think?
   
   
   > 2. Test of nilled values (and more tests generally to show deeply nested 
and repeating nested objects work.)
   > 3. Errors - revisit every place errors are detected or thrown to make sure 
these are being done the right way for DFDL schema compilation and runtime 
errors as well.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to