cgivre commented on issue #1978: DRILL-7578: HDF5 Metadata Queries Fail with Large Files URL: https://github.com/apache/drill/pull/1978#issuecomment-585729825 @paul-rogers , @vvysotskyi I was looking at the HDF5 library and it turns out that there is metadata available for the datasets. Therefore I think I'm going to do three things after removing the config option: 1. Add new columns to the metadata view with the dataset information (size, data type, dimensions) 2. Check the data size prior to projection and truncate it if it is too big. 3. Update the documentation. Does this sound like a good plan?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
