arina-ielchiieva commented on a change in pull request #1978: DRILL-7578: HDF5
Metadata Queries Fail with Large Files
URL: https://github.com/apache/drill/pull/1978#discussion_r383911924
##########
File path:
contrib/format-hdf5/src/main/java/org/apache/drill/exec/store/hdf5/HDF5BatchReader.java
##########
@@ -458,7 +494,7 @@ private void projectMetadataRow(RowSetLoader rowWriter) {
/**
* This function writes one row of data in a metadata query. The number of
dimensions here is n+1. So if the actual dataset is a 1D column, it will be
written as a list.
- * This is function is only called in metadata queries as the schema is not
known in advance.
+ * This is function is only called in metadata queries as the schema is not
known in advance. If the datasize is greater than 16MB, the function does not
project the dataset
Review comment:
Please also add this to documentation.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
