Ben-Zvi commented on a change in pull request #1738: DRILL-7062: Initial
implementation of run-time row-group pruning
URL: https://github.com/apache/drill/pull/1738#discussion_r275007436
##########
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/metadata/Metadata.java
##########
@@ -448,23 +476,23 @@ private ColTypeInfo getColTypeInfo(MessageType schema,
Type type, String[] path,
/**
* Get the metadata for a single file
*/
- private ParquetFileMetadata_v3
getParquetFileMetadata_v3(ParquetTableMetadata_v3 parquetTableMetadata,
- final FileStatus file, final FileSystem fs, boolean allColumns,
Set<String> columnSet) throws IOException, InterruptedException {
- final ParquetMetadata metadata;
- final UserGroupInformation processUserUgi =
ImpersonationUtil.getProcessUserUGI();
- final Configuration conf = new Configuration(fs.getConf());
- try {
- metadata =
processUserUgi.doAs((PrivilegedExceptionAction<ParquetMetadata>)() -> {
- try (ParquetFileReader parquetFileReader =
ParquetFileReader.open(HadoopInputFile.fromStatus(file, conf),
readerConfig.toReadOptions())) {
- return parquetFileReader.getFooter();
- }
- });
- } catch(Exception e) {
- logger.error("Exception while reading footer of parquet file [Details -
path: {}, owner: {}] as process user {}",
- file.getPath(), file.getOwner(), processUserUgi.getShortUserName(), e);
- throw e;
+ public static ParquetFileMetadata_v3
getParquetFileMetadata_v3(ParquetTableMetadata_v3 parquetTableMetadata,
ParquetMetadata footer,
Review comment:
Done
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
