dvjyothsna commented on a change in pull request #1723: DRILL-7063: Seperate
metadata cache file into summary, file metadata
URL: https://github.com/apache/drill/pull/1723#discussion_r272463221
##########
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetFormatPlugin.java
##########
@@ -298,11 +298,28 @@ public DrillTable isReadable(DrillFileSystem fs,
FileSelection selection,
}
private Path getMetadataPath(FileStatus dir) {
- return new Path(dir.getPath(), Metadata.METADATA_FILENAME);
+ return new Path(dir.getPath(), Metadata.OLD_METADATA_FILENAME);
+ }
+
+ /**
+ * Check if the metadata version 4 files exist
+ * @param dir the path of the directory
+ * @param fs
+ * @return true if both file metadata and summary cache file exist
+ * @throws IOException in case of problems during accessing files
+ */
+ private boolean currentMetadataFileExists(FileStatus dir, FileSystem fs)
throws IOException {
+ for (String metaFileName : Metadata.CURRENT_METADATA_FILENAMES) {
+ Path path = new Path(dir.getPath(), metaFileName);
+ if (!fs.exists(path)) {
+ return false;
+ }
+ }
+ return true;
}
private boolean metaDataFileExists(FileSystem fs, FileStatus dir) throws
IOException {
- return fs.exists(getMetadataPath(dir));
+ return fs.exists(getMetadataPath(dir)) || currentMetadataFileExists(dir,
fs);
Review comment:
Extracted both methods into one.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
