Github user manishgupta88 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2560#discussion_r205436561
--- Diff:
core/src/main/java/org/apache/carbondata/core/indexstore/BlockletDataMapIndexStore.java
---
@@ -81,6 +82,8 @@ public BlockletDataMapIndexWrapper
get(TableBlockIndexUniqueIdentifierWrapper id
List<BlockDataMap> dataMaps = new ArrayList<>();
if (blockletDataMapIndexWrapper == null) {
try {
+ boolean isCarbonTableUpdated =
--- End diff --
Listing files from metadata folder will be less costly as compared to
listing files from segment path. Metadata contains only few files but segment
path can contain lot of files which will do more RPC calls to namenode
Also listing from segment file path will be very costly in case of flat
folder structure OR when storage file system is S3
---
