vinothchandar commented on issue #663: Cannot query real time table
URL: https://github.com/apache/incubator-hudi/issues/663#issuecomment-489715771
 
 
   Seems like we cannot find a FileSlice corresponding to a parquet split
   
   ```
   Stream<FileSlice> latestFileSlices = latestCompletedInstant.map(instant ->
               fsView.getLatestMergedFileSlicesBeforeOrOn(relPartitionPath, 
instant.getTimestamp()))
               .orElse(Stream.empty());
   
           // subgroup splits again by file id & match with log files.
           Map<String, List<FileSplit>> groupedInputSplits = 
partitionsToParquetSplits
               .get(partitionPath).stream()
               .collect(Collectors.groupingBy(split -> 
FSUtils.getFileId(split.getPath().getName())));
           latestFileSlices.forEach(fileSlice -> {
             List<FileSplit> dataFileSplits = 
groupedInputSplits.get(fileSlice.getFileId());
   ```
   
    First hint, I am suspecting if there is a bug due to pending compactions 
etc.. not sure though. I assume you are running MOR? If you share the listing 
of the partition path `waybill7/2019-04-19` it'd be helpful to debug.. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to