[
https://issues.apache.org/jira/browse/LUCENE-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861141#comment-16861141
]
ASF subversion and git services commented on LUCENE-8835:
---------------------------------------------------------
Commit b6c68ccdedc7bedb73d90c7e21b285b4e71f7ff4 in lucene-solr's branch
refs/heads/master from Simon Willnauer
[ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=b6c68cc ]
LUCENE-8835: Respect file extension when listing files form FileSwitchDirectory
(#700)
FileSwitchDirectory splits file actions between 2 directories based
on file extensions. The extensions are respected on write operations
like delete or create but ignored when we list the content of the
directories. Until now we only deduplicated the contents on
Directory#listAll which can cause inconsistencies and hard to debug
errors due to double deletions in IndexWriter is a file is pending
delete in one of the directories but still shows up in the directory
listing form the other directory. This case can happen if both
directories point to the same underlying FS directory which is a
common use-case to split between mmap and NIOFS.
This change filters out files from directories depending on their
file extension to make sure files that are deleted in one directory
are not returned form another if they point to the same FS directory.
> Respect file extension when listing files form FileSwitchDirectory
> ------------------------------------------------------------------
>
> Key: LUCENE-8835
> URL: https://issues.apache.org/jira/browse/LUCENE-8835
> Project: Lucene - Core
> Issue Type: Bug
> Reporter: Simon Willnauer
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> FileSwitchDirectory splits file actions between 2 directories based on file
> extensions. The extensions are respected on write operations like delete or
> create but ignored when we list the content of the directories. Until now we
> only deduplicated the contents on Directory#listAll which can cause
> inconsistencies and hard to debug errors due to double deletions in
> IndexWriter is a file is pending delete in one of the directories but still
> shows up in the directory listing form the other directory. This case can
> happen if both directories point to the same underlying FS directory which is
> a common usecase to split between mmap and noifs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
