Shazwazza commented on issue #967: URL: https://github.com/apache/lucenenet/issues/967#issuecomment-2423201152
This has been attempted before a few times with various implementations for things like Azure Blob Storage and SQL data stores. The problem is, Lucene requires super fast access to the its files. Lucene is entirely file based and sure, there's APIs to have a different Directory store, but ultimately if Lucene is not operating off of a fast disk, it will be very slow. The work around for this, is to sync the indexes so that Lucene operates off of a local files system (maybe in %temp%) and the Lucene Replicator is used to sync to a slow storage system so that when the process restarts, a sync from the slow system to the fast drive works. I have implemented this for slow network drives to fast local drives https://github.com/Shazwazza/Examine/blob/support/3.x/src/Examine.Lucene/Directories/SyncedFileSystemDirectoryFactory.cs I used to try to manage the implementation for Blog Storage but that was abandoned. However, this file system to file system syncing implementation has become pretty stable and could be used to swap out the slow network drive directory for something like AWS. This won't be something that would be put into the Lucene.NET codebase though. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@lucenenet.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
