[
https://issues.apache.org/jira/browse/BLUR-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826004#comment-13826004
]
Aaron McCurry commented on BLUR-290:
------------------------------------
This code is looking very promising, I really like the approach you are taking.
Do you have any numbers yet on performance? If not I will do a little
evaluation of where the code is performance wise.
Also I'm thinking that we might want to introduce table types in Blur to allow
for plugging in various implementations of the BlurIndex. That way this more
performant indexing implementation could be used instead of the normal NRT or
the ReadOnly variation. I also thought of another possible implementation, it
would allow for varying latency between writes and visibility. Basically under
load it would allow the indexer to fall behind but would still allow for
mutates to occur as fast as possible.
> NRT Updates using RAMDirectory & Swap
> -------------------------------------
>
> Key: BLUR-290
> URL: https://issues.apache.org/jira/browse/BLUR-290
> Project: Apache Blur
> Issue Type: New Feature
> Affects Versions: experimental-dev
> Reporter: Ravikumar
> Attachments: BlurFieldsConsumer.java, BlurFieldsConsumer.java,
> BlurFlushingIndexWriter.java, BlurIndexTracker.java,
> BlurPostingsConsumer.java, BlurPostingsFormat.java, BlurRealTimeIndex.java,
> BlurRealTimeIndexWriter.java, BlurRealTimeManager.java,
> BlurRealTimeManagerReopenThread.java, BlurRowCodec.java,
> BlurTermsConsumer.java, CompressingRowIndexReader.java,
> CompressingRowIndexWriter.java, CompressingRowReader.java,
> CompressingRowReader.java, CompressingRowWriter.java,
> CompressingRowWriter.java, GrowableByteArrayDataOutput.java,
> PrimeDocCache.java, RealTimeTransactionRecorder.java, RowCache.java,
> RowDocsCollector.java, RowReaderCache.java, SlabAllocator.java,
> SlabRAMDirectory.java, SlabRAMFile.java, SlabRAMInputStream.java,
> SlabRAMOutputStream.java, SortingMultiReader.java, SortingMultiReader.java,
> TestCompressingRowWriter.java
>
>
> We have been discussing about handling humungous rows in Blur (BLUR-220).
> Explore the idea of using RAMDirectory at the front, backed by
> persistent-index.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
