[
https://issues.apache.org/jira/browse/SOLR-6393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104475#comment-14104475
]
Mark Miller commented on SOLR-6393:
-----------------------------------
bq. Ah, missed that. Thanks!
The straight read speed should be really fast now, but when we are updating
while reading, when we get to the end of the file we are reading, we have to
try and open it again to see if there is anything new. The local fs impl uses
channels and doesn't have to do this to see the latest data from the writer. So
even when updates are also coming in, this should be a huge improvement,
because it was previously reopening needlessly on every update it read, but we
do still have to take that hit of opening a new reader every time we read up to
the end of the view of the last reader.
> Improve transaction log replay speed on HDFS.
> ---------------------------------------------
>
> Key: SOLR-6393
> URL: https://issues.apache.org/jira/browse/SOLR-6393
> Project: Solr
> Issue Type: Improvement
> Reporter: Mark Miller
> Assignee: Mark Miller
> Fix For: 5.0, 4.10
>
> Attachments: SOLR-6393.patch
>
>
> Replay speed is pretty slow on HDFS because we currently reopen a reader
> between reading each update.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
