[
https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17642512#comment-17642512
]
ASF GitHub Bot commented on HADOOP-18546:
-----------------------------------------
snvijaya commented on PR #5176:
URL: https://github.com/apache/hadoop/pull/5176#issuecomment-1335245329
> happy with all the production code; just tuning tests.
>
> now, has anyone tried a spark standalone cluster with a build of hadoop
trunk without then with this patch to verify all is good there?
>
> i can do this, but it is good for others to try too
Hi Steve, Unfortunately we didn't get to the standalone cluster checks. We
will try the setup and test on Monday. Thanks.
> disable purging list of in progress reads in abfs stream closed
> ---------------------------------------------------------------
>
> Key: HADOOP-18546
> URL: https://issues.apache.org/jira/browse/HADOOP-18546
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.3.4
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
>
> turn off the prune of in progress reads in
> ReadBufferManager::purgeBuffersForStream
> this will ensure active prefetches for a closed stream complete. they wiill
> then get to the completed list and hang around until evicted by timeout, but
> at least prefetching will be safe.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
