[ https://issues.apache.org/jira/browse/SOLR-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16798304#comment-16798304 ]
Kevin Risden commented on SOLR-5007: ------------------------------------ Putting some notes here as I looked into this a bit more. Hadoop `FileSystem` vs `FileContext`. `FileContext` seems to be the preferred HDFS interaction tool. but `FileContext` doesn’t have a `close()` method so can’t clean up any usages. In the Solr HDFS stuff, there is a mix of `FileSystem` and `FileContext`. and it is weird from a resource usage as to what should be used. I know all the `FileContext` stuff leaks threads in Solr testing, but moving to `FileSystem` isn’t an option since not all the required methods are on `FileSystem`. I plan to try to follow up with the Hadoop ecosystem about `FileContext` and how to properly clean up. Since right now there is no easy way :( > TestRecoveryHdfs seems to be leaking a thread occasionally that ends up > failing a completely different test. > ------------------------------------------------------------------------------------------------------------ > > Key: SOLR-5007 > URL: https://issues.apache.org/jira/browse/SOLR-5007 > Project: Solr > Issue Type: Test > Components: Hadoop Integration, hdfs, Tests > Reporter: Mark Miller > Assignee: Kevin Risden > Priority: Major > Attachments: SOLR-5007.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org