Radeity commented on PR #248: URL: https://github.com/apache/incubator-hugegraph-computer/pull/248#issuecomment-1566757342
Hi, @javeme , I've careful debug, and find the real reason is that `FileElementFetcher` maintains `inputReader`, when the type of `inputReader` is `HDFSFileReader`, HDFS client will cache only one client for the same URI, also, if one thread close fetcher and inputReader, the client will be removed from the map, the other thread can not get this client and throw `IOException: Filesystem closed`. Thus, I use a fetcher array to manage all fetchers in `LoadService`, and close them together after sending all edges and vertices, PTAL. cc @coderzc @imbajin -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
