[
https://issues.apache.org/jira/browse/HIVE-21375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784893#comment-16784893
]
Shawn Weeks commented on HIVE-21375:
------------------------------------
Same issue for ConnectionImpl as well. Closing the file system here will cause
a problem if you have multiple connections or transaction batches open. This
type of cleanup should probably be handled by the caller.
> Closing TransactionBatch closes FileSystem for other batches
> ------------------------------------------------------------
>
> Key: HIVE-21375
> URL: https://issues.apache.org/jira/browse/HIVE-21375
> Project: Hive
> Issue Type: Bug
> Components: HCatalog, Streaming
> Reporter: Shawn Weeks
> Priority: Minor
>
> The patch in HIVE-13151 added FileSystem.closeAllForUGI(ugi); to the close
> method of HiveEndPoint for the legacy Streaming API. This seems to have a
> side effect of closing the FileSystem for all open TransactionBatches as used
> by NiFi and Storm when writing to multiple partitions. Setting
> fs.hdfs.impl.disable.cache=true negates the issue but at a performance cost.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
