Sandhya Sundaresan created TRAFODION-2091:
---------------------------------------------
Summary: hdfsFS filesystem usage causies abnormal behavior in
Trafodion
Key: TRAFODION-2091
URL: https://issues.apache.org/jira/browse/TRAFODION-2091
Project: Apache Trafodion
Issue Type: Bug
Components: sql-general
Affects Versions: 2.1-incubating
Reporter: Sandhya Sundaresan
Assignee: Sandhya Sundaresan
Several components use the libhdfs API to perform operations on hdfs files in
Trafodion. Some places use the JNI API as well to access hdfs.
The inconsistency observed was ehen one component cached and kept the hdfsFS
hande for it's use another part of the code would perform a "close" or a
dsconnect and prematurely close the hdfsFS handle which is currently being
used. The reason is that the hdfs layer seems to cache the hdfsFS handle
underneathThe solution now is to keep a list of hdfsFS handles at the global
context level. All disconnect calls and JNI close calls are remmoved. The hdfHS
handles will get cleaned up either at context destructor time or at endSession
time.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
