Zhihua Deng created HIVE-27596:
----------------------------------

             Summary: Make the cached InputFormat stateless
                 Key: HIVE-27596
                 URL: https://issues.apache.org/jira/browse/HIVE-27596
             Project: Hive
          Issue Type: Improvement
            Reporter: Zhihua Deng


InputFormat is cached in FetchOperator:

[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/FetchOperator.java#L233|https://github.com/ganeshashree/hive/blob/c2fb5827761b99b1270582bd9c41c9ab5a6ab549/ql/src/java/org/apache/hadoop/hive/ql/exec/FetchOperator.java#L233]

and HiveFileInputFormat:

[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java#L391]

which makes the InputFormat instance is accessible across different sessions, 
so it's better to be stateless to avoid concurrency problem.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to