Ji Qi created HUDI-3670:
---------------------------

             Summary: SqlQueryBasedTransformer leaks temp views in continuous 
mode
                 Key: HUDI-3670
                 URL: https://issues.apache.org/jira/browse/HUDI-3670
             Project: Apache Hudi
          Issue Type: Bug
          Components: deltastreamer
            Reporter: Ji Qi


In the Sql transformers, a new temp view with a random name is created for each 
incoming batch, but the temp view is never dropped.

This causes a resource leak in Spark SessionState's Catalog. For long-running 
deltastreamer jobs, the temp views created causes HiveSessionCatalog to take up 
a lot of memory.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to