Ji Qi created HUDI-3670: --------------------------- Summary: SqlQueryBasedTransformer leaks temp views in continuous mode Key: HUDI-3670 URL: https://issues.apache.org/jira/browse/HUDI-3670 Project: Apache Hudi Issue Type: Bug Components: deltastreamer Reporter: Ji Qi
In the Sql transformers, a new temp view with a random name is created for each incoming batch, but the temp view is never dropped. This causes a resource leak in Spark SessionState's Catalog. For long-running deltastreamer jobs, the temp views created causes HiveSessionCatalog to take up a lot of memory. -- This message was sent by Atlassian Jira (v8.20.1#820001)