JingsongLi commented on code in PR #8943:
URL: https://github.com/apache/paimon/pull/8943#discussion_r3687571685
##########
paimon-spark/paimon-spark-common/src/main/scala/org/apache/paimon/spark/data/SparkInternalRow.scala:
##########
@@ -33,6 +35,8 @@ abstract class SparkInternalRow extends InternalRow {
object SparkInternalRow {
+ private val blobFieldsCache = new IdentityHashMap[RowType, Set[Int]]()
Review Comment:
If `key` is a strong reference and is never evicted, and if a Spark driver
or executor with a long lifecycle continuously accesses a large number of
tables or schema versions, `RowType` will be retained indefinitely, posing a
clear risk of memory leaks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
