watermelon12138 commented on code in PR #5197:
URL: https://github.com/apache/hudi/pull/5197#discussion_r853857228
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/SerDeUtils.scala:
##########
@@ -30,7 +30,10 @@ object SerDeUtils {
private val kryoLocal = new ThreadLocal[Kryo] {
override protected def initialValue: Kryo = {
- val serializer = new KryoSerializer(new SparkConf(true))
+ val conf = new SparkConf(true)
+ conf.set("spark.kryo.referenceTracking", "true")
Review Comment:
ok，i see. Thank you for your review. Hard-coding is not a good way to
determine the value of properties. Is it feasible to use logs to tell users
what to do when this problem occurs?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
