bvaradar commented on issue #1939:
URL: https://github.com/apache/hudi/issues/1939#issuecomment-678220122
Sorry for the delay in responding , here is the default storage level
config I am seeing,
private static final String WRITE_STATUS_STORAGE_LEVEL =
"hoodie.write.status.storage.level";
private static final String DEFAULT_WRITE_STATUS_STORAGE_LEVEL =
"MEMORY_AND_DISK_SER";
From the code, I can see that hudi uses the spark.persist API to manage this
cache. So, this does not look like the problem.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
