[GitHub] [hudi] hj2016 commented on issue #2215: [SUPPORT] Spark driver memory overflows after using spark streaming for a long time

Fri, 30 Oct 2020 03:17:32 -0700 


hj2016 commented on issue #2215:
URL: https://github.com/apache/hudi/issues/2215#issuecomment-719466640


   I tried to run the spark task for several hours, the HoodieLogFormatWriter 
object problem was solved, but I found a new problem. Many Hbase ShutdownHook 
objects cannot be released. Need to removeShutDownHook thread。
   
![image](https://user-images.githubusercontent.com/18521084/97693034-823b0c80-1adb-11eb-8bed-63040c9207c3.png)
   
![image](https://user-images.githubusercontent.com/18521084/97693251-dcd46880-1adb-11eb-8489-e806d2320ce0.png)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to