rmetzger opened a new pull request #14372:
URL: https://github.com/apache/flink/pull/14372


   ## What is the purpose of the change
   
   The Kinesis producer is loading some classes which register static final 
instance fields. These fields prevent the user code classloader from unloading, 
leading to pollution of the JVM Metaspace.
   
   
   ## Verifying this change
   
   I manually verified the behavior by monitoring the metaspace of a 
TaskManager. The initial spikes are caused by a Kinesis Producer implementation 
with the new changes applied (= using the classloader shutdown hook). Later, 
the TM gets killed by running out of JVM metaspace, when running the old 
Kinesis Producer implementation.
   <img width="606" alt="Screenshot 2020-12-12 at 12 27 30" 
src="https://user-images.githubusercontent.com/89049/101992801-17721900-3cb6-11eb-8725-6b7ffc54700f.png";>
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to