[GitHub] [spark] HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

Mon, 09 Sep 2019 05:55:39 -0700 

HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB] Enforce 
not leaking SparkContext in tests which creates new StreamingContext with new 
SparkContext
URL: https://github.com/apache/spark/pull/25709#issuecomment-529459986
 
 
   Here's the comparison between other builds (emphasized `#110323 ` via 
rectangle):
   
   
![SPARK-29007-elapsed-time-comparison-dstream-closure-suite](https://user-images.githubusercontent.com/1317309/64532285-25ffb100-d34c-11e9-8dc0-56f8be8ec964.png)
   
![SPARK-29007-elapsed-time-comparison-dstream-scope-suite](https://user-images.githubusercontent.com/1317309/64532286-25ffb100-d34c-11e9-8e9a-096866152397.png)
   
![SPARK-29007-elapsed-time-comparison-kinesis](https://user-images.githubusercontent.com/1317309/64532287-26984780-d34c-11e9-901e-fae48b986e3c.png)
   (Showing N mins are only valid - some tests are disabled if flag is turned 
off.)
   
   
![SPARK-29007-elapsed-time-comparison-receiver-input-dstream-suite](https://user-images.githubusercontent.com/1317309/64532288-26984780-d34c-11e9-8980-3953def194ee.png)
   
   Looks like it might be able to contribute couple of seconds (or even more) 
but it seems to be small compared to the fluctuation among builds.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to