Github user BryanCutler commented on the pull request:
https://github.com/apache/spark/pull/9670#issuecomment-158160419
Thanks for the response @mengxr. I tried setting the following:
`@volatile protected var model: StreamingKMeansModel = new
StreamingKMeansModel(null, null)`
but still got the failure.
I might have misspoke before, but the point I was trying to get at was that
if the model update was somehow taking a while to complete, outside of the RDD
operations, wouldn't the predict stream just continue or is it somehow blocked?
I tried adding a sleep delay at the end of the scala
`StreamingKMeansModel.update` and this causes the failure every time. That
doesn't prove what is happening, but seems like it could be the case and
doesn't look like a thread visibility issue to me, but I could be very wrong :)
I'll keep looking into it, and appreciate any more suggestions to try.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
