Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19272
What you wrote sounds correct. However, I've seen errors like the ones
above in the past, but haven't been able to fully debug them due to lack of
logs. Part of it is because the user running the app didn't provide me the full
logs; but also Spark currently doesn't have the logs you added in your debug
code, not even at debug level, so we have only partial information about
exactly what's going on from existing logs. (And these error tend to happen
only after x days, so it's kind of a pain to reproduce.)
That all being said, though, as I mentioned, what you wrote sounds correct
AFAIK.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
