Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/22384#discussion_r216454727
--- Diff: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ---
@@ -584,8 +583,7 @@ private object LiveEntityHelpers {
.filter { acc =>
// We don't need to store internal or SQL accumulables as their
values will be shown in
// other places, so drop them to reduce the memory usage.
- !acc.internal && (!acc.metadata.isDefined ||
- acc.metadata.get !=
Some(AccumulatorContext.SQL_ACCUM_IDENTIFIER))
+ !acc.internal && acc.metadata !=
Some(AccumulatorContext.SQL_ACCUM_IDENTIFIER)
--- End diff --
CC @vanzin on this one for a double-check
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
