Shruti Gumma created SPARK-32996:
------------------------------------
Summary: Handle Option.empty v1.ExecutorSummary#peakMemoryMetrics
Key: SPARK-32996
URL: https://issues.apache.org/jira/browse/SPARK-32996
Project: Spark
Issue Type: Bug
Components: Web UI
Affects Versions: 3.1.0
Reporter: Shruti Gumma
When {{peakMemoryMetrics}} in {{ExecutorSummary}} is {{Option.empty}}, then the
{{ExecutorMetricsJsonSerializer#serialize}} method does not execute the
{{jsonGenerator.writeObject}} method. This causes the json to be generated with
{{peakMemoryMetrics}} key added to the serialized string, but no corresponding
value.
This causes an error to be thrown when it is the next key {{attributes}} turn
to be added to the json:
{{com.fasterxml.jackson.core.JsonGenerationException: Can not write a field
name, expecting a value.}}
{{}}
{{}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]