Itsuki Toyota created SPARK-32428:
-------------------------------------
Summary: [EXAMPLES] Make BinaryClassificationMetricsExample
consistently print the metrics on driver's stdout
Key: SPARK-32428
URL: https://issues.apache.org/jira/browse/SPARK-32428
Project: Spark
Issue Type: Improvement
Components: Examples
Affects Versions: 3.0.0, 2.4.6
Reporter: Itsuki Toyota
Some RDDs in this example (e.g., precision, recall) call println without
calling collect.
If the job is under local mode, it sends the data to the driver node and prints
the metrics on the driver's stdout.
However if the job is under cluster mode, the job prints the metrics on the
executor's stdout.
It seems inconsistent compared to the other metrics nothing to do with RDD
(e.g., auPRC, auROC) since these metrics always output the result on the
driver's stdout.
All of the metrics should output its result on the driver's stdout.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
