Peter Liu created SPARK-16332:
---------------------------------
Summary: the history server of spark2.0-preview (may-24 build)
consumes more than 1000% cpu
Key: SPARK-16332
URL: https://issues.apache.org/jira/browse/SPARK-16332
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.0.0
Environment: IBM Power8 Habanero (Model: 8348-21C), Red Hat Enterprise
Linux Server release 7.2 (Maipo), Spark2.0.0-preview (May-24, 2016)
Reporter: Peter Liu
the JVM instance of the Spark history server of spark2.0-preview (may-24 build)
consumes more than 1000% cpu without the spark standalone cluster (of 6 nodes)
being under load.
When under load (1TB input data for a SQL query scenario), the JVM instance of
the Spark history server of spark2.0-preview consumes 2000% cpu (as seen with
"top" on linux 3.10)
Note: can't see a proper Component selection here, surely not a Web GUI issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]