[
https://issues.apache.org/jira/browse/SPARK-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586648#comment-14586648
]
Irina Easterling commented on SPARK-8383:
-----------------------------------------
Spark History Server shows Last Updated as 1969/12/31 when SparkPI application
completed
Steps to reproduce:
1. Install Spark thru Ambari Wizard
2. After installation run the Spark Pi Example
3. Navigate to your Spark directory:
baron1:~ # cd /usr/hdp/current/spark-client/
baron1:/usr/hdp/current/spark-client # su spark
spark@baron1:/usr/hdp/current/spark-client> spark-submit --verbose --class
org.apache.spark.examples.SparkPi --master yarn-cluster
--num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores
1 lib/spark-examples*.jar 10
4. When job completed.
5. Access to the Ambari > Spark> Spark History Server UI
6. Click on 'Show incomplete applications' link
7. View the result for completed job
//Results
Last Updated column shows date/time as 1969/12/31 19:00:00 (screenshot attacked)
8. Verify that Spark job completed in YARN. (screenshot attached)
There also discrepancy between SparkHistory Server WebUI and
YARN/ResourceManager WebUI. Spark job completed and it is shown in the
YARN/Resource Manager WebUI. In the SparkHistroyServer WebUI it shows as
Uncompleted.
See attached screenshots.
> Spark History Server shows Last Updated as 1969/12/31 when SparkPI
> application completed
> -----------------------------------------------------------------------------------------
>
> Key: SPARK-8383
> URL: https://issues.apache.org/jira/browse/SPARK-8383
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, Web UI
> Affects Versions: 1.3.1
> Environment: Spark 1.3.1.2.3
> Reporter: Irina Easterling
> Attachments: Spark_WrongLastUpdatedDate.png,
> YARN_SparkJobCompleted.PNG
>
>
> Spark History Server shows Last Updated as 1969/12/31 when SparkPI
> application completed and Started Date is 2015/06/10
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
