[
https://issues.apache.org/jira/browse/SPARK-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979386#comment-14979386
]
Xin Ren commented on SPARK-11155:
---------------------------------
Hi sorry for being slow, this is my first attempt to change spark code, and
just managed to set up IntelliJ and build the source code from IntelliJ
successfully.
Could you please tell me how to debug the source code? as my understanding, if
I make some code changes in the source code and test it, I have to:
1. build the project after each code change (takes a long time to finish...)
2. start spark cluster by running "./sbin/start-all.sh"
3. test UI by running "./bin/spark-class
org.apache.spark.ui.UIWorkloadGenerator spark://mac-xr.local:7077 FAIR 1"
I tried to google how to debug step by step for source code but didn't find
much useful, mostly for debugging Spark app but not Spark source code itself.
Could you please tell me how to debug Spark source code step by step in debug
mode?
Thank you very much :)
> Stage summary json should include stage duration
> -------------------------------------------------
>
> Key: SPARK-11155
> URL: https://issues.apache.org/jira/browse/SPARK-11155
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Reporter: Imran Rashid
> Assignee: Xin Ren
> Priority: Minor
> Labels: Starter
>
> The json endpoint for stages doesn't include information on the stage
> duration that is present in the UI. This looks like a simple oversight, they
> should be included. eg., the metrics should be included at
> {{api/v1/applications/<appId>/stages}}. The missing metrics are
> {{submissionTime}} and {{completionTime}} (and whatever other metrics come
> out of the discussion on SPARK-10930)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
