[
https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089159#comment-17089159
]
Daniel Templeton commented on SPARK-1537:
-----------------------------------------
Thanks for the response, [~vanzin]. Yeah, I think we would be interested in
exploring the work involved to do the integration. We're in the process of
introducing Spark into Hadoop clusters that primarily run Scalding today.
We're using ATSv2 as the store for all of the Scalding metrics, so it would
make sense for us to do the same with Spark.
Any required reading that we should do as we decide how best to tackle this?
Pointers, tips, tricks, potholes, or any other info would be welcome. Thanks!
> Add integration with Yarn's Application Timeline Server
> -------------------------------------------------------
>
> Key: SPARK-1537
> URL: https://issues.apache.org/jira/browse/SPARK-1537
> Project: Spark
> Issue Type: New Feature
> Components: YARN
> Reporter: Marcelo Masiero Vanzin
> Priority: Major
> Attachments: SPARK-1537.txt, spark-1573.patch
>
>
> It would be nice to have Spark integrate with Yarn's Application Timeline
> Server (see YARN-321, YARN-1530). This would allow users running Spark on
> Yarn to have a single place to go for all their history needs, and avoid
> having to manage a separate service (Spark's built-in server).
> At the moment, there's a working version of the ATS in the Hadoop 2.4 branch,
> although there is still some ongoing work. But the basics are there, and I
> wouldn't expect them to change (much) at this point.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
