Re: REST api for monitoring Spark Streaming

2016-12-01 Thread Chan Chor Pang
hi everyone I have done the coding and create the PR the implementation is straightforward and similar to the api in spark-core but we still need someone with streaming background to verify the patch just to make sure everything is OK so, please anyone can help? https://github.com/apache/spark/p

Re: REST api for monitoring Spark Streaming

2016-11-07 Thread Chan Chor Pang
Thank you this should take me at least a few days, and will let you know as soon as the PR ready. On 11/8/16 11:44 AM, Tathagata Das wrote: This may be a good addition. I suggest you read our guidelines on contributing code to Spark. https://cwiki.apache.org/confluence/display/SPARK/Contri

Re: REST api for monitoring Spark Streaming

2016-11-07 Thread Tathagata Das
This may be a good addition. I suggest you read our guidelines on contributing code to Spark. https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-PreparingtoContributeCodeChanges Its long document but it should have everything for you to figure out how to c

Re: REST api for monitoring Spark Streaming

2016-11-07 Thread Chan Chor Pang
hi everyone it seems that there is not much who interested in creating a api for Streaming. never the less I still really want the api for monitoring. so i tried to see if i can implement by my own. after some test, i believe i can achieve the goal by 1. implement a package(org.apache.spark.st

REST api for monitoring Spark Streaming

2016-09-13 Thread Chan Chor Pang
Hi everyone, Trying to monitoring our streaming application using Spark REST interface only to found that there is no such thing for Streaming. I wonder if anyone already working on this or I should just start implementing my own one? -- BR Peter Chan ---