Re: Spark job tracker.

2014-08-04 Thread abhiguruvayya
. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p11351.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user

Re: Spark job tracker.

2014-07-23 Thread abhiguruvayya
thread and read the sparkListener interface implementation methods in another thread. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p10548.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark job tracker.

2014-07-22 Thread Marcelo Vanzin
.nabble.com/Spark-job-tracker-tp8367p10287.html Sent from the Apache Spark User List mailing list archive at Nabble.com. -- Marcelo

Re: Spark job tracker.

2014-07-22 Thread abhiguruvayya
.1001560.n3.nabble.com/Spark-job-tracker-tp8367p10433.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark job tracker.

2014-07-22 Thread Marcelo Vanzin
to filter some of the unnecessary logs. Can you let me know where can i find this properties file. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p10433.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Spark job tracker.

2014-07-22 Thread abhiguruvayya
log4j.logger.spark.MapOutputTrackerActor=INFO, myFileAppender log4j.additivity.spark.MapOutputTrackerActor=false log4j.logger.spark.MapOutputTracker=INFO, myFileAppender log4j.additivty.spark.MapOutputTracker=false -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job

Re: Spark job tracker.

2014-07-22 Thread Marcelo Vanzin
.n3.nabble.com/Spark-job-tracker-tp8367p10440.html Sent from the Apache Spark User List mailing list archive at Nabble.com. -- Marcelo

Re: Spark job tracker.

2014-07-21 Thread abhiguruvayya
Hello Marcelo Vanzin, Can you explain bit more on this? I tried using client mode but can you explain how can i use this port to write the log or output to this port?Thanks in advance! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker

Re: Spark job tracker.

2014-07-21 Thread abhiguruvayya
/application_1405471266091_0055/commons-math3-3.0.jar. from the logs. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p10343.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark job tracker.

2014-07-10 Thread abhiguruvayya
: UNDEFINED appTrackingUrl: *** appUser: hadoop Which port do i have to hook in to write my statistics details rather than this default output. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p9315.html Sent

Re: Spark job tracker.

2014-07-10 Thread Marcelo Vanzin
. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p9315.html Sent from the Apache Spark User List mailing list archive at Nabble.com. -- Marcelo

Re: Spark job tracker.

2014-07-09 Thread Mayur Rustagi
public void onStageCompleted(SparkListenerStageCompleted arg0) { } @Override public void onStageSubmitted(SparkListenerStageSubmitted arg0) { } -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker

Re: Spark job tracker.

2014-07-08 Thread abhiguruvayya
) { } @Override public void onStageSubmitted(SparkListenerStageSubmitted arg0) { } -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p9104.html Sent from the Apache Spark User List mailing list archive

Re: Spark job tracker.

2014-07-04 Thread Mayur Rustagi
this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p8697.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark job tracker.

2014-07-02 Thread abhiguruvayya
Spark displays job status information on port 4040 using JobProgressListener, any one knows how to hook into this port and read the details? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p8697.html Sent from the Apache Spark User

Re: Spark job tracker.

2014-06-27 Thread abhiguruvayya
Hello Mayur, Are you using SparkListener interface java API? I tried using it but was unsuccessful. So need few more inputs. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p8438.html Sent from the Apache Spark User List mailing

Re: Spark job tracker.

2014-06-27 Thread abhiguruvayya
._2); } System.exit(0); } } -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p8472.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark job tracker.

2014-06-26 Thread Mayur Rustagi
at 2:31 AM, abhiguruvayya sharath.abhis...@gmail.com wrote: I don't want to track it on the cluster UI. Once i launch the job i would to like to print the status. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p8370.html Sent