Re: Latency experiment without losing executors

2016-05-19 Thread Ted Yu
16/05/19 15:51:39 WARN CoarseGrainedExecutorBackend: An unknown (ip-10-171-80-97.ec2.internal:44765) driver disconnected. 16/05/19 15:51:42 ERROR TransportClient: Failed to send RPC 5466711974642652953 to ip-10-171-80-97.ec2.internal/10.171.80.97:44765: java.nio.channels.ClosedChannelException java

Re: Latency experiment without losing executors

2016-05-19 Thread Geet Kumar
Ah, it seems the code did not show up in the email. Here is a link to the original post: http://apache-spark-user-list.1001560.n3.nabble.com/Latency-experiment-without-losing-executors-td26981.html Also, attached is the executor logs.​ spark-logging.log

Re: Latency experiment without losing executors

2016-05-19 Thread Ted Yu
I didn't see the code snippet. Were you using picture(s) ? Please pastebin the code. It would be better if you pastebin executor log for the killed executor. Thanks On Wed, May 18, 2016 at 9:41 PM, gkumar7 wrote: > I would like to test the latency (tasks/s) perceived in a simple > application