Hi
Trying to access GPU from a Spark 1.4.0 Docker slave, without much luck. In my
Spark program, I make a system call to a script, which performs various
calculations using GPU. I am able to run this script as standalone, or via
Mesos Marathon; however, calling the script through Spark fails
Hi
I have a 1.0.0 cluster with multiple worker nodes that deploy a number of
external tasks, through getRuntime().exec. Currently I have no control on how
many nodes get deployed for a given task. At times scheduler evenly distributes
the executors among all nodes and at other times it only
/web/siteassets/legal/privacy.html
From: Akhil Das [mailto:ak...@sigmoidanalytics.com]
Sent: Thursday, April 30, 2015 1:16 AM
To: Nastooh Avessta (navesta)
Cc: user@spark.apache.org
Subject: Re: External Application Run Status
One way you could try would be, Inside the map, you can have
Hi
In a multi-node setup, I am invoking a number external apps, through
Runtime.getRuntime.exec from rdd.map function, and would like to track their
completion status. Evidently, such calls spawn a separate thread, which is not
tracked by the standalone scheduler, i.e., reduce or collect are
=000478326 -
Unsubscribehttp://www.cisco.com/offer/unsubscribe/?sid=000478327 –
Privacyhttp://www.cisco.com/web/siteassets/legal/privacy.html
From: Tathagata Das [mailto:t...@databricks.com]
Sent: Tuesday, March 03, 2015 10:24 PM
To: Nastooh Avessta (navesta)
Cc: user@spark.apache.org
Subject: Re
Hi
On a standalone, Spark 1.0.0, with 1 master and 2 workers, operating in client
mode, running a udp streaming application, I am noting around 2 second elapse
time on switchover, upon shutting down the streaming worker, where streaming
window length is 1 sec. I am wondering what parameters are
Hi
Under Spark 1.0.0, standalone, client mode am trying to invoke a 3rd party udp
traffic generator, from the streaming thread. The excerpt is as follows:
...
do{
try {
p = Runtime.getRuntime().exec(Prog );
socket.receive(packet);
=000478326 -
Unsubscribehttp://www.cisco.com/offer/unsubscribe/?sid=000478327 –
Privacyhttp://www.cisco.com/web/siteassets/legal/privacy.html
From: Tathagata Das [mailto:t...@databricks.com]
Sent: Friday, February 27, 2015 12:39 PM
To: Nastooh Avessta (navesta)
Cc: user@spark.apache.org
Subject: Re: Race
/privacy.html
From: Tathagata Das [mailto:t...@databricks.com]
Sent: Friday, February 27, 2015 12:29 PM
To: Nastooh Avessta (navesta)
Cc: user@spark.apache.org
Subject: Re: Race Condition in Streaming Thread
Are you sure the multiple invocations are not from previous runs of the program?
TD
On Fri, Feb
