Hi,
You need good monitoring tools to send you alarms about disk, network
or applications errors, but I think it is general dev ops work not
very specific to spark or hadoop.
BR,
Arkadiusz Bicz
https://www.linkedin.com/in/arkadiuszbicz
On Thu, Feb 11, 2016 at 7:09 PM, Andy Davidson
ion.com>
> Cc: "user @spark" <user@spark.apache.org>
> Subject: Re: best practices? spark streaming writing output detecting disk
> full error
>
> Hi,
>
> You need good monitoring tools to send you alarms about disk, network
> or applications errors, but
:57 AM
To: Andrew Davidson <a...@santacruzintegration.com>
Cc: "user @spark" <user@spark.apache.org>
Subject: Re: best practices? spark streaming writing output detecting disk
full error
> Hi,
>
> You need good monitoring tools to send you alarms about disk, network
&
We recently started a Spark/Spark Streaming POC. We wrote a simple streaming
app in java to collect tweets. We choose twitter because we new we get a lot
of data and probably lots of burst. Good for stress testing
We spun up a couple of small clusters using the spark-ec2 script. In one
cluster
