Re: How to tell Spark not to use /tmp for snappy-unknown-***-libsnappyjava.so
See the tail of this: https://bugzilla.redhat.com/show_bug.cgi?id=1005811 FYI > On Sep 30, 2015, at 5:54 AM, Dmitry Goldenberg> wrote: > > Is there a way to ensure Spark doesn't write to /tmp directory? > > We've got spark.local.dir specified in the spark-defaults.conf file to point > at another directory. But we're seeing many of these > snappy-unknown-***-libsnappyjava.so files being written to /tmp still. > > Is there a config setting or something that would cause Spark to use another > directory of our choosing? > > Thanks. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: How to tell Spark not to use /tmp for snappy-unknown-***-libsnappyjava.so
Thanks, Ted, will try it out. On Wed, Sep 30, 2015 at 9:07 AM, Ted Yuwrote: > See the tail of this: > https://bugzilla.redhat.com/show_bug.cgi?id=1005811 > > FYI > > > On Sep 30, 2015, at 5:54 AM, Dmitry Goldenberg > wrote: > > > > Is there a way to ensure Spark doesn't write to /tmp directory? > > > > We've got spark.local.dir specified in the spark-defaults.conf file to > point at another directory. But we're seeing many of these > snappy-unknown-***-libsnappyjava.so files being written to /tmp still. > > > > Is there a config setting or something that would cause Spark to use > another directory of our choosing? > > > > Thanks. >
How to tell Spark not to use /tmp for snappy-unknown-***-libsnappyjava.so
Is there a way to ensure Spark doesn't write to /tmp directory? We've got spark.local.dir specified in the spark-defaults.conf file to point at another directory. But we're seeing many of these snappy-unknown-***-libsnappyjava.so files being written to /tmp still. Is there a config setting or something that would cause Spark to use another directory of our choosing? Thanks.