Re: Spark Security

2020-06-01 Thread Wilbert S.
Hello, My hard drive has about 80 GB of space left on it, and the RAM is about 12GB. I am not sure the size of the .tsv file, but it will most likely be around 30 GB. Thanks, Wilbert Seoane On Fri, May 29, 2020 at 5:03 PM Anwar AliKhan wrote: > What is the size of your .tsv file sir ?

Re: Spark Security

2020-05-29 Thread Anwar AliKhan
What is the size of your .tsv file sir ? What is the size of your local hard drive sir ? Regards Wali Ahaad On Fri, 29 May 2020, 16:21 , wrote: > Hello, > > I plan to load in a local .tsv file from my hard drive using sparklyr (an > R package). I have figured out how to do this

Re: Spark Security

2020-05-29 Thread Sean Owen
If you load a file on your computer, that is unrelated to Spark. Whatever you load via Spark APIs will at some point live in memory on the Spark cluster, or the storage you back it with if you store it. Whether the cluster and storage are secure (like, ACLs / auth enabled) is up to whoever runs

Re: Spark Security

2020-05-29 Thread Sean Owen
What do you mean by secure here? On Fri, May 29, 2020 at 10:21 AM wrote: > Hello, > > I plan to load in a local .tsv file from my hard drive using sparklyr (an > R package). I have figured out how to do this already on small files. > > When I decide to receive my client’s large .tsv file, can I

Re: Spark security

2016-10-27 Thread Steve Loughran
On 13 Oct 2016, at 14:40, Mendelson, Assaf > wrote: Hi, We have a spark cluster and we wanted to add some security for it. I was looking at the documentation (in http://spark.apache.org/docs/latest/security.html) and had some questions.

RE: Spark security

2016-10-27 Thread Mendelson, Assaf
Anyone can assist with this? From: Mendelson, Assaf [mailto:assaf.mendel...@rsa.com] Sent: Thursday, October 13, 2016 3:41 PM To: user@spark.apache.org Subject: Spark security Hi, We have a spark cluster and we wanted to add some security for it. I was looking at the documentation (in