Re: [VOTE] Release Spark 2.4.8 (RC2)

2021-04-12 Thread sarutak
+1 (non-binding) +1 On Tue, 13 Apr 2021, 02:58 Sean Owen, wrote: +1 same result as last RC for me. On Mon, Apr 12, 2021, 12:53 AM Liang-Chi Hsieh wrote: Please vote on releasing the following candidate as Apache Spark version 2.4.8. The vote is open until Apr 15th at 9AM PST and passes

Re: [VOTE] Release Spark 2.4.8 (RC2)

2021-04-12 Thread Hyukjin Kwon
+1 On Tue, 13 Apr 2021, 02:58 Sean Owen, wrote: > +1 same result as last RC for me. > > On Mon, Apr 12, 2021, 12:53 AM Liang-Chi Hsieh wrote: > >> Please vote on releasing the following candidate as Apache Spark version >> 2.4.8. >> >> The vote is open until Apr 15th at 9AM PST and passes if a

Re: [VOTE] Release Spark 2.4.8 (RC2)

2021-04-12 Thread Sean Owen
+1 same result as last RC for me. On Mon, Apr 12, 2021, 12:53 AM Liang-Chi Hsieh wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.4.8. > > The vote is open until Apr 15th at 9AM PST and passes if a majority +1 PMC > votes are cast, with a minimum of 3 +1 vote

Re: UserGroupInformation.doAS is working well in Spark Executors?

2021-04-12 Thread yaooqinn
Hi Kwangsun, You may use `—proxy-user` to impersonate. For example, bin/spark-shell --proxy-user kent 21/04/12 23:31:34 WARN Utils: Your hostname, hulk.local resolves to a loopback address: 127.0.0.1; using 192.168.1.14 instead (on interface en0) 21/04/12 23:31:34 WARN Utils: Set SPARK_LOCAL_IP

UserGroupInformation.doAS is working well in Spark Executors?

2021-04-12 Thread Kwangsun Noh
Hi, Spark users. I wanted to make unknown users create HDFS files, not the OS user who executes the spark application. And I thought it would be possible using UserGroupInformation.createRemoteUser(“other”).doAS(…) However, the files are created by the OS user who launched the spark applicati