Re: 回复: [DISCUSS] Apache Spark 3.0.1 Release

2020-08-15 Thread Koert Kuipers
i noticed commit today that seems to prepare for 3.0.1-rc1: commit 05144a5c10cd37ebdbb55fde37d677def49af11f Author: Ruifeng Zheng Date: Sat Aug 15 01:37:47 2020 + Preparing Spark release v3.0.1-rc1 so i tried to build spark on that commit and i get failure in sql: 09:36:57.371 ERROR o

Re: Spark3 on k8S reading encrypted data from HDFS with KMS in HA

2020-08-15 Thread Michel Sumbul
Hi guys, Does anyone have an idea on this issue? even some tips to troubleshoot it? I got the impression that after the creation of the delegation for the KMS, the token is not sent to the executor or maybe not saved? I'm sure I'm not the only one using Spark with HDFS encrypted with KMS :-) Tha