Re: Spark Dataset API for secondary sorting

Hi Daniel, This is the user mailing list for Apache Hadoop, not Apache Spark. Please use instead. https://spark.apache.org/community.html -Akira On Tue, Dec 3, 2019 at 1:00 AM Daniel Zhang wrote: > Hi, Spark Users: > > I have a question related to the way I use the spark Dataset API for my >

Re: hadoop java compatability

Hi Augustine, Java 11 is not supported even in the latest version in Apache Hadoop. I hope Apache Hadoop 3.3.0 will support Java 11 (only runtime support) but 3.3.0 is not released yet. (Our company (Yahoo! JAPAN) builds trunk with OpenJDK 8 and run HDFS dev cluster with OpenJDK 11 successfully.)

Re: How can we access multiple Kerberos-enabled Hadoop with different users in single JVM process

Thanks @Thibault but I don't think this could resolve our problem. According to the answers of StackOverflow, we should set multiple realm in the same jaas.conf file and update the system properties to specify the Kerberos principle. But in our process, we need to process multiple requests in the

RE: How can we access multiple Kerberos-enabled Hadoop with different users in single JVM process

Hi, You can configure multiple realms inside /etc/krb5.conf on linux hosts, it will also require relevant DNS configuration and network access in order to work. See: https://stackoverflow.com/questions/26382936/multiple-realms Proxy-users won’t help you in any way, proxy-users rely on the fact