Re: Kerberos on YARN: delegation or proxying?

2016-03-06 Thread Maximilian Michels
Hi Stefano, That is currently a limitation of the Kerberos implementation. The Kerberos authentication is performed only once the Flink cluster is brought up. The Yarn session is then tight to a particular user's ticket. Note, that you need at least Hadoop version 2.6.1 or higher to run

Re: Retrieve elements from the Dataset without using collect

2016-03-06 Thread subash basnet
Hello Konstantin, Yup thanks. Best Regards, Subash Basnet On Sun, Mar 6, 2016 at 7:20 PM, Konstantin Knauf < konstantin.kn...@tngtech.com> wrote: > [image: Boxbe] This message is eligible > for Automatic Cleanup! (konstantin.kn...@tngtech.com) Add cleanup rule

Re: Retrieve elements from the Dataset without using collect

2016-03-06 Thread Konstantin Knauf
Hi Subash, I think Dataset.first(int n) is what you are looking for. Cheers, Konstantin On 06.03.2016 19:10, subash basnet wrote: > Hello all, > > My requirement is to get suppose top '10' elements from the DataSet as > another DataSet. How would I do that without using collect. > Eg: >

Retrieve elements from the Dataset without using collect

2016-03-06 Thread subash basnet
Hello all, My requirement is to get suppose top '10' elements from the DataSet as another DataSet. How would I do that without using collect. Eg: *DataSet> counts =* *data.flatMap(new Tokenizer());* I want a new DataSet containing 10 elements of *counts*. And, what

Re: Kerberos on YARN: delegation or proxying?

2016-03-06 Thread Stefano Baghino
One last note: initially I tried to run the session as the same OS user, running kdestroy and then kinit with the other user, having this error. Trying to run the job in a different OS session, authenticating with Kerberos as the user who should run the job, I can't connect to the JobManager. I've