Re: Behavior of lib directory shipping on YARN

Yup, I shall open an issue for both this one and my other thread (re: Kerberos). Thanks for the pointer on this issue. On Tue, Mar 29, 2016 at 12:44 PM, Maximilian Michels wrote: > Hi Stefano, > > Thanks for pointing out this bug. Your analysis is correct. The per-job > cluster

Re: Behavior of lib directory shipping on YARN

Hi Stefano, Thanks for pointing out this bug. Your analysis is correct. The per-job cluster does not ship the /lib directory by default. Would you like to open an issue/PR? We should let the ship_path default to the /lib directory. The mechanism with the environment variables is the same. They

Re: Behavior of lib directory shipping on YARN

On Tue, Mar 22, 2016 at 8:42 PM, Stefano Baghino wrote: > My feeling is that running a job on YARN should > end up in having more or less the same effect, regardless of the way the > job is run. +1 I think that the current behaviour is buggy. The resource

Behavior of lib directory shipping on YARN

Hello everybody, in the past few days me and my colleagues ran some tests with Flink on YARN and detected a possible inconsistent behavior in the way the contents of the flink/lib directory is shipped to the cluster when run on YARN, depending on the fact that the jobs are deployed individually