Re: Malhar 0.8.1.1 Kafka Operator and chroot

2016-08-25 Thread McCullough, Alex
Hey Siyuan, Looks like using the single ZK IP with the chroot works, but fails with the same error when adding more than one. Can explain the exact impact of only having the single zk node listed? It can auto discover with ZK the other nodes, but if the one we connect to drops than Apex won’t

FileOutputOperator Rolling Windows Based on Time

2016-08-25 Thread McCullough, Alex
Hey Everyone, I am trying to set up my file output operator so that the files roll every hour. My thought is that in the operator if I know the Streaming Window Size and the Application Window Count, I can easily enough calculate the value I should set for RotationWindows property. I’ve been a

Re: Sandbox Question - Set up more than 8 GIG RAM

2016-08-25 Thread Feldkamp, Brandon (CONT)
Hey Jim, I had to make adjustments to the default memory settings which I accomplished by doing the following: The setting is located in /sfw/hadoop/conf/yarn-site.xml. You should see: 1. yarn.nodemanager.resource.memory-mb (Amount of physical memory, in MB, that can be allocated for cont

Re: Malhar 0.8.1.1 Kafka Operator and chroot

2016-08-25 Thread McCullough, Alex
Hey Siyuan, Sorry for the delay ran into some unrelated cluster issues yesterday that prevented me from testing. Working on testing this this afternoon and I will let you know. Thanks, Alex From: "hsy...@gmail.com" Reply-To: "users@apex.apache.org" Date: Thursday, August 25, 2016 at 12:57 P

Re: Malhar 0.8.1.1 Kafka Operator and chroot

2016-08-25 Thread hsy...@gmail.com
Hey Alex, Does the workaround work? I just want to follow up to see my hypothesis for the root cause is correct. Thanks! Regards, Siyuan On Wed, Aug 24, 2016 at 10:56 AM, hsy...@gmail.com wrote: > Hey Alex, > > Yeah, I think there is a bug for multitenant kafka support in the code. I > have cr