[DISCUSS] KIP-28 - Add a transform client for data processing

2015-08-19 Thread Yan Fang
Hi Guozhang, Thank you for writing the KIP-28 up. (Hope this is the right thread for me to post some comments. :) I still have some confusing about the implementation of the Processor: 1. why do we maintain a separate consumer and producer for each worker thread? — from my understanding,

Re: [Discuss/Vote] upgrade to Yarn 2.6.0

2015-08-19 Thread Roger Hoover
We're using 2.4.0 in production. Are there any major incompatibilities to watch out for when upgrading to 2.6.0? Thanks, Roger On Mon, Aug 17, 2015 at 4:41 PM, Yan Fang yanfang...@gmail.com wrote: Hi guys, we have been discussing upgrading to Yarn 2.6.0 (SAMZA-536

[DISCUSS] Sliding window implementation in Samza

2015-08-19 Thread Mhaskar, Tushar
Hi, 1. I came across Windowing functionality in Samza. It looks like it implements a static window. Is there a sliding window functionality available in Samza? 2. How to do aggregation across multi-node yarn node, any pointers to it? E.g : Lets say I have 2 slave machines

Re: [DISCUSS] KIP-28 - Add a transform client for data processing

2015-08-19 Thread Guozhang Wang
Hello Yan, Thanks for the feedback, replies inlined. Guozhang On Wed, Aug 19, 2015 at 8:22 AM, Yan Fang yanfang...@me.com wrote: Hi Guozhang, Thank you for writing the KIP-28 up. (Hope this is the right thread for me to post some comments. :) I still have some confusing about the

Review Request 37604: SAMZA-760 Samza Container should catch Throwables instead of just catching Exceptions

2015-08-19 Thread Aleksandar Bircakovic
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37604/ --- Review request for samza. Repository: samza Description --- Added a

Re: Review Request 37528: SAMZA-736 BrokerProxy will stuck in infinite loop if consumer.fetch throws OOME

2015-08-19 Thread Aleksandar Pejakovic
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37528/ --- (Updated Aug. 19, 2015, 9:03 a.m.) Review request for samza. Changes ---