Re: Operators in PENDING_DEPLOY

2016-08-12 Thread Pradeep A. Dalvi
Can you share AppMaster logs? What are container resource requests in AppMaster logs? --prad On Fri, Aug 12, 2016 at 9:28 AM, Ankit Sarraf wrote: > When I deploy my application on DTConsole, all applications are in pending > deploy state. The App itself is showing

Re: Round Robin Partitioning with Dynamic Partitioning

2016-08-12 Thread Thomas Weise
If idempotency is needed (replay on recovery) and the order of tuples in the stream can change within a window (multiple upstream partitions), then it may be better to use a stateless hash function that ensures even distribution. On Fri, Aug 12, 2016 at 10:10 AM, Munagala Ramanath

Re: Round Robin Partitioning with Dynamic Partitioning

2016-08-12 Thread Munagala Ramanath
I assume the situation is that you have operators A -> {B1, B2, ...} where Bi are partitions of B and you want to distribute incoming tuples from A to the Bi in round-robin fashion. For this, you'll need to create a StreamCodec; please see:

Re: Round Robin Partitioning with Dynamic Partitioning

2016-08-12 Thread McCullough, Alex
Thanks Ram. If I didn’t want dynamic partitioning and just round robin on a fixed # of partitions, can it just be set through a property? If so, what is the property? From: Munagala Ramanath Reply-To: "users@apex.apache.org" Date: Friday, August

Round Robin Partitioning with Dynamic Partitioning

2016-08-12 Thread McCullough, Alex
I can’t find any examples of how to set round robin partitioning or how to set dynamic partitioning, are there any example applications I can look at? The DataTorrent/Examples github page has a dynamic partitioning example but it just looks to be a shell, I don’t see any actual logic

Re: Information Needed

2016-08-12 Thread Priyanka Gugale
Hi, We have parsers examples at: https://github.com/DataTorrent/examples/tree/master/tutorials/parser (The csv parser example will be available in couple of days) Check if this can help you. -Priyanka On Thu, Aug 11, 2016 at 7:05 PM, Mukkamula, Suryavamshivardhan (CWM-NR) <