Re: Retry functionality in Datatorrent

2016-10-19 Thread Ashwin Chandra Putta
gt; >>> >>> Hadoop version : hadoop-2.7.0 (Mapr distribution 5.1) >>> >>> >>> >>> Thanks, >>> >>> Srinivas >>> >>> >>> >>> *From:* Ashwin Chandra Putta [mailto:ashwinchand...@gmail.com] >>

Re: Retry functionality in Datatorrent

2016-10-19 Thread Jaspal Singh
gt;> >> Hadoop version : hadoop-2.7.0 (Mapr distribution 5.1) >> >> >> >> Thanks, >> >> Srinivas >> >> >> >> *From:* Ashwin Chandra Putta [mailto:ashwinchand...@gmail.com] >> *Sent:* Wednesday, October 19, 2016 3:05 PM >>

Re: Retry functionality in Datatorrent

2016-10-19 Thread Ashwin Chandra Putta
; > > > *From:* Ashwin Chandra Putta [mailto:ashwinchand...@gmail.com] > *Sent:* Wednesday, October 19, 2016 2:40 PM > *To:* users@apex.apache.org > *Subject:* Re: Retry functionality in Datatorrent > > > > Jaspal, > > > > Ensure that the app package is not inc

RE: Retry functionality in Datatorrent

2016-10-19 Thread Bandaru, Srinivas
lt;mailto:users@apex.apache.org> Subject: Re: Retry functionality in Datatorrent Jaspal, Ensure that the app package is not including any hadoop jars as dependencies. Check target/deps/ You can exclude those dependencies in the maven pom file. Regards, Ashwin. On Wed, Oct 19, 2016 at 12:0

Re: Retry functionality in Datatorrent

2016-10-19 Thread Ashwin Chandra Putta
wrote: > We have a Hbase client dependency and do not have any Hadoop dependencies > in project. > > > > *From:* Ashwin Chandra Putta [mailto:ashwinchand...@gmail.com] > *Sent:* Wednesday, October 19, 2016 2:40 PM > *To:* users@apex.apache.org > *Subject:* Re: R

RE: Retry functionality in Datatorrent

2016-10-19 Thread Bandaru, Srinivas
We have a Hbase client dependency and do not have any Hadoop dependencies in project. From: Ashwin Chandra Putta [mailto:ashwinchand...@gmail.com] Sent: Wednesday, October 19, 2016 2:40 PM To: users@apex.apache.org Subject: Re: Retry functionality in Datatorrent Jaspal, Ensure that the app

Re: Retry functionality in Datatorrent

2016-10-19 Thread Ashwin Chandra Putta
Jaspal, Ensure that the app package is not including any hadoop jars as dependencies. Check target/deps/ You can exclude those dependencies in the maven pom file. Regards, Ashwin. On Wed, Oct 19, 2016 at 12:09 PM, Jaspal Singh wrote: > Hi Ashwin, That's correct flow !! > > Team - ANother thin

Re: Retry functionality in Datatorrent

2016-10-19 Thread Jaspal Singh
Hi Ashwin, That's correct flow !! Team - ANother thing we are receiving below exception in the logs and application is FAILING when we are trying to make an update to HBase table. Any idea what could be the reason ? Container: container_e32_1476503307399_0172_02_01 on dbslt0079.uhc.com_8091

Re: Retry functionality in Datatorrent

2016-10-18 Thread Ashwin Chandra Putta
Jaspal, If I understand this correctly, the flow looks like this. REST API --> Kafka topic --> Apex Kafka Input Operator. If this is the flow, then the kafka input operator should be reading messages from Kafka without losing them. There is no retry attempts necessary. Let me know if the unders

Retry functionality in Datatorrent

2016-10-18 Thread Jaspal Singh
Hi Team, We are pushing messages from Kafka to Datatorrent application using REST API service as a producer. If say due to some issue with the service the message couldn't be pushed/processed so we want to "retry it for n times" before it is dropped. Is there any retry functionality built within