Re: Runtime property modifications for an Apex Application

2016-07-05 Thread Ashwin Chandra Putta
Raja, You can set log levels for class path patterns for running applications from gateway. Not sure if you can do it from CLI. http://docs.datatorrent.com/configuration/#adjusting-logging-levels Regards, Ashwin. On Tue, Jul 5, 2016 at 2:53 PM, Raja.Aravapalli

Re: how to increase lifetime of hdfs delegation tokens ?

2016-07-05 Thread Pramod Immaneni
Hi Raja, Do you have admin access to the cluster? If so look for the properties yarn.resourcemanager.delegation.token.max-lifetime and dfs.namenode.delegation.token.max-lifetime in your Hadoop configuration. They should currently be set to 7 days. This is what is making the tokens expire after

Runtime property modifications for an Apex Application

2016-07-05 Thread Raja . Aravapalli
Hi, Is it possible for me to set below DEBUG property for a running applicaion using apex command line tool, without killing or shutting down a running application ? dt.attr.DEBUG true If so can someone help me with the command, how I can achieve this ? Thank you. Regards, Raja.

Re: how to increase lifetime of hdfs delegation tokens ?

2016-07-05 Thread Raja . Aravapalli
Hi Pramod, As suggested in step2, I added the properties you provided below, and ran a new job, to see the debug lines "number of tokens: " and "updated token: " And, as you said, I can see those lines in the application log now.. Does this mean, the renewal is working as expected ? So, will

Question on KafkaInputOperator - with kafka 0.8.2.1

2016-07-05 Thread Martin, Eric
Hi all, I am using the 0.8.x version of the Kafka Input Operators. When using these operators, I am able to run the application fine while using kafka version 0.8.1.1. However, if I use version 0.8.2.x, I am not able to run the application even though the kafka cluster that I am connecting is