Thanks for help. I am able to launch application now, but it is failing later
with below exception.
2016-08-29 08:25:11,414 WARN com.datatorrent.stram.client.EventsAgent: Got
exception when reading events
java.io.FileNotFoundException: File does not exist:
/user/bj9306/datatorrent/apps/application_1472055988122_0010/events/index.txt
at
org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
at
org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1828)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1799)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1712)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:652)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:365)
at
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
From: Chaitanya Chebolu [mailto:[email protected]]
Sent: Monday, August 29, 2016 6:48 AM
To: [email protected]
Subject: Re: Issue when Launching apps having KafkaInput
Please set the zookeeper property to the consumer of Kafka Input Operator using
parameter dt.operator.<Kafka-Input-Operator-Name>.prop.consumer.zookeeper.
On Mon, Aug 29, 2016 at 6:44 PM, JOHN, BIBIN
<[email protected]<mailto:[email protected]>> wrote:
I am using 3.4.0
From: Chaitanya Chebolu
[mailto:[email protected]<mailto:[email protected]>]
Sent: Monday, August 29, 2016 4:44 AM
To: [email protected]<mailto:[email protected]>
Subject: Re: Issue when Launching apps having KafkaInput
Hi John,
From the debug message, value of zookeeperMap is null. You need to set the
zookeeper property.
Which version of Malhar are you using?
Regards,
Chaitanya
On Mon, Aug 29, 2016 at 3:15 PM, JOHN, BIBIN
<[email protected]<mailto:[email protected]>> wrote:
Team,
Could you please help me to debug this issue?
An error occurred trying to launch the application. Server message:
javax.validation.ConstraintViolationException: Operator kafkainput violates
constraints
[ConstraintViolationImpl{rootBean=com.att.dti.dtdemo1.app.Application$KafkaInput@5a04a4b6,
propertyPath='consumer.zookeeperMap', message='may not be null',
leafBean=com.datatorrent.contrib.kafka.SimpleKafkaConsumer@768e3249<mailto:leafBean=com.datatorrent.contrib.kafka.SimpleKafkaConsumer@768e3249>,
value=null}] at
com.datatorrent.stram.plan.logical.LogicalPlan.validate(LogicalPlan.java:1674)
at com.datatorrent.stram.StramClient.<init>(StramClient.java:163) at
com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:596)
at com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:2056)
at com.datatorrent.stram.cli.ApexCli.launchAppPackage(ApexCli.java:3445) at
com.datatorrent.stram.cli.ApexCli.access$7400(ApexCli.java:151) at
com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:1900) at
com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1462)
Thanks and Regards,
Bibin John| Data Movement Technology Development
20205 North Creek Pkwy , Bothell, WA 98011 USA
• Office: (770) 235 5614 | Cell: (469) 648-9858
Email: [email protected]<mailto:[email protected]>
OOO Alert : 09/19/2016 – 10/14/2016
