Attached is the list of jars inside target/deps directory.
Thanks!!
On Wed, Oct 19, 2016 at 3:48 PM, Ashwin Chandra Putta <
[email protected]> wrote:
> Ok, versions seem compatible. Can you do an ls on the target/deps/
> directory and send the list of included jars?
>
> Regards,
> Ashwin.
>
> On Wed, Oct 19, 2016 at 1:12 PM, Bandaru, Srinivas <
> [email protected]> wrote:
>
>> Mapr RD version:
>>
>> <groupId>org.apache.hbase</groupId>
>> <artifactId>hbase-client</artifactId>
>> <version>*1.1.1-mapr-1602*</version>
>>
>>
>>
>>
>>
>> Hadoop version : hadoop-2.7.0 (Mapr distribution 5.1)
>>
>>
>>
>> Thanks,
>>
>> Srinivas
>>
>>
>>
>> *From:* Ashwin Chandra Putta [mailto:[email protected]]
>> *Sent:* Wednesday, October 19, 2016 3:05 PM
>>
>> *To:* [email protected]
>> *Subject:* Re: Retry functionality in Datatorrent
>>
>>
>>
>> What is your HBase client version? Also, what is the version of hadoop on
>> your cluster?
>>
>>
>>
>> Make sure that the HBase client version is compatible with the version of
>> hadoop you are running.
>>
>>
>>
>> Regards,
>>
>> Ashwin.
>>
>>
>>
>> On Wed, Oct 19, 2016 at 12:54 PM, Bandaru, Srinivas <
>> [email protected]> wrote:
>>
>> We have a Hbase client dependency and do not have any Hadoop dependencies
>> in project.
>>
>>
>>
>> *From:* Ashwin Chandra Putta [mailto:[email protected]]
>> *Sent:* Wednesday, October 19, 2016 2:40 PM
>> *To:* [email protected]
>> *Subject:* Re: Retry functionality in Datatorrent
>>
>>
>>
>> Jaspal,
>>
>>
>>
>> Ensure that the app package is not including any hadoop jars as
>> dependencies. Check target/deps/
>>
>>
>>
>> You can exclude those dependencies in the maven pom file.
>>
>>
>>
>> Regards,
>>
>> Ashwin.
>>
>>
>>
>> On Wed, Oct 19, 2016 at 12:09 PM, Jaspal Singh <
>> [email protected]> wrote:
>>
>> Hi Ashwin, That's correct flow !!
>>
>> Team - ANother thing we are receiving below exception in the logs and
>> application is FAILING when we are trying to make an update to HBase table.
>> Any idea what could be the reason ?
>>
>> Container: container_e32_1476503307399_0172_02_000001 on
>> dbslt0079.uhc.com_8091
>>
>> ============================================================
>> =====================
>>
>> LogType:AppMaster.stderr
>>
>> Log Upload Time:Wed Oct 19 11:35:36 -0500 2016
>>
>> LogLength:1246
>>
>> Log Contents:
>>
>> SLF4J: Class path contains multiple SLF4J bindings.
>>
>> SLF4J: Found binding in [jar:file:/opt/mapr/tmp/hadoop
>> -mapr/nm-local-dir/usercache/mapr/appcache/application_
>> 1476503307399_0172/filecache/26/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/
>> StaticLoggerBinder.class]
>>
>> SLF4J: Found binding in [jar:file:/opt/mapr/lib/slf4j-
>> log4j12-1.7.12.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>
>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>> explanation.
>>
>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>>
>> Exception in thread "main" java.lang.IllegalArgumentException: Invalid
>> ContainerId: container_e32_1476503307399_0172_02_000001
>>
>> at org.apache.hadoop.yarn.util.ConverterUtils.toContainerId(Con
>> verterUtils.java:182)
>>
>> at com.datatorrent.stram.StreamingAppMaster.main(StreamingAppMa
>> ster.java:91)
>>
>> Caused by: java.lang.NumberFormatException: For input string: "e32"
>>
>> at java.lang.NumberFormatException.forInputString(NumberFormatE
>> xception.java:65)
>>
>> at java.lang.Long.parseLong(Long.java:589)
>>
>> at java.lang.Long.parseLong(Long.java:631)
>>
>> at org.apache.hadoop.yarn.util.ConverterUtils.toApplicationAtte
>> mptId(ConverterUtils.java:137)
>>
>> at org.apache.hadoop.yarn.util.ConverterUtils.toContainerId(Con
>> verterUtils.java:177)
>>
>> ... 1 more
>>
>> End of LogType:AppMaster.stderr
>>
>>
>>
>> Thanks!!
>>
>>
>>
>> On Tue, Oct 18, 2016 at 7:47 PM, Ashwin Chandra Putta <
>> [email protected]> wrote:
>>
>> Jaspal,
>>
>>
>>
>> If I understand this correctly, the flow looks like this.
>>
>>
>>
>> REST API --> Kafka topic --> Apex Kafka Input Operator.
>>
>>
>>
>> If this is the flow, then the kafka input operator should be reading
>> messages from Kafka without losing them. There is no retry attempts
>> necessary.
>>
>>
>> Let me know if the understanding of the flow is incorrect.
>>
>>
>>
>> Regards,
>>
>> Ashwin.
>>
>>
>>
>> On Tue, Oct 18, 2016 at 2:49 PM, Jaspal Singh <[email protected]>
>> wrote:
>>
>> Hi Team,
>>
>> We are pushing messages from Kafka to Datatorrent application using REST
>> API service as a producer. If say due to some issue with the service the
>> message couldn't be pushed/processed so we want to "retry it for n times"
>> before it is dropped.
>>
>> Is there any retry functionality built within Datatorrent or we have
>> write some code logic for the same ??
>>
>> Thanks!!
>>
>>
>>
>>
>>
>> --
>>
>>
>>
>> Regards,
>>
>> Ashwin.
>>
>>
>>
>>
>>
>>
>>
>> --
>>
>>
>>
>> Regards,
>>
>> Ashwin.
>>
>>
>> This e-mail, including attachments, may include confidential and/or
>> proprietary information, and may be used only by the person or entity
>> to which it is addressed. If the reader of this e-mail is not the intended
>> recipient or his or her authorized agent, the reader is hereby notified
>> that any dissemination, distribution or copying of this e-mail is
>> prohibited. If you have received this e-mail in error, please notify the
>> sender by replying to this message and delete this e-mail immediately.
>>
>>
>>
>>
>>
>> --
>>
>>
>>
>> Regards,
>>
>> Ashwin.
>>
>>
>> This e-mail, including attachments, may include confidential and/or
>> proprietary information, and may be used only by the person or entity
>> to which it is addressed. If the reader of this e-mail is not the intended
>> recipient or his or her authorized agent, the reader is hereby notified
>> that any dissemination, distribution or copying of this e-mail is
>> prohibited. If you have received this e-mail in error, please notify the
>> sender by replying to this message and delete this e-mail immediately.
>>
>
>
>
> --
>
> Regards,
> Ashwin.
>
Volume in drive C is OS
Volume Serial Number is 50FB-722D
Directory of
C:\Work\Datatorrent-projects\bdp-datatorrent-mapr-streams\target\deps
10/19/2016 03:52 PM <DIR> .
10/19/2016 03:52 PM <DIR> ..
10/19/2016 01:47 PM 62,983 activation-1.1.jar
10/19/2016 01:47 PM 4,467 aopalliance-1.0.jar
10/19/2016 01:47 PM 44,925 apacheds-i18n-2.0.0-M15.jar
10/19/2016 01:47 PM 691,479 apacheds-kerberos-codec-2.0.0-M15.jar
10/19/2016 01:47 PM 16,560 api-asn1-api-1.0.0-M20.jar
10/19/2016 01:47 PM 79,912 api-util-1.0.0-M20.jar
10/19/2016 01:47 PM 43,033 asm-3.1.jar
10/19/2016 01:47 PM 303,139 avro-1.7.4.jar
10/19/2016 01:47 PM 41,123 commons-cli-1.2.jar
10/19/2016 01:47 PM 284,184 commons-codec-1.10.jar
10/19/2016 01:47 PM 588,337 commons-collections-3.2.2.jar
10/19/2016 01:47 PM 241,367 commons-compress-1.4.1.jar
10/19/2016 01:47 PM 298,829 commons-configuration-1.6.jar
10/19/2016 01:47 PM 143,602 commons-digester-1.8.jar
10/19/2016 01:47 PM 305,001 commons-httpclient-3.1.jar
10/19/2016 01:47 PM 185,140 commons-io-2.4.jar
10/19/2016 01:47 PM 284,220 commons-lang-2.6.jar
10/19/2016 01:47 PM 61,829 commons-logging-1.2.jar
10/19/2016 01:47 PM 1,599,627 commons-math3-3.1.1.jar
10/19/2016 01:47 PM 273,370 commons-net-3.1.jar
10/19/2016 01:47 PM 69,500 curator-client-2.7.1.jar
10/19/2016 01:47 PM 186,273 curator-framework-2.7.1.jar
10/19/2016 01:47 PM 270,342 curator-recipes-2.7.1.jar
10/19/2016 01:47 PM 15,322 findbugs-annotations-1.3.9-1.jar
10/19/2016 01:47 PM 21,817 gmbal-api-only-3.0.0-b023.jar
10/19/2016 01:47 PM 690,573 grizzly-framework-2.1.2.jar
10/19/2016 01:47 PM 253,086 grizzly-http-2.1.2.jar
10/19/2016 01:47 PM 198,255 grizzly-http-server-2.1.2.jar
10/19/2016 01:47 PM 336,904 grizzly-http-servlet-2.1.2.jar
10/19/2016 01:47 PM 8,114 grizzly-rcm-2.1.2.jar
10/19/2016 01:47 PM 202,837 gson-2.0.jar
10/19/2016 01:47 PM 1,795,932 guava-12.0.1.jar
10/19/2016 01:47 PM 710,492 guice-3.0.jar
10/19/2016 01:47 PM 65,012 guice-servlet-3.0.jar
10/19/2016 01:47 PM 16,778 hadoop-annotations-2.2.0.jar
10/19/2016 01:47 PM 89,569 hadoop-auth-2.7.0-mapr-1602.jar
10/19/2016 01:47 PM 3,467,221 hadoop-common-2.7.0-mapr-1602.jar
10/19/2016 01:47 PM 1,540,354
hadoop-mapreduce-client-core-2.7.0-mapr-1602.jar
10/19/2016 01:47 PM 1,158,936 hadoop-yarn-api-2.2.0.jar
10/19/2016 01:47 PM 1,301,627 hadoop-yarn-common-2.2.0.jar
10/19/2016 01:47 PM 20,790 hbase-annotations-1.1.1-mapr-1602.jar
10/19/2016 01:47 PM 1,284,915 hbase-client-1.1.1-mapr-1602.jar
10/19/2016 01:47 PM 532,052 hbase-common-1.1.1-mapr-1602.jar
10/19/2016 01:47 PM 4,201,682 hbase-protocol-1.1.1-mapr-1602.jar
10/19/2016 01:47 PM 1,475,955 htrace-core-3.1.0-incubating.jar
10/19/2016 01:47 PM 590,533 httpclient-4.3.5.jar
10/19/2016 01:47 PM 282,269 httpcore-4.3.2.jar
10/19/2016 01:47 PM 33,491 jackson-annotations-2.2.2.jar
10/19/2016 01:47 PM 191,738 jackson-core-2.2.2.jar
10/19/2016 01:47 PM 228,286 jackson-core-asl-1.9.2.jar
10/19/2016 01:47 PM 866,104 jackson-databind-2.2.2.jar
10/19/2016 01:47 PM 765,648 jackson-mapper-asl-1.9.2.jar
10/19/2016 03:52 PM 0 jars.txt
10/19/2016 01:47 PM 2,497 javax.inject-1.jar
10/19/2016 01:47 PM 83,945 javax.servlet-3.1.jar
10/19/2016 01:47 PM 85,353 javax.servlet-api-3.0.1.jar
10/19/2016 01:47 PM 105,134 jaxb-api-2.2.2.jar
10/19/2016 01:47 PM 890,168 jaxb-impl-2.2.3-1.jar
10/19/2016 01:47 PM 1,291,164 jcodings-1.0.8.jar
10/19/2016 01:47 PM 130,458 jersey-client-1.9.jar
10/19/2016 01:47 PM 458,739 jersey-core-1.9.jar
10/19/2016 01:47 PM 17,542 jersey-grizzly2-1.9.jar
10/19/2016 01:47 PM 14,786 jersey-guice-1.9.jar
10/19/2016 01:47 PM 147,952 jersey-json-1.9.jar
10/19/2016 01:47 PM 713,089 jersey-server-1.9.jar
10/19/2016 01:47 PM 28,100 jersey-test-framework-core-1.9.jar
10/19/2016 01:47 PM 12,976 jersey-test-framework-grizzly2-1.9.jar
10/19/2016 01:47 PM 67,758 jettison-1.1.jar
10/19/2016 01:47 PM 177,131 jetty-util-6.1.26.jar
10/19/2016 01:47 PM 187,292 joni-2.1.2.jar
10/19/2016 01:47 PM 185,746 jsch-0.1.42.jar
10/19/2016 01:47 PM 37,875 json-20080701.jar
10/19/2016 01:47 PM 33,015 jsr305-1.3.9.jar
10/19/2016 01:47 PM 650,670
kafka-clients-0.9.0.0-mapr-1602-streams-5.1.0.jar
10/19/2016 01:47 PM 8,848 kafka-unit-0.4.jar
10/19/2016 01:47 PM 489,884 log4j-1.2.17.jar
10/19/2016 01:47 PM 165,505 lz4-1.2.0.jar
10/19/2016 01:47 PM 599,801 malhar-contrib-3.5.0.jar
10/19/2016 01:47 PM 61,385 malhar-kafka-3.5.0.jar
10/19/2016 01:47 PM 1,744,252 malhar-library-3.5.0.jar
10/19/2016 01:47 PM 42,212 management-api-3.0.0-b012.jar
10/19/2016 01:47 PM 96,808 mapr-streams-5.1.0-mapr.jar
10/19/2016 01:47 PM 47,632,391 maprfs-5.1.0-mapr.jar
10/19/2016 01:47 PM 785,556 netty-3.2.2.Final.jar
10/19/2016 01:47 PM 1,199,572 netty-3.6.2.Final.jar
10/19/2016 01:47 PM 1,779,991 netty-all-4.0.23.Final.jar
10/19/2016 01:47 PM 29,555 paranamer-2.3.jar
10/19/2016 01:47 PM 533,455 protobuf-java-2.5.0.jar
10/19/2016 01:47 PM 278,281 serializer-2.7.1.jar
10/19/2016 01:47 PM 28,688 slf4j-api-1.7.6.jar
10/19/2016 01:47 PM 8,869 slf4j-log4j12-1.7.5.jar
10/19/2016 01:47 PM 594,033 snappy-java-1.1.1.7.jar
10/19/2016 01:47 PM 26,514 stax-api-1.0.1.jar
10/19/2016 01:47 PM 3,176,148 xalan-2.7.1.jar
10/19/2016 01:47 PM 1,229,125 xercesImpl-2.9.1.jar
10/19/2016 01:47 PM 194,354 xml-apis-1.3.04.jar
10/19/2016 01:47 PM 15,010 xmlenc-0.52.jar
10/19/2016 01:47 PM 94,672 xz-1.0.jar
10/19/2016 01:47 PM 781,882 zookeeper-3.4.5-mapr-1406.jar
99 File(s) 95,343,715 bytes
2 Dir(s) 175,956,692,992 bytes free
