Sandeep Deshmukh created BEAM-1213:
--------------------------------------
Summary: WordCount example failure on Apex Runner
Key: BEAM-1213
URL: https://issues.apache.org/jira/browse/BEAM-1213
Project: Beam
Issue Type: Bug
Components: runner-apex
Reporter: Sandeep Deshmukh
Tried running WordCount example using apex runner (on YARN) with
https://github.com/apache/incubator-beam/pull/1693 , fix for httpclient version
issue fixed.
Create /tmp/input-beam/ dir on all nodes and pushed a test data in that
directory. Ran the following command in examples/java/
~/bin/apache-maven-3.3.9/bin/mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.WordCount
-Dexec.args="--inputFile=/tmp/input-beam/java.java --output=/tmp/output-beam/
--runner=ApexRunner --embeddedExecution=false" -Papex-runner
INFO: using
/disk2/devhdfs/nn_20161013/usercache/sandeep/appcache/application_1482319446115_4336/container_1482319446115_4336_01_000014/tmp/chkp5198889890309038810
as the basepath for checkpointing.
Dec 23, 2016 7:17:44 AM com.datatorrent.stram.engine.StreamingContainer main
SEVERE: Fatal exception in container!
java.lang.IllegalArgumentException: Invalid slice: offset=1426, length=0
array.length=67108864
at com.datatorrent.netlet.util.Slice.<init>(Slice.java:43)
at
com.datatorrent.bufferserver.util.SerializedData.<init>(SerializedData.java:40)
at
com.datatorrent.bufferserver.internal.DataList$Block.purge(DataList.java:712)
at
com.datatorrent.bufferserver.internal.DataList.purge(DataList.java:192)
at com.datatorrent.bufferserver.server.Server.purge(Server.java:204)
at
com.datatorrent.stram.engine.StreamingContainer.processHeartbeatResponse(StreamingContainer.java:776)
at
com.datatorrent.stram.engine.StreamingContainer.heartbeatLoop(StreamingContainer.java:705)
at
com.datatorrent.stram.engine.StreamingContainer.main(StreamingContainer.java:310)
Dec 23, 2016 7:17:44 AM com.datatorrent.bufferserver.server.Server unregistered
INFO: Server stopped listening at /0:0:0:0:0:0:0:0:40904
Dec 23, 2016 7:17:44 AM com.datatorrent.stram.engine.StreamingContainer main
INFO: Exit status for container: 1
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
