Re: Need help running beam word count example on apex/hdfs

2018-01-09 Thread Shashank Prabhakara
For anyone who faces the same issue, I was not able to make work with "mvn compile exec:java ...". Instead, I ran with "hadoop jar ..." command which magically fixed this. Best guess is that maven is picking up incompatible version of commons-io from the wrong side of dependency tree. Regards, Sha

Re: Need help running beam word count example on apex/hdfs

2018-01-08 Thread Shashank Prabhakara
Forgot to mention: Execution works in embedded mode and counts are created on the local fs. I need this to run on hdfs/yarn with --embeddedExecution=false. Regards, Shashank On Mon, Jan 8, 2018 at 3:06 PM, Shashank Prabhakara wrote: > Hi All, > > I want to test beam on apex using the word coun

Need help running beam word count example on apex/hdfs

2018-01-08 Thread Shashank Prabhakara
Hi All, I want to test beam on apex using the word count example provided in the beam repository, but I'm facing some difficulties while executing word count as described in the documentation. I'm running hadoop version 2.8.2 on debian in a multi-node environment. I cloned the beam github reposit