Hi Claire, The 'hdfs' filesystem is registered when you include the artifact "org.apache.beam:beam-sdks-java-io-hadoop-file-system". Do you have this in your dependencies?
Kenn On Fri, Jun 16, 2017 at 11:45 AM, Claire Yuan <[email protected]> wrote: > Hi all, > I was following the instruction here Apache Apex Runner > <https://beam.apache.org/documentation/runners/apex/> to submit the work > into the cluster. The building seems to be successful. However, the thing > is that I could not find where the output is. I set my param in my maven > command with: > --output=/user/claire/output/ > and I checked with hadoop dfs -ls /home/claire/output/ but seems no such > directory created. > I also checked my local directory with > --output=/home/claire/output/, and still no output there > Finally I set the output directory manually with: > --output=hdfs:///user/claireyuan/output > it gave exception as: Failed to execute goal > org.codehaus.mojo:exec-maven-plugin:1.5.0:java > (default-cli) on project beam-examples-java: An exception occured while > executing the Java class. null: InvocationTargetException: Unable to find > registrar for hdfs -> [Help 1] > > Apache Apex Runner > Apache Beam is an open source, unified model and set of language-specific > SDKs for defining and executing data p... > <https://beam.apache.org/documentation/runners/apex/> > I am wondering where I should check or modify my output directory to be? > > Claire >
