[
https://issues.apache.org/jira/browse/BEAM-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15768772#comment-15768772
]
ASF GitHub Bot commented on BEAM-1203:
--------------------------------------
GitHub user PramodSSImmaneni opened a pull request:
https://github.com/apache/incubator-beam/pull/1684
[BEAM-1203] Fixed exception with app launch using apex runner in YARN mode
@tweise please review it
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/PramodSSImmaneni/incubator-beam BEAM-1203
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/1684.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1684
----
commit 50b192dcd80f52621ea252f60d62e91626a89596
Author: Pramod Immaneni <[email protected]>
Date: 2016-12-22T01:56:55Z
BEAM-1203 Fixed exception when creating zip entries during Apex YARN launch
----
> Exception when running apex runner in non embedded mode
> -------------------------------------------------------
>
> Key: BEAM-1203
> URL: https://issues.apache.org/jira/browse/BEAM-1203
> Project: Beam
> Issue Type: Bug
> Components: runner-apex
> Affects Versions: 0.5.0-incubating
> Reporter: Pramod Immaneni
>
> Tried to run the word count example application using apex runner on yarn
> with the command below (the command refers to local files so app when running
> will not be able to access these files but that is a different issue). There
> is an exception and the application does not get launched.
> mvn exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount
> -Dexec.args="--inputFile=/home/pramod/Development/test/kinglear.txt
> --output=/home/pramod/Development/test/wordcounts.txt --runner=ApexRunner
> --embeddedExecution=false" -Papex-runner
> java.nio.file.FileAlreadyExistsException: META-INF/
> at
> com.sun.nio.zipfs.ZipFileSystem.createDirectory(ZipFileSystem.java:422)
> at com.sun.nio.zipfs.ZipPath.createDirectory(ZipPath.java:634)
> at
> com.sun.nio.zipfs.ZipFileSystemProvider.createDirectory(ZipFileSystemProvider.java:201)
> at java.nio.file.Files.createDirectory(Files.java:630)
> at
> org.apache.beam.runners.apex.ApexYarnLauncher$2.preVisitDirectory(ApexYarnLauncher.java:266)
> at
> org.apache.beam.runners.apex.ApexYarnLauncher$2.preVisitDirectory(ApexYarnLauncher.java:252)
> at java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:192)
> at java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:199)
> at java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:69)
> at java.nio.file.Files.walkFileTree(Files.java:2602)
> at java.nio.file.Files.walkFileTree(Files.java:2635)
> at
> org.apache.beam.runners.apex.ApexYarnLauncher.createJar(ApexYarnLauncher.java:252)
> at
> org.apache.beam.runners.apex.ApexYarnLauncher.launchApp(ApexYarnLauncher.java:90)
> at org.apache.beam.runners.apex.ApexRunner.run(ApexRunner.java:149)
> at org.apache.beam.runners.apex.ApexRunner.run(ApexRunner.java:63)
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:176)
> at org.apache.beam.examples.WordCount.main(WordCount.java:184)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293)
> at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
