[
https://issues.apache.org/jira/browse/BEAM-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tenghuan He updated BEAM-1020:
------------------------------
Description:
Beam fails to remove temporary directory after completing pipelines and
sinking output results on Windows operating system and throws the following
exception
{noformat}
Exception in thread "main"
org.apache.beam.sdk.Pipeline$PipelineExecutionException:
java.nio.file.InvalidPathException: Illegal char <*> at index 0: *
at
org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:348)
at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:73)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:179)
at
org.apache.beam.examples.MinimalWordCount.main(MinimalWordCount.java:116)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
Caused by: java.nio.file.InvalidPathException: Illegal char <*> at index 0: *
at sun.nio.fs.WindowsPathParser.normalize(WindowsPathParser.java:182)
at sun.nio.fs.WindowsPathParser.parse(WindowsPathParser.java:153)
at sun.nio.fs.WindowsPathParser.parse(WindowsPathParser.java:77)
at sun.nio.fs.WindowsPath.parse(WindowsPath.java:94)
at sun.nio.fs.WindowsFileSystem.getPath(WindowsFileSystem.java:255)
at sun.nio.fs.AbstractPath.resolve(AbstractPath.java:53)
at
org.apache.beam.sdk.util.FileIOChannelFactory.resolve(FileIOChannelFactory.java:159)
at
org.apache.beam.sdk.io.FileBasedSink$FileBasedWriteOperation.removeTemporaryFiles(FileBasedSink.java:469)
at
org.apache.beam.sdk.io.FileBasedSink$FileBasedWriteOperation.finalize(FileBasedSink.java:388)
at org.apache.beam.sdk.io.Write$Bound$2.processElement(Write.java:417)
{noformat}
This is due to the use of wildcards * when matching all files in the temporary
directory, while Windows does not support wildcard * in the file path.
was:
> FileBasedSink fails to remove temporary directory on Windows operating system
> -----------------------------------------------------------------------------
>
> Key: BEAM-1020
> URL: https://issues.apache.org/jira/browse/BEAM-1020
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-core
> Affects Versions: Not applicable
> Reporter: Tenghuan He
> Assignee: Davor Bonaci
> Fix For: Not applicable
>
> Original Estimate: 0.5h
> Remaining Estimate: 0.5h
>
> Beam fails to remove temporary directory after completing pipelines and
> sinking output results on Windows operating system and throws the following
> exception
> {noformat}
> Exception in thread "main"
> org.apache.beam.sdk.Pipeline$PipelineExecutionException:
> java.nio.file.InvalidPathException: Illegal char <*> at index 0: *
> at
> org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:348)
> at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:73)
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:179)
> at
> org.apache.beam.examples.MinimalWordCount.main(MinimalWordCount.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
> Caused by: java.nio.file.InvalidPathException: Illegal char <*> at index 0: *
> at sun.nio.fs.WindowsPathParser.normalize(WindowsPathParser.java:182)
> at sun.nio.fs.WindowsPathParser.parse(WindowsPathParser.java:153)
> at sun.nio.fs.WindowsPathParser.parse(WindowsPathParser.java:77)
> at sun.nio.fs.WindowsPath.parse(WindowsPath.java:94)
> at sun.nio.fs.WindowsFileSystem.getPath(WindowsFileSystem.java:255)
> at sun.nio.fs.AbstractPath.resolve(AbstractPath.java:53)
> at
> org.apache.beam.sdk.util.FileIOChannelFactory.resolve(FileIOChannelFactory.java:159)
> at
> org.apache.beam.sdk.io.FileBasedSink$FileBasedWriteOperation.removeTemporaryFiles(FileBasedSink.java:469)
> at
> org.apache.beam.sdk.io.FileBasedSink$FileBasedWriteOperation.finalize(FileBasedSink.java:388)
> at org.apache.beam.sdk.io.Write$Bound$2.processElement(Write.java:417)
> {noformat}
> This is due to the use of wildcards * when matching all files in the
> temporary directory, while Windows does not support wildcard * in the file
> path.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
