[jira] [Commented] (ORC-316) URISyntaxException when trying to create Writer for a path that includes a colon
[ https://issues.apache.org/jira/browse/ORC-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390577#comment-16390577 ] Quanlong Huang commented on ORC-316: LocalFileSystem is an implementation of org.apache.hadoop.fs.FileSystem. The exception is thrown from the hadoop client, not from the hadoop cluster. Since the orc-writer rely on hadoop-common module to access whatever local fs or hdfs, it's unable to create a file with colons in the filename. > URISyntaxException when trying to create Writer for a path that includes a > colon > > > Key: ORC-316 > URL: https://issues.apache.org/jira/browse/ORC-316 > Project: ORC > Issue Type: Bug > Components: Java >Affects Versions: 1.4.3 >Reporter: Yevgeny Zaspitsky >Priority: Major > > URISyntaxException is thrown upon trying the following code. Note that if the > path doesn't include a colon ':' everything is OK. > {code:java} > OrcFile.createWriter( > new > Path("/tmp/test-2018-03-05T16:15:00-153c036e-2241-49d0-a100-5291c5c09311.orc"), > OrcFile > .writerOptions(new Configuration()) > .setSchema(schema) > .stripeSize(10) > .bufferSize(1)) > {code} > The stacktrace is: > java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative > path in absolute URI: > .test-2018-03-05T16:15:00-96b3e05f-1aad-4235-9049-ac436f1837f7.orc.crc > at org.apache.hadoop.fs.Path.initialize(Path.java:206) > at org.apache.hadoop.fs.Path.(Path.java:172) > at org.apache.hadoop.fs.Path.(Path.java:94) > at > org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:88) > at > org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.(ChecksumFileSystem.java:390) > at > org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:449) > at > org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:428) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:908) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:889) > at org.apache.orc.impl.PhysicalFsWriter.(PhysicalFsWriter.java:91) > at org.apache.orc.impl.WriterImpl.(WriterImpl.java:184) > at org.apache.orc.OrcFile.createWriter(OrcFile.java:685) > ... > Caused by: java.net.URISyntaxException: Relative path in absolute URI: > .test-2018-03-05T16:15:00-96b3e05f-1aad-4235-9049-ac436f1837f7.orc.crc > at java.net.URI.checkPath(URI.java:1823) > at java.net.URI.(URI.java:745) > at org.apache.hadoop.fs.Path.initialize(Path.java:203) > ... -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (ORC-316) URISyntaxException when trying to create Writer for a path that includes a colon
[ https://issues.apache.org/jira/browse/ORC-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390541#comment-16390541 ] Yevgeny Zaspitsky commented on ORC-316: --- I use LocalFileSystem, my code snippet has nothing to do with Hadoop. > URISyntaxException when trying to create Writer for a path that includes a > colon > > > Key: ORC-316 > URL: https://issues.apache.org/jira/browse/ORC-316 > Project: ORC > Issue Type: Bug > Components: Java >Affects Versions: 1.4.3 >Reporter: Yevgeny Zaspitsky >Priority: Major > > URISyntaxException is thrown upon trying the following code. Note that if the > path doesn't include a colon ':' everything is OK. > {code:java} > OrcFile.createWriter( > new > Path("/tmp/test-2018-03-05T16:15:00-153c036e-2241-49d0-a100-5291c5c09311.orc"), > OrcFile > .writerOptions(new Configuration()) > .setSchema(schema) > .stripeSize(10) > .bufferSize(1)) > {code} > The stacktrace is: > java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative > path in absolute URI: > .test-2018-03-05T16:15:00-96b3e05f-1aad-4235-9049-ac436f1837f7.orc.crc > at org.apache.hadoop.fs.Path.initialize(Path.java:206) > at org.apache.hadoop.fs.Path.(Path.java:172) > at org.apache.hadoop.fs.Path.(Path.java:94) > at > org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:88) > at > org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.(ChecksumFileSystem.java:390) > at > org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:449) > at > org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:428) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:908) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:889) > at org.apache.orc.impl.PhysicalFsWriter.(PhysicalFsWriter.java:91) > at org.apache.orc.impl.WriterImpl.(WriterImpl.java:184) > at org.apache.orc.OrcFile.createWriter(OrcFile.java:685) > ... > Caused by: java.net.URISyntaxException: Relative path in absolute URI: > .test-2018-03-05T16:15:00-96b3e05f-1aad-4235-9049-ac436f1837f7.orc.crc > at java.net.URI.checkPath(URI.java:1823) > at java.net.URI.(URI.java:745) > at org.apache.hadoop.fs.Path.initialize(Path.java:203) > ... -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (ORC-316) URISyntaxException when trying to create Writer for a path that includes a colon
[ https://issues.apache.org/jira/browse/ORC-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388768#comment-16388768 ] Quanlong Huang commented on ORC-316: This is a problem of Hadoop. It can't create files with colons in the filename: HADOOP-3257 > URISyntaxException when trying to create Writer for a path that includes a > colon > > > Key: ORC-316 > URL: https://issues.apache.org/jira/browse/ORC-316 > Project: ORC > Issue Type: Bug > Components: Java >Affects Versions: 1.4.3 >Reporter: Yevgeny Zaspitsky >Priority: Major > > URISyntaxException is thrown upon trying the following code. Note that if the > path doesn't include a colon ':' everything is OK. > {code:java} > OrcFile.createWriter( > new > Path("/tmp/test-2018-03-05T16:15:00-153c036e-2241-49d0-a100-5291c5c09311.orc"), > OrcFile > .writerOptions(new Configuration()) > .setSchema(schema) > .stripeSize(10) > .bufferSize(1)) > {code} > The stacktrace is: > java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative > path in absolute URI: > .test-2018-03-05T16:15:00-96b3e05f-1aad-4235-9049-ac436f1837f7.orc.crc > at org.apache.hadoop.fs.Path.initialize(Path.java:206) > at org.apache.hadoop.fs.Path.(Path.java:172) > at org.apache.hadoop.fs.Path.(Path.java:94) > at > org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:88) > at > org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.(ChecksumFileSystem.java:390) > at > org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:449) > at > org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:428) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:908) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:889) > at org.apache.orc.impl.PhysicalFsWriter.(PhysicalFsWriter.java:91) > at org.apache.orc.impl.WriterImpl.(WriterImpl.java:184) > at org.apache.orc.OrcFile.createWriter(OrcFile.java:685) > ... > Caused by: java.net.URISyntaxException: Relative path in absolute URI: > .test-2018-03-05T16:15:00-96b3e05f-1aad-4235-9049-ac436f1837f7.orc.crc > at java.net.URI.checkPath(URI.java:1823) > at java.net.URI.(URI.java:745) > at org.apache.hadoop.fs.Path.initialize(Path.java:203) > ... -- This message was sent by Atlassian JIRA (v7.6.3#76005)