[
https://issues.apache.org/jira/browse/AVRO-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063060#comment-16063060
]
Nandor Kollar commented on AVRO-1991:
-------------------------------------
[~busbey] is -appendToFirst a valid option for concat? I couldn't find this
string in the project, and the example you mentioned here fails with a
different exception: Exception in thread "main" java.io.FileNotFoundException:
-appendFirst
The documentation of concat doesn't mention appendToFirst option:
{code}
concat [input-file...] output-file
Concatenates one or more input files into a new output file
by appending the input blocks without decoding them. The input
files must have the same schema, metadata and codec. If they
do not the tool will return the following error codes:
1 if the schemas don't match
2 if the metadata doesn't match
3 if the codecs don't match
If no input files are given stdin will be used. The tool
0 on success. A dash ('-') can be given as an input file
to use stdin, and as an output file to use stdout. If a directory
is given as an input-file all the files within this directory
are used.
{code}
> Java concat tool -appendToFirst option doesn't work with local filesystem
> -------------------------------------------------------------------------
>
> Key: AVRO-1991
> URL: https://issues.apache.org/jira/browse/AVRO-1991
> Project: Avro
> Issue Type: Bug
> Components: java
> Affects Versions: 1.9.0
> Reporter: Sean Busbey
>
> We should either make it work (e.g. by switching to RawLocalFilesytem instead
> of LocalFileSystem) or update the cli help.
> {code}
> java -jar lang/java/tools/target/avro-tools-1.9.0-SNAPSHOT.jar concat
> -appendToFirst ~/Downloads/append.0.avro
> '/Users/busbey/Downloads/example.*.avro'
> log4j:WARN No appenders could be found for logger
> (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more
> info.
> Exception in thread "main" java.io.IOException: Not supported
> at
> org.apache.hadoop.fs.ChecksumFileSystem.append(ChecksumFileSystem.java:352)
> at org.apache.hadoop.fs.FileSystem.append(FileSystem.java:1161)
> at org.apache.avro.tool.Util.createFromFS(Util.java:150)
> at org.apache.avro.tool.Util.fileOrStdout(Util.java:76)
> at org.apache.avro.tool.ConcatTool.run(ConcatTool.java:76)
> at org.apache.avro.tool.Main.run(Main.java:87)
> at org.apache.avro.tool.Main.main(Main.java:76)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
