[jira] [Commented] (AVRO-1373) Add A XZ Codec
[ https://issues.apache.org/jira/browse/AVRO-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13819238#comment-13819238 ] Hudson commented on AVRO-1373: -- SUCCESS: Integrated in AvroJava #404 (See [https://builds.apache.org/job/AvroJava/404/]) AVRO-1373. Java: Add support for xz compresssion codec, using LZMA2. Contributed by Nick White. (cutting: rev 1540620) * /avro/trunk/CHANGES.txt * /avro/trunk/lang/java/avro/src/main/java/org/apache/avro/file/CodecFactory.java * /avro/trunk/lang/java/avro/src/main/java/org/apache/avro/file/DataFileConstants.java * /avro/trunk/lang/java/avro/src/main/java/org/apache/avro/file/XZCodec.java * /avro/trunk/lang/java/avro/src/test/java/org/apache/avro/TestDataFile.java * /avro/trunk/lang/java/avro/src/test/java/org/apache/avro/TestDataFileConcat.java * /avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapred/AvroOutputFormat.java * /avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapred/tether/TetherOutputFormat.java * /avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapreduce/AvroOutputFormatBase.java * /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/CreateRandomFileTool.java * /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/DataFileWriteTool.java * /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/FromTextTool.java * /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/RecodecTool.java * /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/Util.java > Add A XZ Codec > -- > > Key: AVRO-1373 > URL: https://issues.apache.org/jira/browse/AVRO-1373 > Project: Avro > Issue Type: New Feature > Components: java >Affects Versions: 1.7.5 >Reporter: Nick White >Assignee: Nick White > Labels: patch > Fix For: 1.7.6 > > Attachments: AVRO-1373.1.patch, AVRO-1373.patch, xz-codec.patch > > > The java Avro projects already depend on the commons-library; the attached > patch adds support for the XZ codec using classes from it. I've also > refactored some of the duplicated code in the tools project (the code that > deals with the --codec and --level options) by moving a single copy to the > Util class, and calling that from the various tools that produce Avro files. > The XZ codec by default uses the LZMA2 algorithm to compress files - this > produces noticeably smaller files than the current bzip2 or deflate codecs. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (AVRO-1373) Add A XZ Codec
[ https://issues.apache.org/jira/browse/AVRO-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13818790#comment-13818790 ] Nick White commented on AVRO-1373: -- Thanks! > Add A XZ Codec > -- > > Key: AVRO-1373 > URL: https://issues.apache.org/jira/browse/AVRO-1373 > Project: Avro > Issue Type: New Feature > Components: java >Affects Versions: 1.7.5 >Reporter: Nick White >Assignee: Nick White > Labels: patch > Fix For: 1.7.6 > > Attachments: AVRO-1373.1.patch, AVRO-1373.patch, xz-codec.patch > > > The java Avro projects already depend on the commons-library; the attached > patch adds support for the XZ codec using classes from it. I've also > refactored some of the duplicated code in the tools project (the code that > deals with the --codec and --level options) by moving a single copy to the > Util class, and calling that from the various tools that produce Avro files. > The XZ codec by default uses the LZMA2 algorithm to compress files - this > produces noticeably smaller files than the current bzip2 or deflate codecs. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (AVRO-1373) Add A XZ Codec
[ https://issues.apache.org/jira/browse/AVRO-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13818737#comment-13818737 ] ASF subversion and git services commented on AVRO-1373: --- Commit 1540620 from [~cutting] in branch 'avro/trunk' [ https://svn.apache.org/r1540620 ] AVRO-1373. Java: Add support for xz compresssion codec, using LZMA2. Contributed by Nick White. > Add A XZ Codec > -- > > Key: AVRO-1373 > URL: https://issues.apache.org/jira/browse/AVRO-1373 > Project: Avro > Issue Type: New Feature > Components: java >Affects Versions: 1.7.5 >Reporter: Nick White >Assignee: Nick White > Labels: patch > Fix For: 1.7.6 > > Attachments: AVRO-1373.1.patch, AVRO-1373.patch, xz-codec.patch > > > The java Avro projects already depend on the commons-library; the attached > patch adds support for the XZ codec using classes from it. I've also > refactored some of the duplicated code in the tools project (the code that > deals with the --codec and --level options) by moving a single copy to the > Util class, and calling that from the various tools that produce Avro files. > The XZ codec by default uses the LZMA2 algorithm to compress files - this > produces noticeably smaller files than the current bzip2 or deflate codecs. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (AVRO-1373) Add A XZ Codec
[ https://issues.apache.org/jira/browse/AVRO-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13818311#comment-13818311 ] Doug Cutting commented on AVRO-1373: The latest patch appears to be missing the file XZCodec.java. > Add A XZ Codec > -- > > Key: AVRO-1373 > URL: https://issues.apache.org/jira/browse/AVRO-1373 > Project: Avro > Issue Type: New Feature > Components: java >Affects Versions: 1.7.5 >Reporter: Nick White >Assignee: Nick White > Labels: patch > Fix For: 1.7.6 > > Attachments: AVRO-1373.1.patch, AVRO-1373.patch, xz-codec.patch > > > The java Avro projects already depend on the commons-library; the attached > patch adds support for the XZ codec using classes from it. I've also > refactored some of the duplicated code in the tools project (the code that > deals with the --codec and --level options) by moving a single copy to the > Util class, and calling that from the various tools that produce Avro files. > The XZ codec by default uses the LZMA2 algorithm to compress files - this > produces noticeably smaller files than the current bzip2 or deflate codecs. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (AVRO-1373) Add A XZ Codec
[ https://issues.apache.org/jira/browse/AVRO-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13793068#comment-13793068 ] Nick White commented on AVRO-1373: -- Could I get a review for this patch? Thanks - > Add A XZ Codec > -- > > Key: AVRO-1373 > URL: https://issues.apache.org/jira/browse/AVRO-1373 > Project: Avro > Issue Type: New Feature > Components: java >Affects Versions: 1.7.5 >Reporter: Nick White >Assignee: Nick White > Labels: patch > Fix For: 1.7.6 > > Attachments: xz-codec.patch > > > The java Avro projects already depend on the commons-library; the attached > patch adds support for the XZ codec using classes from it. I've also > refactored some of the duplicated code in the tools project (the code that > deals with the --codec and --level options) by moving a single copy to the > Util class, and calling that from the various tools that produce Avro files. > The XZ codec by default uses the LZMA2 algorithm to compress files - this > produces noticeably smaller files than the current bzip2 or deflate codecs. -- This message was sent by Atlassian JIRA (v6.1#6144)
