[
https://issues.apache.org/jira/browse/PIG-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586129#comment-14586129
]
Tomas Hudik commented on PIG-4599:
----------------------------------
I'm just wondering if hadoop doesn't support tar archives what
org.apache.hadoop.fs.FileUtil.unTar is responsible for? (it untarring files)
@Koji -do you have some explanation? Or, some documentation...
Hmm, I somehow subconsciously assumed when bz2/gz is supported tar will be as
well. Strange. I'll close the issue.
> tar.gz compression doesn't produce correct output
> -------------------------------------------------
>
> Key: PIG-4599
> URL: https://issues.apache.org/jira/browse/PIG-4599
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.12.1
> Reporter: Tomas Hudik
> Labels: compression, easytest
>
> I'm not completely sure whether this is the right place to put this issue
> since Pig is involved, however, Pig leave decompression of tar.gz to
> hadoop-common.
> How to reproduce the issue:
> # simple file (file1) with arbitrary text lines put into in1 in HDFS
> # same file (file1) compressed by tar -cvzf file1.tar.gz file put into in2 in
> HDFS
> # issue simple pig commands in pig:
> {quote}
> raw = load 'in1/' USING TextLoader AS (line: bytearray);
> dump raw;
> {quote}
> run for both (compressed and uncompressed file)
> # in case of compressed version you will get strange 1st line
> {quote}
> a0000644000570000001440000000002512534073736011260 0ustar loadhadoopusersa
> ...
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
