[ 
https://issues.apache.org/jira/browse/HIVE-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150174#comment-13150174
 ] 

Carl Steinbach commented on HIVE-2580:
--------------------------------------

HIVE-2391 upgraded the Ivy dependency from 2.1.0 to 2.2.0. It looks like 2.2.0
contains a bug (IVY-1320) that causes the build to fail if the user has a
a fresh .ivy2 directory, e.g:


{noformat}

BUILD FAILED
/home/carl/Work/repos/hive2/build.xml:297: The following error occurred while 
executing this line:
/home/carl/Work/repos/hive2/build.xml:154: The following error occurred while 
executing this line:
/home/carl/Work/repos/hive2/shims/build.xml:65: The following error occurred 
while executing this line:
/home/carl/Work/repos/hive2/build-common.xml:132: Error while expanding 
/home/carl/Work/repos/hive2/build/hadoopcore/hadoop-0.20.1.tar.gz
java.io.IOException: Not in GZIP format
        at java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:143)
        at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:58)
        at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:67)
        at 
org.apache.tools.ant.taskdefs.Untar$UntarCompressionMethod.decompress(Untar.java:235)
        at org.apache.tools.ant.taskdefs.Untar.expandStream(Untar.java:158)
        at org.apache.tools.ant.taskdefs.Untar.expandFile(Untar.java:114)
        at org.apache.tools.ant.taskdefs.Expand.execute(Expand.java:132)
        at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
        at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
        at org.apache.tools.ant.Task.perform(Task.java:348)
        at org.apache.tools.ant.Target.execute(Target.java:390)
        at org.apache.tools.ant.Target.performTasks(Target.java:411)
        at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
        at 
org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
        at org.apache.tools.ant.Project.executeTargets(Project.java:1249)
        at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442)
        at org.apache.tools.ant.taskdefs.CallTarget.execute(CallTarget.java:105)
        at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
        at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
        at org.apache.tools.ant.Task.perform(Task.java:348)
        at org.apache.tools.ant.Target.execute(Target.java:390)
        at org.apache.tools.ant.Target.performTasks(Target.java:411)
        at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
        at 
org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
        at org.apache.tools.ant.Project.executeTargets(Project.java:1249)
        at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442)
        at org.apache.tools.ant.taskdefs.SubAnt.execute(SubAnt.java:302)
        at org.apache.tools.ant.taskdefs.SubAnt.execute(SubAnt.java:221)
        at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
        at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
        at org.apache.tools.ant.Task.perform(Task.java:348)
        at org.apache.tools.ant.taskdefs.Sequential.execute(Sequential.java:68)
        at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
        at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
        at org.apache.tools.ant.Task.perform(Task.java:348)
        at 
org.apache.tools.ant.taskdefs.MacroInstance.execute(MacroInstance.java:398)
        at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
        at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
        at org.apache.tools.ant.Task.perform(Task.java:348)
        at org.apache.tools.ant.Target.execute(Target.java:390)
        at org.apache.tools.ant.Target.performTasks(Target.java:411)
        at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
        at org.apache.tools.ant.Project.executeTarget(Project.java:1366)
        at 
org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
        at org.apache.tools.ant.Project.executeTargets(Project.java:1249)
        at org.apache.tools.ant.Main.runBuild(Main.java:801)
        at org.apache.tools.ant.Main.startAnt(Main.java:218)
        at org.apache.tools.ant.launch.Launcher.run(Launcher.java:280)
        at org.apache.tools.ant.launch.Launcher.main(Launcher.java:109)
{noformat}

I checked the files in the local cache and noticed the following:

{noformat}
% file ~/.ivy2/cache/hadoop/core/sources/*.gz
/home/carl/.ivy2/cache/hadoop/core/sources/hadoop-0.20.1.tar.gz:
POSIX tar archive
/home/carl/.ivy2/cache/hadoop/core/sources/hadoop-0.20.3-CDH3-SNAPSHOT.tar.gz:
POSIX tar archive
{noformat}

I tried reverting to Ivy 2.1.0 and the problem dissappears:

{noformat}
% file ~/.ivy2/cache/hadoop/core/sources/*.gz
/home/carl/.ivy2/cache/hadoop/core/sources/hadoop-0.20.1.tar.gz:
gzip compressed data, from FAT filesystem (MS-DOS, OS/2, NT)
/home/carl/.ivy2/cache/hadoop/core/sources/hadoop-0.20.3-CDH3-SNAPSHOT.tar.gz:
gzip compressed data, from FAT filesystem (MS-DOS, OS/2, NT)
{noformat}


Workaround for trunk: Rename and then Gzip compress the tar archives in ~/.ivy2:

{noformat}
% cd ~/.ivy2/cache/hadoop/core/sources
% mv hadoop-0.20.1.tar.gz hadoop-0.20.1.tar
% mv hadoop-0.20.3-CDH3-SNAPSHOT.tar.gz hadoop-0.20.3-CDH3-SNAPSHOT.tar
% gzip *.tar
{noformat}

                
> Hive build fails with error "java.io.IOException: Not in GZIP format"
> ---------------------------------------------------------------------
>
>                 Key: HIVE-2580
>                 URL: https://issues.apache.org/jira/browse/HIVE-2580
>             Project: Hive
>          Issue Type: Bug
>          Components: Build Infrastructure
>    Affects Versions: 0.8.0
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.8.0
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to