On Sun, Feb 14, 2010 at 1:07 PM, Vidyasagar Venkata Nallapati
<[email protected]> wrote:
> Hi Carl,
>
>
>
> I am still getting error with the pom of the hadoop builds, how can I solve
> these?
>
>
>
> [ivy:retrieve] tried
> https://repository.apache.org/content/repositories/snapshots/hadoop/core/0.17.2.1/core-0.17.2.1.pom
>
> [ivy:retrieve] ERROR: Server access Error: Connection timed out
> url=https://repository.apache.org/content/repositories/snapshots/hadoop/core/0.17.2.1/core-0.17.2.1.pom
>
> [ivy:retrieve] tried
> https://repository.apache.org/content/repositories/snapshots/hadoop/core/0.17.2.1/hadoop-0.17.2.1.tar.gz
>
>
>
> Regards
>
> Vidyasagar N V
>
> From: Carl Steinbach [mailto:[email protected]]
> Sent: Sunday, February 14, 2010 12:46 PM
> To: [email protected]
> Subject: Re: Hive Installation Error
>
>
>
> The answer to your problem is here:
> http://www.mail-archive.com/[email protected]/msg02361.html
>
> Carl
>
> On Sat, Feb 13, 2010 at 11:04 PM, Vidyasagar Venkata Nallapati
> <[email protected]> wrote:
>
> Hi Carl,
>
>
>
> I am getting an error as
>
>
>
> ivy-retrieve-hadoop-source:
>
> [ivy:retrieve] :: Ivy 2.0.0-rc2 - 20081028224207 ::
> http://ant.apache.org/ivy/ ::
>
> :: loading settings :: file = /master/hadoop/hive/ivy/ivysettings.xml
>
>
>
> BUILD FAILED
>
> /master/hadoop/hive/build.xml:148: The following error occurred while
> executing this line:
>
> /master/hadoop/hive/build.xml:93: The following error occurred while
> executing this line:
>
> /master/hadoop/hive/shims/build.xml:55: The following error occurred while
> executing this line:
>
> /master/hadoop/hive/build-common.xml:180: impossible to configure
> ivy:settings with given file: /master/hadoop/hive/ivy/ivysettings.xml :
> java.text.ParseException: failed to load settings from
> file:/master/hadoop/hive/ivy/ivysettings.xml: impossible to set defaultTTL
> to eternal on class org.apache.ivy.core.cache.DefaultRepositoryCacheManager
>
>
>
> Regards
>
> Vidyasagar N V
>
>
>
> From: Carl Steinbach [mailto:[email protected]]
> Sent: Thursday, February 11, 2010 6:06 PM
>
> To: [email protected]
> Subject: Re: Hive Installation Error
>
>
>
> Sorry, I forgot to include one command:
>
> % wget
> http://archive.apache.org/dist/hadoop/core/hadoop-0.19.0/hadoop-0.19.0.tar.gz
>
> On Thu, Feb 11, 2010 at 4:34 AM, Carl Steinbach <[email protected]> wrote:
>
> Hi Vidyasagar,
>
> Try doing the following:
>
> % cd ~/.ant/cache/hadoop/core/sources
>
> % wget
> http://archive.apache.org/dist/hadoop/core/hadoop-0.17.2.1/hadoop-0.17.2.1.tar.gz
> % wget
> http://archive.apache.org/dist/hadoop/core/hadoop-0.18.3/hadoop-0.18.3.tar.gz
> % wget
> http://archive.apache.org/dist/hadoop/core/hadoop-0.20.0/hadoop-0.20.0.tar.gz
>
> % wget
> http://archive.apache.org/dist/hadoop/core/hadoop-0.20.1/hadoop-0.20.1.tar.gz
>
> % cd /master/hive
> % svn update
>
> % ant -Dhadoop.version=0.20.1 clean package
>
> On Thu, Feb 11, 2010 at 4:17 AM, Vidyasagar Venkata Nallapati
> <[email protected]> wrote:
>
> Hi Carl,
>
>
>
> I am still getting an error as
>
>
>
> phoe...@ph2:/master/hive$ ant -Dhadoop.version=0.20.1 clean package
>
> Buildfile: build.xml
>
>
>
> clean:
>
>
>
> clean:
>
> [echo] Cleaning: anttasks
>
> [delete] Deleting directory /master/hive/build/anttasks
>
>
>
> clean:
>
> [echo] Cleaning: shims
>
> [delete] Deleting directory /master/hive/build/shims
>
>
>
> clean:
>
> [echo] Cleaning: common
>
>
>
> clean:
>
> [echo] Cleaning: serde
>
>
>
> clean:
>
> [echo] Cleaning: metastore
>
>
>
> clean:
>
> [echo] Cleaning: ql
>
>
>
> clean:
>
> [echo] Cleaning: cli
>
>
>
> clean:
>
> [echo] Cleaning: contrib
>
>
>
> clean:
>
>
>
> clean:
>
>
>
> clean:
>
> [echo] Cleaning: hwi
>
>
>
> clean:
>
> [exec] rm -rf /master/hive/build/odbc /master/hive/build/service/objs
> /master/hive/build/service/fb303/objs /master/hive/build/metastore/objs
>
> [delete] Deleting directory /master/hive/build
>
>
>
> jar:
>
>
>
> create-dirs:
>
> [mkdir] Created dir: /master/hive/build
>
> [mkdir] Created dir: /master/hive/build/shims
>
> [mkdir] Created dir: /master/hive/build/shims/classes
>
> [mkdir] Created dir: /master/hive/build/jexl/classes
>
> [mkdir] Created dir: /master/hive/build/hadoopcore
>
> [mkdir] Created dir: /master/hive/build/shims/test
>
> [mkdir] Created dir: /master/hive/build/shims/test/src
>
> [mkdir] Created dir: /master/hive/build/shims/test/classes
>
>
>
> compile-ant-tasks:
>
>
>
> create-dirs:
>
> [mkdir] Created dir: /master/hive/build/anttasks
>
> [mkdir] Created dir: /master/hive/build/anttasks/classes
>
> [mkdir] Created dir: /master/hive/build/anttasks/test
>
> [mkdir] Created dir: /master/hive/build/anttasks/test/src
>
> [mkdir] Created dir: /master/hive/build/anttasks/test/classes
>
>
>
> init:
>
>
>
> compile:
>
> [echo] Compiling: anttasks
>
> [javac] Compiling 2 source files to /master/hive/build/anttasks/classes
>
> [javac] Note:
> /master/hive/ant/src/org/apache/hadoop/hive/ant/QTestGenTask.java uses or
> overrides a deprecated API.
>
> [javac] Note: Recompile with -Xlint:deprecation for details.
>
>
>
> deploy-ant-tasks:
>
>
>
> create-dirs:
>
>
>
> init:
>
>
>
> compile:
>
> [echo] Compiling: anttasks
>
>
>
> jar:
>
> [copy] Copying 1 file to
> /master/hive/build/anttasks/classes/org/apache/hadoop/hive/ant
>
> [jar] Building jar:
> /master/hive/build/anttasks/hive-anttasks-0.6.0.jar
>
>
>
> init:
>
>
>
> compile:
>
>
>
> ivy-init-dirs:
>
> [mkdir] Created dir: /master/hive/build/ivy
>
> [mkdir] Created dir: /master/hive/build/ivy/lib
>
> [mkdir] Created dir: /master/hive/build/ivy/report
>
> [mkdir] Created dir: /master/hive/build/ivy/maven
>
>
>
> ivy-download:
>
> [get] Getting:
> http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
>
> [get] To: /master/hive/build/ivy/lib/ivy-2.0.0-rc2.jar
>
>
>
> ivy-probe-antlib:
>
>
>
> ivy-init-antlib:
>
>
>
> ivy-init:
>
>
>
> ivy-retrieve-hadoop-source:
>
> [ivy:retrieve] :: Ivy 2.0.0-rc2 - 20081028224207 ::
> http://ant.apache.org/ivy/ ::
>
> :: loading settings :: file = /master/hive/ivy/ivysettings.xml
>
> [ivy:retrieve] :: resolving dependencies ::
> org.apache.hadoop.hive#shims;work...@ph2
>
> [ivy:retrieve] confs: [default]
>
> [ivy:retrieve] found hadoop#core;0.20.0 in hadoop-source
>
> [ivy:retrieve] :: resolution report :: resolve 382725ms :: artifacts dl 3ms
>
>
> ---------------------------------------------------------------------
>
> | | modules || artifacts
> |
>
> | conf | number| search|dwnlded|evicted||
> number|dwnlded|
>
>
> ---------------------------------------------------------------------
>
> | default | 1 | 0 | 0 | 0 || 1 | 0
> |
>
>
> ---------------------------------------------------------------------
>
> [ivy:retrieve]
>
> [ivy:retrieve] :: problems summary ::
>
> [ivy:retrieve] :::: ERRORS
>
> [ivy:retrieve] Server access Error: Connection timed out
> url=https://repository.apache.org/content/repositories/snapshots/hadoop/core/0.20.0/core-0.20.0.pom
>
> [ivy:retrieve] Server access Error: Connection timed out
> url=https://repository.apache.org/content/repositories/snapshots/hadoop/core/0.20.0/hadoop-0.20.0.tar.gz
>
> [ivy:retrieve]
>
> [ivy:retrieve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
>
> [ivy:retrieve] :: retrieving :: org.apache.hadoop.hive#shims
>
> [ivy:retrieve] confs: [default]
>
> [ivy:retrieve] 1 artifacts copied, 0 already retrieved (41810kB/109ms)
>
>
>
> install-hadoopcore-internal:
>
>
>
> BUILD FAILED
>
> /master/hive/build.xml:148: The following error occurred while executing
> this line:
>
> /master/hive/build.xml:93: The following error occurred while executing this
> line:
>
> /master/hive/shims/build.xml:64: The following error occurred while
> executing this line:
>
> /master/hive/build-common.xml:178: Error while expanding
> /master/hive/build/hadoopcore/hadoop-0.20.1.tar.gz
>
>
>
> Can you please help me on this.
>
>
>
> Regards
>
> Vidyasagar N V
>
>
>
> From: Carl Steinbach [mailto:[email protected]]
> Sent: Thursday, February 11, 2010 4:50 PM
>
> To: [email protected]
> Subject: Re: Hive Installation Error
>
>
>
> Hi Vidyasagar,
>
> It does not look like you are running 'ant package' from the root of the
> hive source tree.
> The error message in your original email references the path
> master/hadoop/hadoop-0.20.1/build.xml, which is not a subpath of the hive
> source
> tree. Instead it looks like you are running 'ant package' in
> master/hadoop/hadoop-0.20.1
> on the hadoop-0.20.1 sources, which is actually unnecessary since the Hadoop
> sources which
> are downloaded when Hive is built include prebuilt JARs.
>
> In order to build Hive against hadoop-0.20.1 please do the following:
>
> % cd ~/.ant/cache/hadoop/core/sources
> % wget
> http://archive.apache.org/dist/hadoop/core/hadoop-0.20.1/hadoop-0.20.1.tar.gz
> % cd
> % svn co http://svn.apache.org/repos/asf/hadoop/hive/trunk hive
> % cd hive
> % ant -Dhadoop.version=0.20.1 clean package
>
> If for some other reason you need to build hadoop-0.20.1 from source you
> need
> to follow these steps:
>
> 1) Download and install Apache Forrest:
> http://forrest.apache.org/docs_0_90/your-project.html#installing
>
> 2) Install Java5 and set JAVA5_HOME to point the Java5 install directory.
>
> 3) Run the following command from the root of your hadoop-0.20.1 source
> tree:
> % ant package -Djava5.home=$JAVA5_HOME -Dforrest.home=$FORREST_HOME'
>
> Hope this helps.
>
> Carl
>
> On Thu, Feb 11, 2010 at 1:26 AM, Vidyasagar Venkata Nallapati
> <[email protected]> wrote:
>
> I had taken a svn check out
>
> svn co http://svn.apache.org/repos/asf/hadoop/hive/trunk hive
>
> and builded through ant
>
> ant package.
>
> Regards
> Vidyasagar N V
>
> -----Original Message-----
> From: Zheng Shao [mailto:[email protected]]
> Sent: Thursday, February 11, 2010 2:26 PM
> To: [email protected]
>
> Subject: Re: Hive Installation Error
>
> What commands did you run? With which release?
>
> Zheng
> On Wed, Feb 10, 2010 at 11:20 PM, Vidyasagar Venkata Nallapati
> <[email protected]> wrote:
>> Hi,
>>
>>
>>
>> Installation is giving an error as
>>
>>
>>
>> master/hadoop/hadoop-0.20.1/build.xml:895: 'java5.home' is not defined.
>> Forrest requires Java 5. Please pass -Djava5.home=<base of Java 5
>> distribution> to Ant on the command-line.
>>
>> at org.apache.tools.ant.taskdefs.Exit.execute(Exit.java:142)
>>
>> at
>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>>
>> at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
>>
>> at
>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>
>> at
>>
>> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
>>
>> at org.apache.tools.ant.Task.perform(Task.java:348)
>>
>> at org.apache.tools.ant.Target.execute(Target.java:357)
>>
>> at org.apache.tools.ant.Target.performTasks(Target.java:385)
>>
>> at
>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
>>
>> at org.apache.tools.ant.Project.executeTarget(Project.java:1306)
>>
>> at
>>
>> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
>>
>> at org.apache.tools.ant.Project.executeTargets(Project.java:1189)
>>
>> at org.apache.tools.ant.Main.runBuild(Main.java:758)
>>
>> at org.apache.tools.ant.Main.startAnt(Main.java:217)
>>
>> at org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
>>
>> at org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)
>>
>>
>>
>> Total time: 7 minutes 11 seconds
>>
>>
>>
>> Please guide on this case.
>>
>>
>>
>> Regards
>>
>> Vidyasagar N V
>>
>> ________________________________
>> DISCLAIMER: The information in this message is confidential and may be
>> legally privileged. It is intended solely for the addressee. Access to
>> this
>> message by anyone else is unauthorized. If you are not the intended
>> recipient, any disclosure, copying, or distribution of the message, or any
>> action or omission taken by you in reliance on it, is prohibited and may
>> be
>> unlawful. Please immediately contact the sender if you have received this
>> message in error. Further, this e-mail may contain viruses and all
>> reasonable precaution to minimize the risk arising there from is taken by
>> OnMobile. OnMobile is not liable for any damage sustained by you as a
>> result
>> of any virus in this e-mail. All applicable virus checks should be carried
>> out by you before opening this e-mail or any attachment thereto.
>> Thank you - OnMobile Global Limited.
>>
>
>
>
> --
> Yours,
> Zheng
>
> DISCLAIMER: The information in this message is confidential and may be
> legally privileged. It is intended solely for the addressee. Access to this
> message by anyone else is unauthorized. If you are not the intended
> recipient, any disclosure, copying, or distribution of the message, or any
> action or omission taken by you in reliance on it, is prohibited and may be
> unlawful. Please immediately contact the sender if you have received this
> message in error. Further, this e-mail may contain viruses and all
> reasonable precaution to minimize the risk arising there from is taken by
> OnMobile. OnMobile is not liable for any damage sustained by you as a result
> of any virus in this e-mail. All applicable virus checks should be carried
> out by you before opening this e-mail or any attachment thereto.
> Thank you - OnMobile Global Limited.
>
>
>
>
>
> ________________________________
>
> DISCLAIMER: The information in this message is confidential and may be
> legally privileged. It is intended solely for the addressee. Access to this
> message by anyone else is unauthorized. If you are not the intended
> recipient, any disclosure, copying, or distribution of the message, or any
> action or omission taken by you in reliance on it, is prohibited and may be
> unlawful. Please immediately contact the sender if you have received this
> message in error. Further, this e-mail may contain viruses and all
> reasonable precaution to minimize the risk arising there from is taken by
> OnMobile. OnMobile is not liable for any damage sustained by you as a result
> of any virus in this e-mail. All applicable virus checks should be carried
> out by you before opening this e-mail or any attachment thereto.
> Thank you - OnMobile Global Limited.
>
>
>
>
>
>
>
> ________________________________
>
> DISCLAIMER: The information in this message is confidential and may be
> legally privileged. It is intended solely for the addressee. Access to this
> message by anyone else is unauthorized. If you are not the intended
> recipient, any disclosure, copying, or distribution of the message, or any
> action or omission taken by you in reliance on it, is prohibited and may be
> unlawful. Please immediately contact the sender if you have received this
> message in error. Further, this e-mail may contain viruses and all
> reasonable precaution to minimize the risk arising there from is taken by
> OnMobile. OnMobile is not liable for any damage sustained by you as a result
> of any virus in this e-mail. All applicable virus checks should be carried
> out by you before opening this e-mail or any attachment thereto.
> Thank you - OnMobile Global Limited.
>
>
>
> ________________________________
> DISCLAIMER: The information in this message is confidential and may be
> legally privileged. It is intended solely for the addressee. Access to this
> message by anyone else is unauthorized. If you are not the intended
> recipient, any disclosure, copying, or distribution of the message, or any
> action or omission taken by you in reliance on it, is prohibited and may be
> unlawful. Please immediately contact the sender if you have received this
> message in error. Further, this e-mail may contain viruses and all
> reasonable precaution to minimize the risk arising there from is taken by
> OnMobile. OnMobile is not liable for any damage sustained by you as a result
> of any virus in this e-mail. All applicable virus checks should be carried
> out by you before opening this e-mail or any attachment thereto.
> Thank you - OnMobile Global Limited.
>
I do not know tons about POM/IVY, but I am not sure I am very happy
with it in this build process. On one hand bundling three versions of
hadoop core seems wasteful.
On the other hand, I have a good Internet connection and...
jar:
[echo] Jar: hwi
[jar] Building jar:
/home/ecapriolo/hive-20/hive-trunk/build/hwi/hive-hwi-0.6.0.jar
BUILD SUCCESSFUL
Total time: 4 minutes 59 seconds
That time is a little too long for my liking. Likewise I think shim
building three branches is a good thing, but I think we would be
better with some type of configure process
ant -Dhadoop.version=18.3 -Dhadoop.version=20.0,
Also if ivy/pom is flaky, I am not sure its 'coolness' factor
outweighs its practicality. In my experience a failing build is a very
frustrating thing for some users and others might be too shy to help,
or people who just walk away and start searching for another
alternative application.
