Re: [VOTE] Release Apache Nutch 2.4 RC#1

2019-10-01 Thread lewis john mcgibbney
Hi Seb,
After purging ~/.ivy2/ and ~/.ant/ all tests pass.
Test crawl cycle with HBase appears fine.
Some more specifics

lmcgibbn@MT-207576 ~/Downloads $ gpg --verify
apache-nutch-2.4-src.tar.gz.asc apache-nutch-2.4-src.tar.gz
gpg: Signature made Mon Sep 23 14:29:05 2019 PDT
gpg:using RSA key FF82A487F92D70E52FF77E0AC66EA7B7DB0A9C6D
gpg: Good signature from "Sebastian Nagel " [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the
owner.
Primary key fingerprint: FF82 A487 F92D 70E5 2FF7  7E0A C66E A7B7 DB0A 9C6D

lmcgibbn@MT-207576 ~/Downloads $ sha512sum --check
apache-nutch-2.4-src.tar.gz.sha512
apache-nutch-2.4-src.tar.gz: OK

All other files (CHANGES, NOTICE) test out.

+1
Thank you for preparing the RC.
Lewis

On Tue, Oct 1, 2019 at 2:08 AM  wrote:

> From: Sebastian Nagel 
> To: user@nutch.apache.org
> Cc:
> Bcc:
> Date: Tue, 1 Oct 2019 11:01:02 +0200
> Subject: Re: [VOTE] Release Apache Nutch 2.4 RC#1
> Hi Lewis,
>
> this looks pretty the same as
>   https://issues.apache.org/jira/browse/IVY-1333
> which affected ivy 2.2.0 but should not affect the Nutch
> build as 2.4 is used. The used ivy version is logged
> soon after ant is run:
>   [ivy:resolve] :: Apache Ivy 2.4.0 - 20141213170938 ::
> http://ant.apache.org/ivy/ ::
>
> Are there any ivy libs in
>   ~/.ant/lib/
> because these will take precedence?
>
> In doubt, move away ~/.ivy2/ and ~/.ant/ and rerun the build.
> Also make sure that Java 8 is used.
>
> One point: the 2.4 release package ships
>ivy/ivy-2.2.0.jar
> but it shouldn't be an issue as the ivy jar is loaded including
> the version number. I've opened
>https://issues.apache.org/jira/browse/NUTCH-2741
> to remove it.
>
> Best,
> Sebastian
>
> On 28.09.19 17:54, lewis john mcgibbney wrote:
> > Hi Seb,
> >
> > On Thu, Sep 26, 2019 at 4:37 AM 
> wrote:
> >
> >> From: Sebastian Nagel 
> >> To: user@nutch.apache.org
> >> Cc: d...@nutch.apache.org
> >> Bcc:
> >> Date: Tue, 24 Sep 2019 11:54:48 +0200
> >> Subject: [VOTE] Release Apache Nutch 2.4 RC#1
> >> Hi Folks,
> >>
> >> A first candidate for the Nutch 2.4 release is available at:
> >>   https://dist.apache.org/repos/dist/dev/nutch/2.4/
> >
> >
> > All signatures are good for the tar.gz and zip artifacts.
> > I get an error message and failed build when running 'ant runtime test'
> >
> > BUILD FAILED
> > /Users/lmcgibbn/Downloads/apache-nutch-2.4/build.xml:143: The following
> > error occurred while executing this line:
> > /Users/lmcgibbn/Downloads/apache-nutch-2.4/src/plugin/build.xml:54: The
> > following error occurred while executing this line:
> >
> /Users/lmcgibbn/Downloads/apache-nutch-2.4/src/plugin/build-plugin.xml:213:
> > impossible to resolve dependencies:
> > java.lang.IllegalStateException: impossible to get artifacts when data
> has
> > not been loaded. IvyNode = javax.measure#unit-api;1.0
> > at org.apache.ivy.core.resolve.IvyNode.getArtifacts(IvyNode.java:763)
> > at
> >
> org.apache.ivy.core.resolve.IvyNode.getSelectedArtifacts(IvyNode.java:740)
> > at
> >
> org.apache.ivy.core.report.ResolveReport.setDependencies(ResolveReport.java:235)
> > at
> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:236)
> > at
> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:193)
> > at org.apache.ivy.Ivy.resolve(Ivy.java:502)
> > at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java:244)
> > at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277)
> > at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:292)
> > at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:498)
> > at
> >
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> > at org.apache.tools.ant.Task.perform(Task.java:350)
> > at org.apache.tools.ant.Target.execute(Target.java:448)
> > at org.apache.tools.ant.Target.performTasks(Target.java:469)
> > at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399)
> > at
> >
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:36)
> > at org.apache.tools.ant.Project.executeTargets(Project.java:1260)
> > at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:446)
> > at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:292)
> > at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:498)
> > at
> >
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> > at org.apache.tools.ant.Task.perform(Task.java:350)
> > at org.apache.tools.ant.Target.execute(Target.java:448)
> > at org.apache.tools.ant.Target.performTasks(Target.java:469)
> > at 

Re: [VOTE] Release Apache Nutch 2.4 RC#1

2019-10-01 Thread Sebastian Nagel
Hi Lewis,

this looks pretty the same as
  https://issues.apache.org/jira/browse/IVY-1333
which affected ivy 2.2.0 but should not affect the Nutch
build as 2.4 is used. The used ivy version is logged
soon after ant is run:
  [ivy:resolve] :: Apache Ivy 2.4.0 - 20141213170938 :: 
http://ant.apache.org/ivy/ ::

Are there any ivy libs in
  ~/.ant/lib/
because these will take precedence?

In doubt, move away ~/.ivy2/ and ~/.ant/ and rerun the build.
Also make sure that Java 8 is used.

One point: the 2.4 release package ships
   ivy/ivy-2.2.0.jar
but it shouldn't be an issue as the ivy jar is loaded including
the version number. I've opened
   https://issues.apache.org/jira/browse/NUTCH-2741
to remove it.

Best,
Sebastian

On 28.09.19 17:54, lewis john mcgibbney wrote:
> Hi Seb,
> 
> On Thu, Sep 26, 2019 at 4:37 AM  wrote:
> 
>> From: Sebastian Nagel 
>> To: user@nutch.apache.org
>> Cc: d...@nutch.apache.org
>> Bcc:
>> Date: Tue, 24 Sep 2019 11:54:48 +0200
>> Subject: [VOTE] Release Apache Nutch 2.4 RC#1
>> Hi Folks,
>>
>> A first candidate for the Nutch 2.4 release is available at:
>>   https://dist.apache.org/repos/dist/dev/nutch/2.4/
> 
> 
> All signatures are good for the tar.gz and zip artifacts.
> I get an error message and failed build when running 'ant runtime test'
> 
> BUILD FAILED
> /Users/lmcgibbn/Downloads/apache-nutch-2.4/build.xml:143: The following
> error occurred while executing this line:
> /Users/lmcgibbn/Downloads/apache-nutch-2.4/src/plugin/build.xml:54: The
> following error occurred while executing this line:
> /Users/lmcgibbn/Downloads/apache-nutch-2.4/src/plugin/build-plugin.xml:213:
> impossible to resolve dependencies:
> java.lang.IllegalStateException: impossible to get artifacts when data has
> not been loaded. IvyNode = javax.measure#unit-api;1.0
> at org.apache.ivy.core.resolve.IvyNode.getArtifacts(IvyNode.java:763)
> at
> org.apache.ivy.core.resolve.IvyNode.getSelectedArtifacts(IvyNode.java:740)
> at
> org.apache.ivy.core.report.ResolveReport.setDependencies(ResolveReport.java:235)
> at org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:236)
> at org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:193)
> at org.apache.ivy.Ivy.resolve(Ivy.java:502)
> at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java:244)
> at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277)
> at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:292)
> at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> at org.apache.tools.ant.Task.perform(Task.java:350)
> at org.apache.tools.ant.Target.execute(Target.java:448)
> at org.apache.tools.ant.Target.performTasks(Target.java:469)
> at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399)
> at
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:36)
> at org.apache.tools.ant.Project.executeTargets(Project.java:1260)
> at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:446)
> at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:292)
> at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> at org.apache.tools.ant.Task.perform(Task.java:350)
> at org.apache.tools.ant.Target.execute(Target.java:448)
> at org.apache.tools.ant.Target.performTasks(Target.java:469)
> at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399)
> at
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:36)
> at org.apache.tools.ant.Project.executeTargets(Project.java:1260)
> at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:446)
> at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:292)
> at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> at org.apache.tools.ant.Task.perform(Task.java:350)
> at org.apache.tools.ant.Target.execute(Target.java:448)
> at org.apache.tools.ant.Target.performTasks(Target.java:469)
> at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399)
> at org.apache.tools.ant.Project.executeTarget(Project.java:1370)
> at
> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
> at org.apache.tools.ant.Project.executeTargets(Project.java:1260)
> at org.apache.tools.ant.Main.runBuild(Main.java:849)
> at