Hi Markus, BlackIce,

Which version of Hadoop are you targeting? As far as I can see, Hadoop 3 does 
not support Java 9 yet (see e.g. 
https://issues.apache.org/jira/browse/HADOOP-11123?subTaskView=all, 
https://issues.apache.org/jira/browse/HADOOP-11124, 
https://issues.apache.org/jira/browse/HADOOP-15046), and I'm not sure previous 
Hadoop versions have Java 9 support in their pipeline at all... (see also 
https://issues.apache.org/jira/browse/HADOOP-15045).

Yossi.

> -----Original Message-----
> From: Markus Jelsma [mailto:markus.jel...@openindex.io]
> Sent: 22 February 2018 00:06
> To: dev@nutch.apache.org
> Subject: RE: Nutch fails to compile...
> 
> This clearly shows Nutch has issues with JDK9. Can you open a ticket?
> 
> Getting things to work with JDK9 is crucial as it is a transitioning to a new 
> kind of
> JDK release schedule. So we should resolve the issues as soon as we can. 
> JDK9's
> EOL is sooner than you would expect from a regular JDK release.
> 
> M.,
> 
> -----Original message-----
> > From:BlackIce <blackice...@gmail.com>
> > Sent: Wednesday 21st February 2018 21:16
> > To: dev@nutch.apache.org
> > Subject: Re: Nutch fails to compile...
> >
> > well reverting back to Java 8.. and it all works now
> >
> > On Wed, Feb 21, 2018 at 2:06 AM, BlackIce <blackice...@gmail.com
> <mailto:blackice...@gmail.com>> wrote:
> > So, now when using the crawl script.. I get this, and it happens with both 
> > my
> Java9 compiled one and the binary distribution:
> >
> > Injecting seed URLs
> > /home/nutch/nutch2/bin/nutch inject searchcrawl//crawldb urls/
> > Injector: starting at 2018-02-21 02:02:16
> > Injector: crawlDb: searchcrawl/crawldb
> > Injector: urlDir: urls
> > Injector: Converting injected urls to crawl db entries.
> > WARNING: An illegal reflective access operation has occurred
> > WARNING: Illegal reflective access by
> > org.apache.hadoop.security.authentication.util.KerberosUtil
> > (file:/home/nutch/nutch2/lib/hadoop-auth-2.7.4.jar) to method
> > sun.security.krb5.Config.getInstance()
> > WARNING: Please consider reporting this to the maintainers of
> > org.apache.hadoop.security.authentication.util.KerberosUtil
> > WARNING: Use --illegal-access=warn to enable warnings of further
> > illegal reflective access operations
> > WARNING: All illegal access operations will be denied in a future
> > release
> > Injector: java.lang.NullPointerException
> >         at
> > org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getBlockIndex(Fi
> > leInputFormat.java:444)
> >         at
> > org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileIn
> > putFormat.java:413)
> >         at
> > org.apache.hadoop.mapreduce.lib.input.DelegatingInputFormat.getSplits(
> > DelegatingInputFormat.java:115)
> >         at
> > org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.j
> > ava:301)
> >         at
> > org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java
> > :318)
> >         at
> > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitte
> > r.java:196)
> >         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
> >         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
> >         at
> > java.base/java.security.AccessController.doPrivileged(Native Method)
> >         at
> > java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> >         at
> > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformat
> > ion.java:1746)
> >         at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
> >         at
> > org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
> >         at org.apache.nutch.crawl.Injector.inject(Injector.java:417)
> >         at org.apache.nutch.crawl.Injector.run(Injector.java:563)
> >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> >         at org.apache.nutch.crawl.Injector.main(Injector.java:528)
> >
> > Error running:
> >   /home/nutch/nutch2/bin/nutch inject searchcrawl//crawldb urls/
> > Failed with exit value 255.
> >
> >
> > Im thinking about going back to Java 8 for now ...   but Its probably 
> > something
> silly due to it being late....
> >
> > On Wed, Feb 21, 2018 at 1:37 AM, BlackIce <blackice...@gmail.com
> <mailto:blackice...@gmail.com>> wrote:
> > I commented out the date and now after a whole lot of warnings it says
> > Build Successful
> >
> > Im gonna take it for a short spin before I set up solr...
> >
> >
> >
> > On Wed, Feb 21, 2018 at 12:01 AM, Markus Jelsma
> <markus.jel...@openindex.io <mailto:markus.jel...@openindex.io>> wrote:
> > Hello,
> 
> >
> 
> > Well, this is interesting! Have you tried Java 8 instead? I donĀ“t think 9 
> > should
> cause these kinds of problems but i havent tried it yet, but would like to 
> know
> anyway.
> 
> >
> 
> > Regarding commenting out the date, try it anyway!
> 
> >
> 
> > Regards,
> 
> > Markus
> 
> >
> 
> > -----Original message-----
> 
> > > From:BlackIce <blackice...@gmail.com <mailto:blackice...@gmail.com>>
> 
> > > Sent: Tuesday 20th February 2018 22:40
> 
> > > To: dev@nutch.apache.org <mailto:dev@nutch.apache.org>
> 
> > > Subject: Nutch fails to compile...
> 
> > >
> 
> > > HI,
> 
> > >
> 
> > > got a strange problem.. When trying to run ANT on Nutch 1.14 at first it 
> > > gave
> me an error regarding sonar.. so I commented Sonar out in the build.xml and
> now Im left with:
> 
> > >
> 
> > > BUILD FAILED
> 
> > > /home/nutch/nutch/build.xml:79: Unparseable date: "01/25/1971 2:00 pm"
> 
> > >
> 
> > > Im on JDK 9 and Ubuntu server 16.04
> 
> > >
> 
> > > Do I just comment this date out?
> 
> > >
> 
> > >
> 
> > > Thnx
> 
> > >
> 
> > > RRK
> 
> >
> >
> >

Reply via email to