Hi Markus, BlackIce, Which version of Hadoop are you targeting? As far as I can see, Hadoop 3 does not support Java 9 yet (see e.g. https://issues.apache.org/jira/browse/HADOOP-11123?subTaskView=all, https://issues.apache.org/jira/browse/HADOOP-11124, https://issues.apache.org/jira/browse/HADOOP-15046), and I'm not sure previous Hadoop versions have Java 9 support in their pipeline at all... (see also https://issues.apache.org/jira/browse/HADOOP-15045).
Yossi. > -----Original Message----- > From: Markus Jelsma [mailto:[email protected]] > Sent: 22 February 2018 00:06 > To: [email protected] > Subject: RE: Nutch fails to compile... > > This clearly shows Nutch has issues with JDK9. Can you open a ticket? > > Getting things to work with JDK9 is crucial as it is a transitioning to a new > kind of > JDK release schedule. So we should resolve the issues as soon as we can. > JDK9's > EOL is sooner than you would expect from a regular JDK release. > > M., > > -----Original message----- > > From:BlackIce <[email protected]> > > Sent: Wednesday 21st February 2018 21:16 > > To: [email protected] > > Subject: Re: Nutch fails to compile... > > > > well reverting back to Java 8.. and it all works now > > > > On Wed, Feb 21, 2018 at 2:06 AM, BlackIce <[email protected] > <mailto:[email protected]>> wrote: > > So, now when using the crawl script.. I get this, and it happens with both > > my > Java9 compiled one and the binary distribution: > > > > Injecting seed URLs > > /home/nutch/nutch2/bin/nutch inject searchcrawl//crawldb urls/ > > Injector: starting at 2018-02-21 02:02:16 > > Injector: crawlDb: searchcrawl/crawldb > > Injector: urlDir: urls > > Injector: Converting injected urls to crawl db entries. > > WARNING: An illegal reflective access operation has occurred > > WARNING: Illegal reflective access by > > org.apache.hadoop.security.authentication.util.KerberosUtil > > (file:/home/nutch/nutch2/lib/hadoop-auth-2.7.4.jar) to method > > sun.security.krb5.Config.getInstance() > > WARNING: Please consider reporting this to the maintainers of > > org.apache.hadoop.security.authentication.util.KerberosUtil > > WARNING: Use --illegal-access=warn to enable warnings of further > > illegal reflective access operations > > WARNING: All illegal access operations will be denied in a future > > release > > Injector: java.lang.NullPointerException > > at > > org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getBlockIndex(Fi > > leInputFormat.java:444) > > at > > org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileIn > > putFormat.java:413) > > at > > org.apache.hadoop.mapreduce.lib.input.DelegatingInputFormat.getSplits( > > DelegatingInputFormat.java:115) > > at > > org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.j > > ava:301) > > at > > org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java > > :318) > > at > > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitte > > r.java:196) > > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) > > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) > > at > > java.base/java.security.AccessController.doPrivileged(Native Method) > > at > > java.base/javax.security.auth.Subject.doAs(Subject.java:423) > > at > > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformat > > ion.java:1746) > > at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) > > at > > org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308) > > at org.apache.nutch.crawl.Injector.inject(Injector.java:417) > > at org.apache.nutch.crawl.Injector.run(Injector.java:563) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > > at org.apache.nutch.crawl.Injector.main(Injector.java:528) > > > > Error running: > > /home/nutch/nutch2/bin/nutch inject searchcrawl//crawldb urls/ > > Failed with exit value 255. > > > > > > Im thinking about going back to Java 8 for now ... but Its probably > > something > silly due to it being late.... > > > > On Wed, Feb 21, 2018 at 1:37 AM, BlackIce <[email protected] > <mailto:[email protected]>> wrote: > > I commented out the date and now after a whole lot of warnings it says > > Build Successful > > > > Im gonna take it for a short spin before I set up solr... > > > > > > > > On Wed, Feb 21, 2018 at 12:01 AM, Markus Jelsma > <[email protected] <mailto:[email protected]>> wrote: > > Hello, > > > > > > Well, this is interesting! Have you tried Java 8 instead? I don´t think 9 > > should > cause these kinds of problems but i havent tried it yet, but would like to > know > anyway. > > > > > > Regarding commenting out the date, try it anyway! > > > > > > Regards, > > > Markus > > > > > > -----Original message----- > > > > From:BlackIce <[email protected] <mailto:[email protected]>> > > > > Sent: Tuesday 20th February 2018 22:40 > > > > To: [email protected] <mailto:[email protected]> > > > > Subject: Nutch fails to compile... > > > > > > > > HI, > > > > > > > > got a strange problem.. When trying to run ANT on Nutch 1.14 at first it > > > gave > me an error regarding sonar.. so I commented Sonar out in the build.xml and > now Im left with: > > > > > > > > BUILD FAILED > > > > /home/nutch/nutch/build.xml:79: Unparseable date: "01/25/1971 2:00 pm" > > > > > > > > Im on JDK 9 and Ubuntu server 16.04 > > > > > > > > Do I just comment this date out? > > > > > > > > > > > > Thnx > > > > > > > > RRK > > > > > > >
