Well I opened an issue on Jira... https://issues.apache.org/jira/browse/NUTCH-2512
First time doing this... so I hope I did it right :) Greetz On Thu, Feb 22, 2018 at 12:09 AM, Yossi Tamari <[email protected]> wrote: > Hi Markus, BlackIce, > > Which version of Hadoop are you targeting? As far as I can see, Hadoop 3 > does not support Java 9 yet (see e.g. https://issues.apache.org/ > jira/browse/HADOOP-11123?subTaskView=all, https://issues.apache.org/ > jira/browse/HADOOP-11124, https://issues.apache.org/ > jira/browse/HADOOP-15046), and I'm not sure previous Hadoop versions have > Java 9 support in their pipeline at all... (see also > https://issues.apache.org/jira/browse/HADOOP-15045). > > Yossi. > > > -----Original Message----- > > From: Markus Jelsma [mailto:[email protected]] > > Sent: 22 February 2018 00:06 > > To: [email protected] > > Subject: RE: Nutch fails to compile... > > > > This clearly shows Nutch has issues with JDK9. Can you open a ticket? > > > > Getting things to work with JDK9 is crucial as it is a transitioning to > a new kind of > > JDK release schedule. So we should resolve the issues as soon as we can. > JDK9's > > EOL is sooner than you would expect from a regular JDK release. > > > > M., > > > > -----Original message----- > > > From:BlackIce <[email protected]> > > > Sent: Wednesday 21st February 2018 21:16 > > > To: [email protected] > > > Subject: Re: Nutch fails to compile... > > > > > > well reverting back to Java 8.. and it all works now > > > > > > On Wed, Feb 21, 2018 at 2:06 AM, BlackIce <[email protected] > > <mailto:[email protected]>> wrote: > > > So, now when using the crawl script.. I get this, and it happens with > both my > > Java9 compiled one and the binary distribution: > > > > > > Injecting seed URLs > > > /home/nutch/nutch2/bin/nutch inject searchcrawl//crawldb urls/ > > > Injector: starting at 2018-02-21 02:02:16 > > > Injector: crawlDb: searchcrawl/crawldb > > > Injector: urlDir: urls > > > Injector: Converting injected urls to crawl db entries. > > > WARNING: An illegal reflective access operation has occurred > > > WARNING: Illegal reflective access by > > > org.apache.hadoop.security.authentication.util.KerberosUtil > > > (file:/home/nutch/nutch2/lib/hadoop-auth-2.7.4.jar) to method > > > sun.security.krb5.Config.getInstance() > > > WARNING: Please consider reporting this to the maintainers of > > > org.apache.hadoop.security.authentication.util.KerberosUtil > > > WARNING: Use --illegal-access=warn to enable warnings of further > > > illegal reflective access operations > > > WARNING: All illegal access operations will be denied in a future > > > release > > > Injector: java.lang.NullPointerException > > > at > > > org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getBlockIndex(Fi > > > leInputFormat.java:444) > > > at > > > org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileIn > > > putFormat.java:413) > > > at > > > org.apache.hadoop.mapreduce.lib.input.DelegatingInputFormat.getSplits( > > > DelegatingInputFormat.java:115) > > > at > > > org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.j > > > ava:301) > > > at > > > org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java > > > :318) > > > at > > > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitte > > > r.java:196) > > > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) > > > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) > > > at > > > java.base/java.security.AccessController.doPrivileged(Native Method) > > > at > > > java.base/javax.security.auth.Subject.doAs(Subject.java:423) > > > at > > > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformat > > > ion.java:1746) > > > at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) > > > at > > > org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308) > > > at org.apache.nutch.crawl.Injector.inject(Injector.java:417) > > > at org.apache.nutch.crawl.Injector.run(Injector.java:563) > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > > > at org.apache.nutch.crawl.Injector.main(Injector.java:528) > > > > > > Error running: > > > /home/nutch/nutch2/bin/nutch inject searchcrawl//crawldb urls/ > > > Failed with exit value 255. > > > > > > > > > Im thinking about going back to Java 8 for now ... but Its probably > something > > silly due to it being late.... > > > > > > On Wed, Feb 21, 2018 at 1:37 AM, BlackIce <[email protected] > > <mailto:[email protected]>> wrote: > > > I commented out the date and now after a whole lot of warnings it says > > > Build Successful > > > > > > Im gonna take it for a short spin before I set up solr... > > > > > > > > > > > > On Wed, Feb 21, 2018 at 12:01 AM, Markus Jelsma > > <[email protected] <mailto:[email protected]>> wrote: > > > Hello, > > > > > > > > > > Well, this is interesting! Have you tried Java 8 instead? I don´t > think 9 should > > cause these kinds of problems but i havent tried it yet, but would like > to know > > anyway. > > > > > > > > > > Regarding commenting out the date, try it anyway! > > > > > > > > > > Regards, > > > > > Markus > > > > > > > > > > -----Original message----- > > > > > > From:BlackIce <[email protected] <mailto:[email protected]>> > > > > > > Sent: Tuesday 20th February 2018 22:40 > > > > > > To: [email protected] <mailto:[email protected]> > > > > > > Subject: Nutch fails to compile... > > > > > > > > > > > > HI, > > > > > > > > > > > > got a strange problem.. When trying to run ANT on Nutch 1.14 at > first it gave > > me an error regarding sonar.. so I commented Sonar out in the build.xml > and > > now Im left with: > > > > > > > > > > > > BUILD FAILED > > > > > > /home/nutch/nutch/build.xml:79: Unparseable date: "01/25/1971 2:00 > pm" > > > > > > > > > > > > Im on JDK 9 and Ubuntu server 16.04 > > > > > > > > > > > > Do I just comment this date out? > > > > > > > > > > > > > > > > > > Thnx > > > > > > > > > > > > RRK > > > > > > > > > > > > >
