OK, so I guess if those Hadoop binaries are needed, then the best is for Elephas build to not run the tests if on Windows, then? (It should still be OK to COMPILE it - although of course it wouldn't be something you would be able to use)
On 12 May 2016 at 13:16, Andy Seaborne <[email protected]> wrote: > https://wiki.apache.org/hadoop/Hadoop2OnWindows > > says > > """ > The official Apache Hadoop releases do not include Windows binaries (yet, as > of January 2014). > """ > > The test dependency is on hadoop-mini-cluster 2.6.0 which was Nov 2014. > > (mrunit 1.0.0 is April 2.3.0) > > It may just not run for testing on Windows. > > > Andy > > > The Jenkins windows job is disabled because it takes so much tmp space and > that was causing problems for stability of the build server. If the JVM > crashed, then tmp files didn't get cleaned; if tmp was a bit full, the peak > size was a problem. > > It runs -Pdev (and still does run - I just checked - I left it disabled > though). > > > > > On 12/05/16 12:06, Bruno P. Kinoshita wrote: >> >> I am quite sure I have a Windows VM somewhere at work. I can give it a try >> tomorrow Stian. I'm compiling on Linux right now. >> Cheers >> >> >> From: Stian Soiland-Reyes <[email protected]> >> To: [email protected] >> Sent: Thursday, 12 May 2016 11:03 PM >> Subject: Re: [] Release Jena 3.1.0 (3rd proposed candidate) >> >> Sorry, Windows 10 is not happy in building Elephas - something goes >> wrong with the hadoop file system (sounds like a Hadoop bug rather >> than Jena) >> >> mvn clean install fails at: >> >> [INFO] Apache Jena - Elephas - I/O ........................ FAILURE [09:44 >> min] >> [INFO] Apache Jena - Elephas - Map/Reduce ................. SKIPPED >> [INFO] Apache Jena - Elephas - Statistics Demo App ........ SKIPPED >> [INFO] Apache Jena - Distribution ......................... SKIPPED >> [INFO] Apache Jena - OSGi ................................. SKIPPED >> [INFO] Apache Jena - OSGi bundle .......................... SKIPPED >> [INFO] Apache Jena - OSGi Karaf features .................. SKIPPED >> [INFO] Apache Jena - Extras ............................... SKIPPED >> [INFO] Apache Jena - Extras - Query Builder ............... SKIPPED >> [INFO] Apache Jena ........................................ SKIPPED >> >> (In other words, all the other worked fine :) >> >> >> output_04[3](org.apache.jena.hadoop.rdf.io.output.turtle.StreamedTurtleOutputTest) >> Time elapsed: 0.017 sec <<< ERROR! >> java.lang.NullPointerException: null >> at java.lang.ProcessBuilder.start(ProcessBuilder.java:1012) >> at org.apache.hadoop.util.Shell.runCommand(Shell.java:482) >> at org.apache.hadoop.util.Shell.run(Shell.java:455) >> at >> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) >> at org.apache.hadoop.util.Shell.execCommand(Shell.java:808) >> at org.apache.hadoop.util.Shell.execCommand(Shell.java:791) >> at >> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:656) >> at >> org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:490) >> at >> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:462) >> at >> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:428) >> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:908) >> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:889) >> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:786) >> at >> org.apache.jena.hadoop.rdf.io.output.AbstractNodeTupleOutputFormat.getRecordWriter(AbstractNodeTupleOutputFormat.java:77) >> at >> org.apache.jena.hadoop.rdf.io.output.AbstractNodeTupleOutputFormatTests.testOutput(AbstractNodeTupleOutputFormatTests.java:199) >> at >> org.apache.jena.hadoop.rdf.io.output.AbstractNodeTupleOutputFormatTests.output_04(AbstractNodeTupleOutputFormatTests.java:253) >> at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:498) >> at >> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) >> at >> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) >> at >> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) >> at >> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) >> at >> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) >> at org.junit.rules.RunRules.evaluate(RunRules.java:20) >> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) >> at >> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) >> at >> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) >> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) >> at >> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) >> at >> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) >> at >> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) >> at >> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) >> at org.junit.runners.ParentRunner.run(ParentRunner.java:363) >> at org.junit.runners.Suite.runChild(Suite.java:128) >> at org.junit.runners.Suite.runChild(Suite.java:27) >> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) >> at >> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) >> at >> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) >> at >> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) >> at >> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) >> at org.junit.runners.ParentRunner.run(ParentRunner.java:363) >> at >> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) >> at >> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) >> at >> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) >> at >> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) >> at >> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) >> at >> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) >> >> This is repeated across all the Elephas IO tests. >> >> Tests run: 984, Failures: 0, Errors: 173, Skipped: 183 >> >> >> Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; >> 2015-11-10T16:41:47+00:00) >> Maven home: C:\Program Files\apache-maven-3.3.9\bin\.. >> Java version: 1.8.0_92, vendor: Oracle Corporation >> Java home: C:\Program Files\Java\jdk1.8.0_92\jre >> Default locale: en_GB, platform encoding: Cp1252 >> OS name: "windows 10", version: "10.0", arch: "amd64", family: "dos" >> >> BTW, this is not the standard Windows 10, but Windows 10 Pro Insider >> Preview Build 14332 - preview of what will become the "Anniersary >> Edition" later this summer. >> >> >> This is not a regression as I get the same error when trying to build >> jena-elephas 3.0.1. >> >> Perhaps someone with a normal Windows 10 and JDK 8 could have a go at >> compiling jena-elephas? To avoid building all of 3.1.0 RC you can >> always try on the 3.0.1 source release from >> http://jena.apache.org/download/index.cgi as it seems the problem is >> also there. >> >> >> >> > -- Stian Soiland-Reyes Apache Taverna (incubating), Apache Commons RDF (incubating) http://orcid.org/0000-0001-9842-9718
