That's probably due to a race condition in the local Hadoop tmp directory:
2017-10-25 13:48:14,870 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1007106179_0001 java.io.FileNotFoundException: File file:/tmp/hadoop-jenkins/merge-1508939167952/out/_temporary/0 does not exist see https://builds.apache.org/job/nutch-trunk/3463/testReport/org.apache.nutch.segment/TestSegmentMerger/testLargeMerge/ On 10/25/2017 03:52 PM, Apache Jenkins Server wrote: > See > <https://builds.apache.org/job/Nutch-trunk/3463/display/redirect?page=changes> > > Changes: > > [markus] NUTCH-2386 BasicURLNormalizer does not encode curly braces > > ------------------------------------------ > [...truncated 318.22 KB...] > > copy-generated-lib: > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-pass> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-protocol/test/data> > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-protocol/test/data> > > init: > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-protocol/classes> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-protocol/test/lib> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-protocol> > > init-plugin: > > deps-jar: > > clean-lib: > > resolve-default: > [ivy:resolve] :: loading settings :: file = > <https://builds.apache.org/job/Nutch-trunk/ws/ivy/ivysettings.xml> > > compile: > [echo] Compiling plugin: urlnormalizer-protocol > [javac] Compiling 1 source file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-protocol/classes> > > jar: > [jar] Building jar: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-protocol/urlnormalizer-protocol.jar> > > deps-test: > > deploy: > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-protocol> > > copy-generated-lib: > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-protocol> > > init: > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-querystring> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-querystring/classes> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-querystring/test> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-querystring/test/lib> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-querystring> > > init-plugin: > > deps-jar: > > clean-lib: > > resolve-default: > [ivy:resolve] :: loading settings :: file = > <https://builds.apache.org/job/Nutch-trunk/ws/ivy/ivysettings.xml> > > compile: > [echo] Compiling plugin: urlnormalizer-querystring > [javac] Compiling 2 source files to > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-querystring/classes> > [javac] Creating empty > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-querystring/classes/org/apache/nutch/net/urlnormalizer/querystring/package-info.class> > > jar: > [jar] Building jar: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-querystring/urlnormalizer-querystring.jar> > > deps-test: > > deploy: > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-querystring> > > copy-generated-lib: > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-querystring> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-regex/test/data> > [copy] Copying 4 files to > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-regex/test/data> > > init: > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-regex/classes> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-regex/test/lib> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-regex> > > init-plugin: > > deps-jar: > > clean-lib: > > resolve-default: > [ivy:resolve] :: loading settings :: file = > <https://builds.apache.org/job/Nutch-trunk/ws/ivy/ivysettings.xml> > > compile: > [echo] Compiling plugin: urlnormalizer-regex > [javac] Compiling 2 source files to > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-regex/classes> > [javac] Creating empty > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-regex/classes/org/apache/nutch/net/urlnormalizer/regex/package-info.class> > > jar: > [jar] Building jar: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-regex/urlnormalizer-regex.jar> > > deps-test: > > init: > > init-plugin: > > clean-lib: > > resolve-default: > [ivy:resolve] :: loading settings :: file = > <https://builds.apache.org/job/Nutch-trunk/ws/ivy/ivysettings.xml> > > compile: > > jar: > > deps-test: > > deploy: > > copy-generated-lib: > > deploy: > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-regex> > > copy-generated-lib: > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-regex> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-slash/test/data> > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-slash/test/data> > > init: > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-slash/classes> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-slash/test/lib> > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-slash> > > init-plugin: > > deps-jar: > > clean-lib: > > resolve-default: > [ivy:resolve] :: loading settings :: file = > <https://builds.apache.org/job/Nutch-trunk/ws/ivy/ivysettings.xml> > > compile: > [echo] Compiling plugin: urlnormalizer-slash > [javac] Compiling 1 source file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-slash/classes> > > jar: > [jar] Building jar: > <https://builds.apache.org/job/Nutch-trunk/ws/build/urlnormalizer-slash/urlnormalizer-slash.jar> > > deps-test: > > deploy: > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-slash> > > copy-generated-lib: > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/plugins/urlnormalizer-slash> > > compile: > > job: > [jar] Building jar: > <https://builds.apache.org/job/Nutch-trunk/ws/build/apache-nutch-1.14-SNAPSHOT.job> > > test-core: > [mkdir] Created dir: > <https://builds.apache.org/job/Nutch-trunk/ws/build/test/data> > [copy] Copying 48 files to > <https://builds.apache.org/job/Nutch-trunk/ws/build/test/data> > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/test/classes> > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/test/classes> > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/test/classes> > [copy] Copying 1 file to > <https://builds.apache.org/job/Nutch-trunk/ws/build/test/classes> > [junit] Running org.apache.nutch.crawl.TestAdaptiveFetchSchedule > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.497 sec > [junit] Running org.apache.nutch.crawl.TestCrawlDbFilter > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 4.548 sec > [junit] Running org.apache.nutch.crawl.TestCrawlDbMerger > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 3.776 sec > [junit] Running org.apache.nutch.crawl.TestCrawlDbStates > [junit] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 3.639 sec > [junit] Running org.apache.nutch.crawl.TestGenerator > [junit] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 43.08 sec > [junit] Running org.apache.nutch.crawl.TestInjector > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 6.617 sec > [junit] Running org.apache.nutch.crawl.TestLinkDbMerger > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 3.643 sec > [junit] Running org.apache.nutch.crawl.TestSignatureFactory > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.419 sec > [junit] Running org.apache.nutch.fetcher.TestFetcher > [junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 15.971 sec > [junit] Running org.apache.nutch.indexer.TestIndexerMapReduce > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 1.42 sec > [junit] Running org.apache.nutch.indexer.TestIndexingFilters > [junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.983 sec > [junit] Running org.apache.nutch.metadata.TestMetadata > [junit] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.189 sec > [junit] Running org.apache.nutch.metadata.TestSpellCheckedMetadata > [junit] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 2.911 sec > [junit] Running org.apache.nutch.net.TestURLFilters > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.632 sec > [junit] Running org.apache.nutch.net.TestURLNormalizers > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.713 sec > [junit] Running org.apache.nutch.parse.TestOutlinkExtractor > [junit] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.107 sec > [junit] Running org.apache.nutch.parse.TestParseData > [junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.218 sec > [junit] Running org.apache.nutch.parse.TestParseText > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.184 sec > [junit] Running org.apache.nutch.parse.TestParserFactory > [junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 1.876 sec > [junit] Running org.apache.nutch.plugin.TestPluginSystem > [junit] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 1.665 sec > [junit] Running org.apache.nutch.protocol.TestContent > [junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.69 sec > [junit] Running org.apache.nutch.protocol.TestProtocolFactory > [junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.873 sec > [junit] Running org.apache.nutch.segment.TestSegmentMerger > [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: > 128.174 sec > [junit] Test org.apache.nutch.segment.TestSegmentMerger FAILED > [junit] Running org.apache.nutch.segment.TestSegmentMergerCrawlDatums > [junit] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 117.236 sec > [junit] Running org.apache.nutch.service.TestNutchServer > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 1.844 sec > [junit] Running org.apache.nutch.tools.TestCommonCrawlDataDumper > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 2.192 sec > [junit] Running org.apache.nutch.util.TestEncodingDetector > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.763 sec > [junit] Running org.apache.nutch.util.TestGZIPUtils > [junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.408 sec > [junit] Running org.apache.nutch.util.TestMimeUtil > [junit] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 1.435 sec > [junit] Running org.apache.nutch.util.TestNodeWalker > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.238 sec > [junit] Running org.apache.nutch.util.TestPrefixStringMatcher > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.11 sec > [junit] Running org.apache.nutch.util.TestStringUtil > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.074 sec > [junit] Running org.apache.nutch.util.TestSuffixStringMatcher > [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.138 sec > [junit] Running org.apache.nutch.util.TestTableUtil > [junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.103 sec > [junit] Running org.apache.nutch.util.TestURLUtil > [junit] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 0.735 sec > > BUILD FAILED > <https://builds.apache.org/job/Nutch-trunk/ws/build.xml>:503: Tests failed! > > Total time: 7 minutes 14 seconds > Build step 'Invoke Ant' marked build as failure > Publishing Javadoc > [xUnit] [INFO] - Starting to record. > [xUnit] [INFO] - Processing JUnit > [xUnit] [INFO] - [JUnit] - 35 test report file(s) were found with the pattern > 'build/test/TEST-*.xml' relative to > '<https://builds.apache.org/job/Nutch-trunk/ws/'> for the testing framework > 'JUnit'. > [xUnit] [INFO] - Processing JUnit > [xUnit] [INFO] - [JUnit] - 35 test report file(s) were found with the pattern > 'build/**/test/TEST-*.xml' relative to > '<https://builds.apache.org/job/Nutch-trunk/ws/'> for the testing framework > 'JUnit'. > [xUnit] [INFO] - Check 'Failed Tests' threshold. > [xUnit] [INFO] - Check 'Skipped Tests' threshold. > [xUnit] [INFO] - Setting the build status to FAILURE > [xUnit] [INFO] - Stopping recording. > NUTCH-2386 issue doesn't exist in JIRA >
