See <https://builds.apache.org/job/Nutch-trunk/3114/changes>
Changes: [totaro] Integrate again the patch NUTCH-1927 (robots.txt whitelist) that had been overwritten in Revision 1675243 ------------------------------------------ [...truncated 1362 lines...] A src/plugin/urlnormalizer-host/ivy.xml A src/plugin/urlnormalizer-host/src A src/plugin/urlnormalizer-host/src/test A src/plugin/urlnormalizer-host/src/test/org A src/plugin/urlnormalizer-host/src/test/org/apache A src/plugin/urlnormalizer-host/src/test/org/apache/nutch A src/plugin/urlnormalizer-host/src/test/org/apache/nutch/net A src/plugin/urlnormalizer-host/src/test/org/apache/nutch/net/urlnormalizer A src/plugin/urlnormalizer-host/src/test/org/apache/nutch/net/urlnormalizer/host A src/plugin/urlnormalizer-host/src/test/org/apache/nutch/net/urlnormalizer/host/TestHostURLNormalizer.java A src/plugin/urlnormalizer-host/src/java A src/plugin/urlnormalizer-host/src/java/org A src/plugin/urlnormalizer-host/src/java/org/apache A src/plugin/urlnormalizer-host/src/java/org/apache/nutch A src/plugin/urlnormalizer-host/src/java/org/apache/nutch/net A src/plugin/urlnormalizer-host/src/java/org/apache/nutch/net/urlnormalizer A src/plugin/urlnormalizer-host/src/java/org/apache/nutch/net/urlnormalizer/host A src/plugin/urlnormalizer-host/src/java/org/apache/nutch/net/urlnormalizer/host/HostURLNormalizer.java AU src/plugin/urlnormalizer-host/src/java/org/apache/nutch/net/urlnormalizer/host/package-info.java A src/plugin/urlnormalizer-host/data A src/plugin/urlnormalizer-host/data/hosts.txt A src/plugin/microformats-reltag A src/plugin/microformats-reltag/ivy.xml A src/plugin/microformats-reltag/src A src/plugin/microformats-reltag/src/java A src/plugin/microformats-reltag/src/java/org A src/plugin/microformats-reltag/src/java/org/apache A src/plugin/microformats-reltag/src/java/org/apache/nutch A src/plugin/microformats-reltag/src/java/org/apache/nutch/microformats A src/plugin/microformats-reltag/src/java/org/apache/nutch/microformats/reltag AU src/plugin/microformats-reltag/src/java/org/apache/nutch/microformats/reltag/RelTagIndexingFilter.java AU src/plugin/microformats-reltag/src/java/org/apache/nutch/microformats/reltag/RelTagParser.java AU src/plugin/microformats-reltag/src/java/org/apache/nutch/microformats/reltag/package.html AU src/plugin/microformats-reltag/plugin.xml AU src/plugin/microformats-reltag/build.xml A src/plugin/tld A src/plugin/tld/ivy.xml A src/plugin/tld/src A src/plugin/tld/src/java A src/plugin/tld/src/java/org A src/plugin/tld/src/java/org/apache A src/plugin/tld/src/java/org/apache/nutch A src/plugin/tld/src/java/org/apache/nutch/indexer A src/plugin/tld/src/java/org/apache/nutch/indexer/tld AU src/plugin/tld/src/java/org/apache/nutch/indexer/tld/package.html AU src/plugin/tld/src/java/org/apache/nutch/indexer/tld/TLDIndexingFilter.java A src/plugin/tld/src/java/org/apache/nutch/scoring A src/plugin/tld/src/java/org/apache/nutch/scoring/tld AU src/plugin/tld/src/java/org/apache/nutch/scoring/tld/TLDScoringFilter.java AU src/plugin/tld/src/java/org/apache/nutch/scoring/tld/package.html AU src/plugin/tld/plugin.xml AU src/plugin/tld/build.xml A src/plugin/urlnormalizer-basic AU src/plugin/urlnormalizer-basic/plugin.xml AU src/plugin/urlnormalizer-basic/build.xml A src/plugin/urlnormalizer-basic/ivy.xml A src/plugin/urlnormalizer-basic/src A src/plugin/urlnormalizer-basic/src/test A src/plugin/urlnormalizer-basic/src/test/org A src/plugin/urlnormalizer-basic/src/test/org/apache A src/plugin/urlnormalizer-basic/src/test/org/apache/nutch A src/plugin/urlnormalizer-basic/src/test/org/apache/nutch/net A src/plugin/urlnormalizer-basic/src/test/org/apache/nutch/net/urlnormalizer A src/plugin/urlnormalizer-basic/src/test/org/apache/nutch/net/urlnormalizer/basic AU src/plugin/urlnormalizer-basic/src/test/org/apache/nutch/net/urlnormalizer/basic/TestBasicURLNormalizer.java A src/plugin/urlnormalizer-basic/src/java A src/plugin/urlnormalizer-basic/src/java/org A src/plugin/urlnormalizer-basic/src/java/org/apache A src/plugin/urlnormalizer-basic/src/java/org/apache/nutch A src/plugin/urlnormalizer-basic/src/java/org/apache/nutch/net A src/plugin/urlnormalizer-basic/src/java/org/apache/nutch/net/urlnormalizer A src/plugin/urlnormalizer-basic/src/java/org/apache/nutch/net/urlnormalizer/basic AU src/plugin/urlnormalizer-basic/src/java/org/apache/nutch/net/urlnormalizer/basic/BasicURLNormalizer.java AU src/plugin/urlnormalizer-basic/src/java/org/apache/nutch/net/urlnormalizer/basic/package-info.java A src/plugin/parse-js A src/plugin/parse-js/ivy.xml A src/plugin/parse-js/src A src/plugin/parse-js/src/java A src/plugin/parse-js/src/java/org A src/plugin/parse-js/src/java/org/apache A src/plugin/parse-js/src/java/org/apache/nutch A src/plugin/parse-js/src/java/org/apache/nutch/parse A src/plugin/parse-js/src/java/org/apache/nutch/parse/js AU src/plugin/parse-js/src/java/org/apache/nutch/parse/js/package-info.java AU src/plugin/parse-js/src/java/org/apache/nutch/parse/js/JSParseFilter.java AU src/plugin/parse-js/plugin.xml AU src/plugin/parse-js/build.xml A src/test AU src/test/nutch-site.xml AU src/test/crawl-tests.xml A src/test/org A src/test/org/apache A src/test/org/apache/nutch A src/test/org/apache/nutch/crawl AU src/test/org/apache/nutch/crawl/TestSignatureFactory.java AU src/test/org/apache/nutch/crawl/CrawlDBTestUtil.java A src/test/org/apache/nutch/crawl/ContinuousCrawlTestUtil.java AU src/test/org/apache/nutch/crawl/TestInjector.java A src/test/org/apache/nutch/crawl/CrawlDbUpdateUtil.java AU src/test/org/apache/nutch/crawl/TestCrawlDbMerger.java A src/test/org/apache/nutch/crawl/TestCrawlDbStates.java AU src/test/org/apache/nutch/crawl/TestAdaptiveFetchSchedule.java A src/test/org/apache/nutch/crawl/TestCrawlDbFilter.java AU src/test/org/apache/nutch/crawl/DummyWritable.java AU src/test/org/apache/nutch/crawl/TestLinkDbMerger.java AU src/test/org/apache/nutch/crawl/TestGenerator.java A src/test/org/apache/nutch/crawl/TODOTestCrawlDbStates.java A src/test/org/apache/nutch/parse AU src/test/org/apache/nutch/parse/TestParseText.java AU src/test/org/apache/nutch/parse/TestOutlinkExtractor.java AU src/test/org/apache/nutch/parse/parse-plugin-test.xml AU src/test/org/apache/nutch/parse/TestParseData.java AU src/test/org/apache/nutch/parse/TestParserFactory.java A src/test/org/apache/nutch/util AU src/test/org/apache/nutch/util/TestPrefixStringMatcher.java AU src/test/org/apache/nutch/util/TestGZIPUtils.java AU src/test/org/apache/nutch/util/WritableTestUtils.java AU src/test/org/apache/nutch/util/TestNodeWalker.java AU src/test/org/apache/nutch/util/TestSuffixStringMatcher.java AU src/test/org/apache/nutch/util/TestEncodingDetector.java AU src/test/org/apache/nutch/util/TestURLUtil.java A src/test/org/apache/nutch/util/DumpFileUtilTest.java AU src/test/org/apache/nutch/util/TestStringUtil.java AU src/test/org/apache/nutch/util/TestMimeUtil.java A src/test/org/apache/nutch/indexer AU src/test/org/apache/nutch/indexer/TestIndexingFilters.java A src/test/org/apache/nutch/plugin AU src/test/org/apache/nutch/plugin/HelloWorldExtension.java AU src/test/org/apache/nutch/plugin/SimpleTestPlugin.java AU src/test/org/apache/nutch/plugin/TestPluginSystem.java AU src/test/org/apache/nutch/plugin/ITestExtension.java A src/test/org/apache/nutch/fetcher AU src/test/org/apache/nutch/fetcher/TestFetcher.java A src/test/org/apache/nutch/metadata AU src/test/org/apache/nutch/metadata/TestMetadata.java AU src/test/org/apache/nutch/metadata/TestSpellCheckedMetadata.java A src/test/org/apache/nutch/tools A src/test/org/apache/nutch/tools/proxy A src/test/org/apache/nutch/tools/proxy/LogDebugHandler.java A src/test/org/apache/nutch/tools/proxy/NotFoundHandler.java A src/test/org/apache/nutch/tools/proxy/AbstractTestbedHandler.java A src/test/org/apache/nutch/tools/proxy/DelayHandler.java A src/test/org/apache/nutch/tools/proxy/ProxyTestbed.java A src/test/org/apache/nutch/tools/proxy/SegmentHandler.java A src/test/org/apache/nutch/tools/proxy/FakeHandler.java A src/test/org/apache/nutch/tools/proxy/package-info.java A src/test/org/apache/nutch/tools/TestCommonCrawlDataDumper.java A src/test/org/apache/nutch/protocol AU src/test/org/apache/nutch/protocol/TestProtocolFactory.java AU src/test/org/apache/nutch/protocol/TestContent.java A src/test/org/apache/nutch/segment A src/test/org/apache/nutch/segment/TestSegmentMergerCrawlDatums.java AU src/test/org/apache/nutch/segment/TestSegmentMerger.java A src/test/org/apache/nutch/net AU src/test/org/apache/nutch/net/TestURLNormalizers.java AU src/test/org/apache/nutch/net/TestURLFilters.java AU src/test/filter-all.txt AU src/test/log4j.properties AU src/test/domain-urlfilter.txt A KEYS AU README.md AU build.xml AU NOTICE.txt AU default.properties AU LICENSE.txt U . At revision 1678797 [trunk] $ /home/jenkins/tools/ant/latest/bin/ant -file build.xml nightly javadoc Buildfile: <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build.xml> Trying to override old definition of task javac [taskdef] Could not load definitions from resource org/sonar/ant/antlib.xml. It could not be found. ivy-probe-antlib: ivy-download: [taskdef] Could not load definitions from resource org/sonar/ant/antlib.xml. It could not be found. ivy-download-unchecked: ivy-init-antlib: ivy-init: init: [mkdir] Created dir: <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build> [mkdir] Created dir: <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes> [mkdir] Created dir: <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/release> [mkdir] Created dir: <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/test> [mkdir] Created dir: <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/test/classes> [mkdir] Created dir: <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/test/lib> [copy] Copying 8 files to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf> [copy] Copying <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/automaton-urlfilter.txt.template> to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/automaton-urlfilter.txt> [copy] Copying <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/httpclient-auth.xml.template> to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/httpclient-auth.xml> [copy] Copying <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/nutch-site.xml.template> to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/nutch-site.xml> [copy] Copying <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/prefix-urlfilter.txt.template> to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/prefix-urlfilter.txt> [copy] Copying <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/regex-normalize.xml.template> to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/regex-normalize.xml> [copy] Copying <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/regex-urlfilter.txt.template> to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/regex-urlfilter.txt> [copy] Copying <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/subcollections.xml.template> to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/subcollections.xml> [copy] Copying <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/suffix-urlfilter.txt.template> to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/conf/suffix-urlfilter.txt> clean-test-lib: [delete] Deleting directory <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/test/lib> resolve-test: [ivy:resolve] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ :: [ivy:resolve] :: loading settings :: file = <https://builds.apache.org/job/Nutch-trunk/ws/trunk/ivy/ivysettings.xml> [taskdef] Could not load definitions from resource org/sonar/ant/antlib.xml. It could not be found. copy-libs: clean-default-lib: resolve-default: [taskdef] Could not load definitions from resource org/sonar/ant/antlib.xml. It could not be found. copy-libs: compile-core: [javac] Compiling 200 source files to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes> [javac] Note: <https://builds.apache.org/job/Nutch-trunk/ws/trunk/src/java/org/apache/nutch/crawl/CrawlDbReader.java> uses unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. [javac] Creating empty <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes/org/apache/nutch/tools/arc/package-info.class> [javac] Creating empty <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes/org/apache/nutch/util/package-info.class> [javac] Creating empty <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes/org/apache/nutch/net/package-info.class> [javac] Creating empty <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes/org/apache/nutch/segment/package-info.class> [javac] Creating empty <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes/org/apache/nutch/parse/package-info.class> [javac] Creating empty <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes/org/apache/nutch/scoring/webgraph/package-info.class> [javac] Creating empty <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes/org/apache/nutch/net/protocols/package-info.class> [javac] Creating empty <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes/org/apache/nutch/tools/package-info.class> [javac] Creating empty <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes/org/apache/nutch/protocol/package-info.class> [javac] Creating empty <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/classes/org/apache/nutch/scoring/package-info.class> compile-core-test: [javac] Compiling 50 source files to <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build/test/classes> [javac] <https://builds.apache.org/job/Nutch-trunk/ws/trunk/src/test/org/apache/nutch/tools/TestCommonCrawlDataDumper.java>:104: error: method dump in class CommonCrawlDataDumper cannot be applied to given types; [javac] dumper.dump(tempDir, sampleSegmentDir, false, null, false); [javac] ^ [javac] required: File,File,boolean,String[],boolean,String [javac] found: File,File,boolean,<null>,boolean [javac] reason: actual and formal argument lists differ in length [javac] 1 error BUILD FAILED <https://builds.apache.org/job/Nutch-trunk/ws/trunk/build.xml>:373: Compile failed; see the compiler error output for details. Total time: 13 seconds Build step 'Invoke Ant' marked build as failure Publishing Javadoc Updating NUTCH-1927
