commits  

Messages by Date

• 2020/08/16 [nutch] 34/35: NUTCH-2817 Avoid check for equality of URL path and file part using ==/!= - replace check whether URL path and file are identical by check whether URL has a query - clean up code and improve log messages snagel
• 2020/08/11 [nutch] branch master updated: NUTCH-2817 Avoid check for equality of URL path and file part using ==/!= - replace check whether URL path and file are identical by check whether URL has a query - clean up code and improve log messages snagel
• 2020/08/11 [nutch] branch master updated: NUTCH-2816 Add Spotbugs target to ant build - called on-demand as ant target "spotbugs" - creates spotbugs report ("build/nutch-spotbugs.html") covering Nutch core and plugins snagel
• 2020/08/03 [nutch] branch master updated: NUTCH-2810 FreeGenerator to actually apply configured number of fetch lists snagel
• 2020/08/03 [nutch] branch master updated (e33aaa1 -> 2f5a8ad) snagel
• 2020/08/03 svn commit: r1063816 - /websites/production/nutch/content/ snagel
• 2020/08/03 svn commit: r1880552 - /nutch/cms_site/trunk/content/credits.md snagel
• 2020/08/03 svn commit: r1063815 - in /websites/staging/nutch/trunk/content: ./ credits.html buildbot
• 2020/08/03 svn commit: r1063814 - in /websites/staging/nutch/trunk/content: ./ credits.html buildbot
• 2020/08/03 svn commit: r1880551 - /nutch/cms_site/trunk/content/credits.md snagel
• 2020/08/03 svn commit: r1063813 - in /websites/staging/nutch/trunk/content: ./ assets/js/README.html bot.html credits.html downloads.html index.html javadoc.html mailing_lists.html version_control.html buildbot
• 2020/08/03 svn commit: r1880550 - in /nutch/cms_site/trunk: content/credits.md templates/std.html snagel
• 2020/08/03 [nutch] branch master updated (5399ce0 -> e33aaa1) balakuntala
• 2020/08/02 [nutch] branch master updated (f0161ea -> 5399ce0) snagel
• 2020/07/29 [nutch] branch master updated: NUTCH-2805: Rename plugin urlfilter-domainblacklist (#540) balakuntala
• 2020/07/14 [nutch] branch master updated: NUTCH-2782: protocol-http / lib-http: support TLSv1.3 snagel
• 2020/07/14 [nutch] branch master updated (a1adce7 -> ff15671) snagel
• 2020/07/02 svn commit: r1062491 - /websites/production/nutch/content/ snagel
• 2020/07/02 svn commit: r1879450 - in /nutch/cms_site/trunk: content/assets/css/bootstrap.css templates/std.html snagel
• 2020/07/02 svn commit: r1062490 - in /websites/staging/nutch/trunk/content: ./ assets/css/bootstrap.css assets/js/README.html bot.html credits.html downloads.html index.html javadoc.html mailing_lists.html version_control.html buildbot
• 2020/07/02 svn commit: r40271 - /release/nutch/1.16/ snagel
• 2020/07/02 svn commit: r1062489 - /websites/production/nutch/content/ snagel
• 2020/07/02 svn commit: r1062488 - in /websites/staging/nutch/trunk/content: ./ version_control.html buildbot
• 2020/07/02 svn commit: r1879446 - /nutch/cms_site/trunk/content/version_control.md snagel
• 2020/07/02 svn commit: r1062485 - in /websites/staging/nutch/trunk/content: ./ version_control.html buildbot
• 2020/07/02 svn commit: r1879444 - /nutch/cms_site/trunk/content/version_control.md snagel
• 2020/07/02 svn commit: r1062484 - in /websites/staging/nutch/trunk/content: ./ assets/js/README.html bot.html credits.html downloads.html index.html javadoc.html mailing_lists.html version_control.html buildbot
• 2020/07/02 svn commit: r1879443 - in /nutch/cms_site/trunk: content/version_control.md templates/std.html snagel
• 2020/07/02 svn commit: r1879442 - in /nutch/cms_site/trunk/content: bot.md credits.md downloads.md index.md javadoc.md mailing_lists.md snagel
• 2020/07/02 svn commit: r1062483 - in /websites/staging/nutch/trunk/content: ./ bot.html credits.html downloads.html javadoc.html mailing_lists.html buildbot
• 2020/07/02 svn commit: r1879440 - in /nutch/cms_site/trunk: content/assets/css/bootstrap.css templates/std.html snagel
• 2020/07/02 svn commit: r1062481 - in /websites/staging/nutch/trunk/content: ./ assets/css/bootstrap.css assets/js/README.html bot.html credits.html downloads.html index.html javadoc.html mailing_lists.html version_control.html buildbot
• 2020/07/02 svn commit: r1062480 - in /websites/staging/nutch/trunk/content: ./ assets/css/ assets/img/ assets/js/ buildbot
• 2020/07/02 svn commit: r1879439 - in /nutch/cms_site/trunk: content/assets/css/bootstrap.css content/assets/img/nutch_logo_tm.gif content/assets/img/nutch_logo_tm.png content/index.md content/javadoc.md templates/std.html snagel
• 2020/07/02 svn commit: r1062474 - in /websites/staging/nutch/trunk/content: ./ apidocs/apidocs-1.17/ apidocs/apidocs-1.17/org/ apidocs/apidocs-1.17/org/apache/ apidocs/apidocs-1.17/org/apache/nutch/ apidocs/apidocs-1.17/org/apache/nutch/analysis/ apidocs/apidocs-... buildbot
• 2020/07/02 svn commit: r1879431 - in /nutch/cms_site/trunk/content: ./ apidocs/apidocs-1.17/ apidocs/apidocs-1.17/org/ apidocs/apidocs-1.17/org/apache/ apidocs/apidocs-1.17/org/apache/nutch/ apidocs/apidocs-1.17/org/apache/nutch/analysis/ apidocs/apidocs-1.17/org... snagel
• 2020/07/01 [nutch] branch master updated: Prepare for new development after release of 1.17 - bump version number (1.17-SNAPSHOT -> 1.18-SNAPSHOT) - add 1.17 changes / release notes - update links to Hadoop and Solr API docs - update current year in API docs etc. snagel
• 2020/07/01 svn commit: r40263 - /dev/nutch/1.17/ /release/nutch/1.17/ snagel
• 2020/06/18 svn commit: r40079 [1/3] - /dev/nutch/1.17/ snagel
• 2020/06/18 svn commit: r40079 [3/3] - /dev/nutch/1.17/ snagel
• 2020/06/18 svn commit: r40079 [2/3] - /dev/nutch/1.17/ snagel
• 2020/06/18 [nutch] annotated tag release-1.17 updated (e68bd87 -> eff98db) snagel
• 2020/06/18 [nutch] 01/02: Nutch 1.17 release - update links to Hadoop and Solr API docs snagel
• 2020/06/18 [nutch] 02/02: Nutch 1.17 release - update current year in API docs etc. - update version number - add changes / release notes snagel
• 2020/06/18 [nutch] branch branch-1.17 updated (77fa56e -> 1386c5a) snagel
• 2020/06/18 [nutch] annotated tag release-1.17 updated (77fa56e -> e68bd87) snagel
• 2020/06/18 [nutch] branch branch-1.17 created (now 77fa56e) snagel
• 2020/06/18 [nutch] 01/02: Nutch 1.16 release - update links to Hadoop and Solr API docs snagel
• 2020/06/18 [nutch] 02/02: Nutch 1.16 release - update current year in API docs etc. - update version number - add changes / release notes snagel
• 2020/06/17 [nutch] branch master updated: NUTCH-2794 Add additional ciphers to HTTP base's default cipher suite markus
• 2020/06/11 [nutch] branch master updated: NUTCH-2791 Handle GCS URLs in stats commands snagel
• 2020/06/10 [nutch] branch master updated: NUTCH-2790 indexer-csv: escape field leading quote character snagel
• 2020/06/09 [nutch] branch master updated: NUTCH-2496 Speed up link inversion step in crawling script snagel
• 2020/06/09 [nutch] branch master updated (9139d6e -> 1cb64df) snagel
• 2020/05/14 [nutch] branch master updated (e61a8a3 -> 9139d6e) snagel
• 2020/05/12 [nutch] branch master updated: NUTCH-1945 Test for XLSX parser - add Tika unit test for XLSX files - bundle instance variables and utility methods in class TikaParserTest - clean up javadoc comments snagel
• 2020/05/05 [nutch] branch master updated: NUTCH-2758 Add plugin READMEs to binary release packages snagel
• 2020/05/05 [nutch] branch master updated: NUTCH-2753 Add -listen option to command-line help of CrawlDbReader and LinkDbReader snagel
• 2020/05/05 [nutch] branch master updated: NUTCH-2002 parse and index checkers to check robots.txt - applied Julien's patch to recent code base - also check redirects whether they are allowed - add command-line parameter `-checkRobotsTxt` enabling this check snagel
• 2020/05/05 [nutch] branch master updated: NUTCH-2785 FreeGenerator: command-line option to define number of generated fetch lists - add command-line option `-numFetchers` to FreeGenerator - in local mode: generate one single fetch list snagel
• 2020/05/05 [nutch] branch master updated: NUTCH-1194 Generator: CrawlDB lock should be released earlier - release CrawlDb lock after select step, in case, generated items are not marked in CrawlDb (generate.update.crawldb is false) snagel
• 2020/05/05 [nutch] branch master updated: NUTCH-2434 Add methods to reset parameters HTMLMetaTags (apply patch contributed by Markus) snagel
• 2020/04/30 [nutch] branch master updated: NUTCH-2743 Add list of Nutch properties (nutch-default.xml) to documentation - modify ant build.xml to copy nutch-default.xml into docs/api/resources/ - adapt XSLT table layout - remove obsolete nutch-conf.xsl - fix typos and normalize spelling in nutch-default.xml snagel
• 2020/04/30 [nutch] branch master updated: NUTCH-2784 Tool to list Nutch properties and configured values snagel
• 2020/04/30 [nutch] branch master updated: NUTCH-2495: Use -deleteGone instead of clean job in crawl script while indexing snagel
• 2020/04/30 [nutch] branch master updated: NUTCH-2776 Fetcher to temporarily deduplicate followed redirects - cache followed redirect targets for a configurable time (`fetcher.redirect.dedupcache.seconds`) - if a redirect target is found in cache it's skipped snagel
• 2020/04/30 [nutch] branch master updated: NUTCH-2772 Debugging parse filter to show serialized DOM tree snagel
• 2020/04/28 [nutch] branch master updated: NUTCH-2778 indexer-elastic to properly log errors - add log output in BulkProcessor.Listener - do not throw an exception in BulkProcessor.Listener (ignored anyway) snagel
• 2020/04/28 [nutch] branch master updated: NUTCH-2501 allow to set Java heap size when using crawl script in distributed mode - fix examples of `-D property=value` in bin/crawl : there must be a blank after `-D` because these arguments are first parsed by bin/crawl snagel
• 2020/04/28 [nutch] branch master updated: NUTCH-2501 allow to set Java heap size when using crawl script in distributed mode - bin/crawl - add hint how to set map and reduce task memory via -D ... options - use -D options for all steps (Nutch tools), fixes NUTCH-2379 - fix quoting of -D options, eg. -D plugin.includes='protocol-xyz|parse-xyz' - use -D options for all steps (Nutch tools) - bin/nutch - document that environment variables are only used in local mode snagel
• 2020/04/28 [nutch] branch master updated: NUTCH-2781 Increase default Java heap size - increase default value for NUTCH_HEAPSIZE to 4096 MB (from 1000 MB) - remove -Dmapred.child.java.opts=-Xmx1000m from default options in bin/crawl snagel
• 2020/04/28 [nutch] branch master updated: NUTCH-2783 Use (more) parametrized logging - replace logging messages with string concatenations by parametrized calls - remove LOG.isInfoEnabled() where parametrized logging is used and no or minor extra calls are done to get logging parameters (similar for other log levels) - replace needless .toString() and Integer.toString(intVal) snagel
• 2020/04/28 [nutch] branch master updated (49eb1bd -> 52eec66) snagel
• 2020/04/24 [nutch] branch master updated: NUTCH-2779 Upgrade to Tika 1.24.1 snagel
• 2020/04/21 [nutch] branch master updated (6f51618 -> dcbb0f2) snagel
• 2020/04/19 [nutch] branch master updated (0cd0022 -> 6f51618) snagel
• 2020/04/10 [nutch] branch master updated: NUTCH-2777 - Upgrade to Hadoop 3.1 snagel
• 2020/04/10 [nutch] branch master updated: NUTCH-2775 Fetcher to guarantee minimum delay even if robots.txt defines shorter Crawl-delay - guaranteed minimum delay is configured by `fetcher.min.crawl.delay` (default set equal to `fetcher.server.delay`) snagel
• 2020/03/13 [nutch] branch master updated: NUTCH-2773 SegmentReader (-dump or -get): show HTML content as UTF-8 - if called with command-line flag `-recode` (or if property `segment.reader.content.recode` is true): try to recode the HTML page content to UTF-8 using the already detected charset - fix passing forward properties (-Dprop=val) to Hadoop job/tasks * always use same Hadoop Configuration * use single instance of SegmentReader for -get and -list * remove duplicating member and local variables snagel
• 2020/03/13 [nutch] branch master updated: NUTCH-2774 Annotate methods implementing the Hadoop API by @Override - annotate classes implementing Hadoop interfaces - annotate few classes implementing Nutch interfaces - remove empty method implementations when super classes already provide a default implementation snagel
• 2020/03/13 [nutch] branch master updated (ebc2152 -> 4443cc1) snagel
• 2020/02/27 [nutch] branch master updated: NUTCH-2763 protocol-okhttp (store.http.headers): add whitespace in status line after status code also when message is empty snagel
• 2020/02/27 [nutch] branch master updated: NUTCH-2768 FetcherThread: unnecessary usage of class casts snagel
• 2020/02/27 [nutch] branch master updated (142a026 -> ac4f2f4) snagel
• 2020/01/23 [nutch] branch master updated: NUTCH-2762 Replace http:// URLs by https:// (build files and documentation) - change URLs of linked resources in build files and documentation from http:// to https:// where possible - update resource locations where necessary snagel
• 2020/01/23 [nutch] branch master updated (0a2ffa7 -> ea862f4) snagel
• 2020/01/19 [nutch] branch master updated (a118c85 -> 0a2ffa7) snagel
• 2020/01/19 [nutch] branch master updated: NUTCH-2759 bin/crawl: Rename option --num-slaves - renamed to --num-fetchers snagel
• 2020/01/19 [nutch] branch master updated: NUTCH-2525 Metadata indexer cannot handle uppercase parse metadata - apply patch contributed by Jurian Broertjes snagel
• 2020/01/17 [nutch] branch master updated: NUTCH-2761 ivy jar fails to download - move to https download link on repo1 snagel
• 2020/01/09 [nutch] branch master updated (3bbc6dd -> c4dd7c1) snagel
• 2020/01/09 [nutch] branch master updated: NUTCH-2760 protocol-okhttp: properly record HTTP version in request message header - use HTTP protocol from connection (instead of response) for request message stored in metadata (if property `store.http.request` is true) snagel
• 2019/12/27 [nutch] branch master updated: Fix for NUTCH-1863: Add JSON format dump output to readdb command (#490) snagel
• 2019/12/23 [nutch] branch master updated: NUTCH-2754 fetcher.max.crawl.delay ignored if exceeding 5 min. / 300 sec. - initialize crawler-commons's SimpleRobotRulesParser with the longest possible internal maxDelay snagel
• 2019/12/20 [nutch] branch master updated: NUTCH-2745 Solr schema.xml not shipped in binary release - copy Solr schema.xml to runtime to include it into binary release packages snagel
• 2019/12/02 [nutch] branch master updated: NUTCH-2748 Fetch status gone (redirect exceeded) not to overwrite existing items in CrawlDb - new configuration property `http.redirect.max.exceeded.skip`: * if true skip redirect targets if http.redirect.max is exceeded * if false (default): store the redirect targets with status "linked" - log whether exceeded redirects are "skipped" or "linked" snagel
• 2019/11/22 [nutch] branch master updated: NUTCH-2746 Basic URL normalizer to normalize Unicode domain names - convert domain names IDN to ASCII or ASCII to IDN (configured by urlnormalizer.basic.host.idn) - strip trailing dot in host names (if urlnormalizer.basic.host.trim-trailing-dot is true) snagel
• 2019/11/22 [nutch] branch master updated: NUTCH-2739: Upgrade ES and migrate to REST client snagel
• 2019/11/12 [nutch] branch master updated: Fix for NUTCH-2750 snagel
• 2019/11/07 [nutch] branch master updated: NUTCH-1559 parse-metatags duplicates extracted metatags - do not add metatags already in ParseData's as this may lead to duplicates - add unit test - fix logging in MetaTagsParser to use slf4j snagel
• 2019/11/07 [nutch] branch master updated (6ca3c5b -> 65361d0) snagel
• 2019/10/16 svn commit: r1051560 - /websites/production/nutch/content/ snagel
• 2019/10/16 svn commit: r1051559 [3/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/i... buildbot
• 2019/10/16 svn commit: r1051559 [7/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/i... buildbot
• 2019/10/16 svn commit: r1051559 [6/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/i... buildbot
• 2019/10/16 svn commit: r1051559 [5/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/i... buildbot
• 2019/10/16 svn commit: r1051559 [1/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/i... buildbot
• 2019/10/16 svn commit: r1051559 [8/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/i... buildbot
• 2019/10/16 svn commit: r1051559 [2/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/i... buildbot
• 2019/10/16 svn commit: r1051559 [10/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/... buildbot
• 2019/10/16 svn commit: r1051559 [4/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/i... buildbot
• 2019/10/16 svn commit: r1051559 [11/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/... buildbot
• 2019/10/16 svn commit: r1051559 [9/11] - in /websites/staging/nutch/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/i... buildbot
• 2019/10/16 svn commit: r1868504 - /nutch/cms_site/trunk/content/credits.md snagel
• 2019/10/15 [nutch] branch master updated (f1cf2ff -> 6ca3c5b) snagel
• 2019/10/14 svn commit: r1868443 [9/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ mi... snagel
• 2019/10/14 svn commit: r1868443 [4/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ mi... snagel
• 2019/10/14 svn commit: r1868443 [13/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ m... snagel
• 2019/10/14 svn commit: r1868443 [2/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ mi... snagel
• 2019/10/14 svn commit: r1868443 [8/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ mi... snagel
• 2019/10/14 svn commit: r1868443 [1/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ mi... snagel
• 2019/10/14 svn commit: r1868443 [12/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ m... snagel
• 2019/10/14 svn commit: r1868443 [3/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ mi... snagel
• 2019/10/14 svn commit: r1868443 [6/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ mi... snagel
• 2019/10/14 svn commit: r1868443 [7/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ mi... snagel
• 2019/10/14 svn commit: r1868443 [5/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ mi... snagel
• 2019/10/14 svn commit: r1868443 [11/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ m... snagel
• 2019/10/14 svn commit: r1868443 [10/13] - in /nutch/cms_site/trunk/content: ./ miredot/1.16/ miredot/1.16/css/ miredot/1.16/font/ miredot/1.16/font/Droid_Sans/ miredot/1.16/font/Droid_Sans_Mono/ miredot/1.16/font/Open_Sans/ miredot/1.16/img/ miredot/1.16/input/ m... snagel
• 2019/10/13 svn commit: r1868423 - /nutch/cms_site/trunk/content/index.md snagel
• 2019/10/13 svn commit: r1051478 - /websites/production/nutch/content/ snagel
• 2019/10/13 svn commit: r1868416 - /nutch/cms_site/trunk/content/credits.md snagel
• 2019/10/12 svn commit: r1051406 - /websites/production/nutch/content/ snagel
• 2019/10/12 svn commit: r1051404 - in /websites/staging/nutch/trunk/content: ./ assets/js/README.html bot.html credits.html downloads.html index.html javadoc.html mailing_lists.html version_control.html buildbot
• 2019/10/12 svn commit: r1868331 - /nutch/cms_site/trunk/templates/std.html snagel
• 2019/10/12 svn commit: r1051403 - in /websites/staging/nutch/trunk/content: ./ assets/js/README.html bot.html credits.html downloads.html index.html javadoc.html mailing_lists.html version_control.html buildbot
• 2019/10/12 svn commit: r1868330 - in /nutch/cms_site/trunk: content/downloads.md templates/std.html snagel
• 2019/10/12 svn commit: r1051402 - in /websites/staging/nutch/trunk/content: ./ downloads.html javadoc.html buildbot
• 2019/10/12 svn commit: r1051401 - in /websites/staging/nutch/trunk/content: ./ credits.html buildbot
• 2019/10/12 svn commit: r1868328 - in /nutch/cms_site/trunk/content: downloads.md javadoc.md snagel
• 2019/10/12 svn commit: r1868327 - /nutch/cms_site/trunk/content/credits.md snagel
• 2019/10/11 svn commit: r36297 - /release/nutch/2.3.1/ snagel
• 2019/10/11 svn commit: r36296 - in /release/nutch: 1.15/ 2.4/ snagel
• 2019/10/11 svn commit: r1051377 - /websites/production/nutch/content/ snagel
• 2019/10/11 svn commit: r1051375 - in /websites/staging/nutch/trunk/content: ./ apidocs/apidocs-1.16/ apidocs/apidocs-1.16/org/ apidocs/apidocs-1.16/org/apache/ apidocs/apidocs-1.16/org/apache/nutch/ apidocs/apidocs-1.16/org/apache/nutch/analysis/ apidocs/apidocs-... buildbot
• 2019/10/11 svn commit: r1868293 - in /nutch/cms_site/trunk/content: ./ apidocs/apidocs-1.16/ apidocs/apidocs-1.16/org/ apidocs/apidocs-1.16/org/apache/ apidocs/apidocs-1.16/org/apache/nutch/ apidocs/apidocs-1.16/org/apache/nutch/analysis/ apidocs/apidocs-1.16/org... snagel
• 2019/10/11 svn commit: r1051372 - in /websites/staging/nutch/trunk/content: ./ credits.html buildbot
• 2019/10/11 svn commit: r1868291 - /nutch/cms_site/trunk/content/credits.md snagel
• 2019/10/11 svn commit: r1051370 - in /websites/staging/nutch/trunk/content: ./ credits.html buildbot
• 2019/10/11 svn commit: r1868286 - /nutch/cms_site/trunk/content/credits.md snagel
• 2019/10/08 [nutch] branch master updated: Prepare for new development after release of 1.16 - bump version number (1.16-SNAPSHOT -> 1.17-SNAPSHOT) - add 1.16 changes / release notes snagel
• 2019/10/08 [nutch] branch 2.x updated: Prepare 2.x for new development after release of 2.4 - bump version number (2.4-SNAPSHOT -> 2.5-SNAPSHOT) - add 2.4 changes / release notes snagel
• 2019/10/08 svn commit: r36253 - /dev/nutch/1.16/ /release/nutch/1.16/ snagel
• 2019/10/08 svn commit: r36252 - /dev/nutch/2.4/ /release/nutch/2.4/ snagel
• 2019/10/02 svn commit: r36162 [2/3] - /dev/nutch/1.16/ snagel
• 2019/10/02 svn commit: r36162 [3/3] - /dev/nutch/1.16/ snagel
• 2019/10/02 svn commit: r36162 [1/3] - /dev/nutch/1.16/ snagel
• 2019/10/02 [nutch] annotated tag release-1.16 updated (c9278f6 -> 6f15fba) snagel
• 2019/10/02 [nutch] branch branch-1.16 updated: Nutch 1.16 release - update year for API docs - add link to release notes snagel
• 2019/10/01 [nutch] 01/01: Nutch 1.16 release - update version number - add changes / release notes snagel
• 2019/10/01 [nutch] branch branch-1.16 created (now eef5af7) snagel
• 2019/10/01 [nutch] branch master updated: NUTCH-2279 LinkRank fails when using Hadoop MR output compression - read output directory of link counter job to determine output file name (fail if there is none or more than one file) - determine output codec and use it to read the output snagel
• 2019/10/01 [nutch] branch master updated (873d7bf -> a2762f0) snagel
• 2019/09/30 [nutch] branch master updated: NUTCH-2381 In some situations the class TextProfileSignature gives different signatures for the same text "profile" page. - implement secondary sorting (similar to patch provided by Rodrigo Joni Sestari) - allow to restore previous behavior by setting property `db.signature.text_profile.sec_sort_lex = false` snagel
• 2019/09/30 [nutch] branch master updated (0f46927 -> 9e49c3f) snagel
• 2019/09/30 [nutch] branch master updated: NUTCH-2482 index-geoip not to add null values to document fields - also improve handling of errors when searching for and reading GeoIP database files - upgrade dependencies snagel
• 2019/09/30 [nutch] branch master updated (caa9422 -> ff9f025) snagel
• 2019/09/27 [nutch] branch master updated: NUTCH-2736 Upgrade Dockerfile to be based on recent Ubuntu LTS version - upgrade to use Ubuntu 18.04 - remove installed packages not required to build Nutch snagel
• 2019/09/24 svn commit: r35983 [3/3] - in /dev/nutch/2.4: ./ CHANGES.txt apache-nutch-2.4-src.tar.gz apache-nutch-2.4-src.tar.gz.asc apache-nutch-2.4-src.tar.gz.sha512 apache-nutch-2.4-src.zip apache-nutch-2.4-src.zip.asc apache-nutch-2.4-src.zip.sha512 snagel
• 2019/09/24 svn commit: r35983 [2/3] - in /dev/nutch/2.4: ./ CHANGES.txt apache-nutch-2.4-src.tar.gz apache-nutch-2.4-src.tar.gz.asc apache-nutch-2.4-src.tar.gz.sha512 apache-nutch-2.4-src.zip apache-nutch-2.4-src.zip.asc apache-nutch-2.4-src.zip.sha512 snagel
• 2019/09/24 svn commit: r35983 [1/3] - in /dev/nutch/2.4: ./ CHANGES.txt apache-nutch-2.4-src.tar.gz apache-nutch-2.4-src.tar.gz.asc apache-nutch-2.4-src.tar.gz.sha512 apache-nutch-2.4-src.zip apache-nutch-2.4-src.zip.asc apache-nutch-2.4-src.zip.sha512 snagel
• 2019/09/23 [nutch] annotated tag release-2.4 updated (e803acd -> af4932c) snagel
• 2019/09/23 [nutch] 01/01: Update 2.4 release date snagel
• 2019/09/23 [nutch] branch branch-2.4 updated (7550c5a -> e803acd) snagel
• 2019/09/23 [nutch] 03/03: Update 2.4 release date snagel
• 2019/09/23 [nutch] 01/03: Add NUTCH-2722 and NUTCH-2734 to CHANGES.txt snagel
• 2019/09/23 [nutch] branch branch-2.4 updated (52188de -> 7550c5a) snagel
• 2019/09/23 [nutch] 02/03: Add dependency to hbase-common explicitly to ivy.xml to avoid errors during runtime snagel
• 2019/09/23 [nutch] branch master updated: NUTCH-1982 Make Git ignore IDE project files and add note about IDE setup - apply and update patch contributed by Marko Asplund snagel
• 2019/09/23 [nutch] branch branch-2.4 updated: NUTCH-2734 Upgrade Tika dependency to 1.22 - fall back to default Tika config if custom config file is not found - warn if loading a parser fails (reports potential plugin class loader issues - improve ant build file to download plugin dependencies (src/plugin/parse-tika/build-ivy.xml) - complete exclusions of dependencies provided also in Nutch core - force same version of xml-apis to be used by tika-core and tika-parsers: otherwise Tika parsers may fail with a linkage error because d [...] snagel
• 2019/09/20 [nutch] branch 2.x updated: NUTCH-2734 Upgrade Tika dependency to 1.22 - fall back to default Tika config if custom config file is not found - warn if loading a parser fails (reports potential plugin class loader issues - improve ant build file to download plugin dependencies (src/plugin/parse-tika/build-ivy.xml) - complete exclusions of dependencies provided also in Nutch core - force same version of xml-apis to be used by tika-core and tika-parsers: otherwise Tika parsers may fail with a linkage error because d [...] snagel
• 2019/09/19 [nutch] branch master updated (87b08fc -> 9e5ae73) r0ann3l
• 2019/09/09 [nutch] branch master updated: NUTCH-2612 Support for sitemap processing by hostname markus
• 2019/09/09 [nutch] branch master updated: NUTCH-2732: .template for configuration files. r0ann3l
• 2019/09/01 [nutch] branch master updated: NUTCH-2696 Nutch SegmentReader does not dump non-ASCII characters with Hadoop 3.x - open streams using fixed UTF-8 encoding snagel
• 2019/09/01 [nutch] branch master updated: NUTCH-2598 URLNormalizerChecker fails on invalid URLs in input - output empty string for invalid URLs (MalformdURLException thrown) or if normalizer(s) return null snagel
• 2019/09/01 [nutch] branch master updated (fa9f895 -> 9a9f425) snagel
• 2019/08/31 [nutch] branch master updated: NUTCH-2669 Reliable solution for javax.ws packaging.type - update org.apache.cxf to drop javax.ws.rs-api dependency snagel
• 2019/08/31 [nutch] branch master updated: NUTCH-2719: Showing a warning when an exchange points to an indexer that doesn't exist. r0ann3l
• 2019/08/31 [nutch] branch master updated: NUTCH-2718: file names of configuration files of index writers and exchanges are configurable. r0ann3l
• 2019/08/27 [nutch] branch master updated: NUTCH-2728 protocol-okhttp: upgrade okhttp dependency to 3.14.2 snagel
• 2019/08/27 [nutch] branch master updated: NUTCH-2727 Upgrade Hadoop dependencies to 2.9.2 - fix unit tests of protocol-okhttp to use plugin class loader and methods defined by Protocol interface to avoid dependency conflicts (Hadoop depends on okhttp as well) snagel
• 2019/08/26 [nutch] branch master updated: NUTCH-2726 Upgrade to Tika 1.22 - fall back to default Tika config if custom config file is not found - warn if loading a parser fails (reports potential plugin class loader issues - improve ant build file to download plugin dependencies (src/plugin/parse-tika/build-ivy.xml) - complete exclusions of dependencies provided also in Nutch core - force same version of xml-apis to be used by tika-core and tika-parsers: otherwise Tika parsers may fail with a linkage error because different [...] snagel
• 2019/08/26 [nutch] branch master updated: NUTCH-2731 Fix to ensure that credentials are set on delete operations. snagel
• 2019/08/05 [nutch] branch master updated: NUTCH-2702 Fetcher: suppress stack for frequent exceptions - exceptions listed in http.log.exceptions.suppress.stack are logged without stack trace - exclusions are checked when errors are logged in FetcherThread and HttpBase.getResponse(...) snagel
• 2019/07/29 [nutch] branch master updated: NUTCH-2725 Plugin lib-http to support per-host configurable cookies markus
• 2019/07/26 svn commit: r1048155 - /websites/production/nutch/content/ snagel
• 2019/07/26 svn commit: r1048153 - /websites/production/nutch/content/ snagel
• 2019/07/26 svn commit: r1048152 - in /websites/staging/nutch/trunk/content: ./ index.html buildbot
• 2019/07/26 svn commit: r1863786 - /nutch/cms_site/trunk/content/index.md snagel
• 2019/07/26 svn commit: r1048151 - /websites/production/nutch/content/ snagel

• Earlier messages
• Later messages