svn commit: r385531 - /lucene/nutch/trunk/src/java/org/apache/nutch/plugin/PluginManifestParser.java

2006-03-13 Thread ab
Author: ab
Date: Mon Mar 13 04:16:54 2006
New Revision: 385531

URL: http://svn.apache.org/viewcvs?rev=385531view=rev
Log:
Print out the full path of plugins directory. Allow using plugins
located outside classpath, eg. in shared repos.

Submitted by Stefan Groschupf, NUTCH-229.

Modified:

lucene/nutch/trunk/src/java/org/apache/nutch/plugin/PluginManifestParser.java

Modified: 
lucene/nutch/trunk/src/java/org/apache/nutch/plugin/PluginManifestParser.java
URL: 
http://svn.apache.org/viewcvs/lucene/nutch/trunk/src/java/org/apache/nutch/plugin/PluginManifestParser.java?rev=385531r1=385530r2=385531view=diff
==
--- 
lucene/nutch/trunk/src/java/org/apache/nutch/plugin/PluginManifestParser.java 
(original)
+++ 
lucene/nutch/trunk/src/java/org/apache/nutch/plugin/PluginManifestParser.java 
Mon Mar 13 04:16:54 2006
@@ -78,7 +78,7 @@
 File directory = getPluginFolder(name);
 if (directory == null)
 continue;
-LOG.info(Plugins: looking in:  + directory);
+LOG.info(Plugins: looking in:  + directory.getAbsolutePath());
 File[] files = directory.listFiles();
 if (files == null)
 continue;
@@ -115,7 +115,10 @@
 if (!directory.isAbsolute()) {
 URL url = PluginManifestParser.class.getClassLoader().getResource(
 name);
-if (url == null) {
+if (url == null  directory.exists()
+ directory.isDirectory()  directory.listFiles().length  
0) {
+return directory; // relative path that is not in the classpath
+} else if (url == null) {
 LOG.warning(Plugins: directory not found:  + name);
 return null;
 } else if (!file.equals(url.getProtocol())) {




[Nutch Wiki] Update of bin/nutch crawl by fha

2006-03-13 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Nutch Wiki for change 
notification.

The following page has been changed by fha:
http://wiki.apache.org/nutch/bin/nutch_crawl

--
  
  [-showThreadID]
  
- [-depth i]: You can tell Nutch how deep it should crawl. If you don’t tell 
Nutch a value, it takes 3 as his standard parameter. 
+ [-depth i]: You can tell Nutch how deep it should crawl. If you don’t tell 
Nutch a value, it takes 5 as his standard parameter. 
  For example if you say –depth 1, Nutch would only index the first level. 
Only if you say –depth 2 (or more) Nutch would make a link follow.
   
  


svn commit: r385702 - /lucene/nutch/trunk/src/java/org/apache/nutch/analysis/AnalyzerFactory.java

2006-03-13 Thread jerome
Author: jerome
Date: Mon Mar 13 16:00:38 2006
New Revision: 385702

URL: http://svn.apache.org/viewcvs?rev=385702view=rev
Log:
Fix NPE if lang is null

Modified:
lucene/nutch/trunk/src/java/org/apache/nutch/analysis/AnalyzerFactory.java

Modified: 
lucene/nutch/trunk/src/java/org/apache/nutch/analysis/AnalyzerFactory.java
URL: 
http://svn.apache.org/viewcvs/lucene/nutch/trunk/src/java/org/apache/nutch/analysis/AnalyzerFactory.java?rev=385702r1=385701r2=385702view=diff
==
--- lucene/nutch/trunk/src/java/org/apache/nutch/analysis/AnalyzerFactory.java 
(original)
+++ lucene/nutch/trunk/src/java/org/apache/nutch/analysis/AnalyzerFactory.java 
Mon Mar 13 16:00:38 2006
@@ -78,6 +78,7 @@
 
   private Extension getExtension(String lang) {
 
+if (lang == null) { return null; }
 Extension extension = (Extension) this.conf.getObject(lang);
 if (extension == null) {
   extension = findExtension(lang);