Author: kwright
Date: Fri Sep 28 11:58:41 2012
New Revision: 1391414
URL: http://svn.apache.org/viewvc?rev=1391414&view=rev
Log:
Fix for CONNECTORS-547.
Modified:
manifoldcf/trunk/CHANGES.txt
manifoldcf/trunk/connectors/webcrawler/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/webcrawler/ThrottledFetcher.java
Modified: manifoldcf/trunk/CHANGES.txt
URL:
http://svn.apache.org/viewvc/manifoldcf/trunk/CHANGES.txt?rev=1391414&r1=1391413&r2=1391414&view=diff
==============================================================================
--- manifoldcf/trunk/CHANGES.txt (original)
+++ manifoldcf/trunk/CHANGES.txt Fri Sep 28 11:58:41 2012
@@ -8,6 +8,10 @@ CONNECTORS-535: Move readme files into S
======================= Release 1.0 =====================
+CONNECTORS-547: Web crawler, on encountering fatal error with no
+contents, would throw a StringIndexOutOfRange exception.
+(Erlend Garåsen, Karl Wright)
+
CONNECTORS-545: web-proprietary wars need to be used by single-
process proprietary example.
(Shinichiro Abe, Karl Wright)
@@ -30,7 +34,7 @@ CONNECTORS-538: Maven build broken on Sh
CONNECTORS-537: NPE when trying to display a history report when
the corresponding connector is unregistered.
-(Erlend Garason, Karl Wright)
+(Erlend Garåsen, Karl Wright)
CONNECTORS-533: Do not forgo xxx-README files in connector-lib-proprietary.
(Karl Wright)
Modified:
manifoldcf/trunk/connectors/webcrawler/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/webcrawler/ThrottledFetcher.java
URL:
http://svn.apache.org/viewvc/manifoldcf/trunk/connectors/webcrawler/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/webcrawler/ThrottledFetcher.java?rev=1391414&r1=1391413&r2=1391414&view=diff
==============================================================================
---
manifoldcf/trunk/connectors/webcrawler/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/webcrawler/ThrottledFetcher.java
(original)
+++
manifoldcf/trunk/connectors/webcrawler/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/webcrawler/ThrottledFetcher.java
Fri Sep 28 11:58:41 2012
@@ -1773,6 +1773,8 @@ public class ThrottledFetcher
Reader r = new InputStreamReader(is,encoding);
char[] buffer = new char[maxSize];
int amt = r.read(buffer);
+ if (amt == -1)
+ return "";
return new String(buffer,0,amt);
}
finally
