Update of /cvsroot/nutch/nutch/src/java/net/nutch/net/protocols/http
In directory
sc8-pr-cvs1.sourceforge.net:/tmp/cvs-serv2281/src/java/net/nutch/net/protocols/http
Modified Files:
HttpResponse.java
Log Message:
Added a new command, crawl, that constructs a database, injects a url
file and performs a few rounds of generate/fetch/updatedb. This
simplifies use for intranet sites. Changed some defaults to be
more intranet friendly.
Also fixed a bug where Fetcher.java didn't construct correct relative links
when a page was redirected.
Index: HttpResponse.java
===================================================================
RCS file:
/cvsroot/nutch/nutch/src/java/net/nutch/net/protocols/http/HttpResponse.java,v
retrieving revision 1.1
retrieving revision 1.2
diff -C2 -d -r1.1 -r1.2
*** HttpResponse.java 13 Feb 2004 19:53:49 -0000 1.1
--- HttpResponse.java 21 Apr 2004 22:52:35 -0000 1.2
***************
*** 28,31 ****
--- 28,32 ----
/** An HTTP response. */
public class HttpResponse implements Response {
+ private URL url;
private final Http http;
private int code;
***************
*** 34,38 ****
private byte[] content;
private byte[] compressedContent;
! MiscHttpAccounting httpAccounting;
/** Returns the response code. */
--- 35,41 ----
private byte[] content;
private byte[] compressedContent;
! private MiscHttpAccounting httpAccounting;
!
! public URL getUrl() { return url; }
/** Returns the response code. */
***************
*** 71,74 ****
--- 74,78 ----
throws IOException, HttpException {
+ this.url = url;
this.httpAccounting= httpAccounting;
this.http = http;
-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
Nutch-cvs mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-cvs
