ehatcher 2004/08/18 03:38:07
Modified: contributions/analyzers/src/java/org/apache/lucene/analysis/cjk
CJKTokenizer.java
Added: contributions/analyzers/src/java overview.html
Log:
quick fixes for javadoc warnings/errors
Revision Changes Path
1.1
jakarta-lucene-sandbox/contributions/analyzers/src/java/overview.html
Index: overview.html
===================================================================
<html>
<head>
<title>Jakarta Lucene Sandbox Analyzers</title>
</head>
<body>
</body>
</html>
1.4 +3 -5
jakarta-lucene-sandbox/contributions/analyzers/src/java/org/apache/lucene/analysis/cjk/CJKTokenizer.java
Index: CJKTokenizer.java
===================================================================
RCS file:
/home/cvs/jakarta-lucene-sandbox/contributions/analyzers/src/java/org/apache/lucene/analysis/cjk/CJKTokenizer.java,v
retrieving revision 1.3
retrieving revision 1.4
diff -u -r1.3 -r1.4
--- CJKTokenizer.java 22 Jan 2004 20:54:47 -0000 1.3
+++ CJKTokenizer.java 18 Aug 2004 10:38:07 -0000 1.4
@@ -61,9 +61,8 @@
/**
- * <p>
* CJKTokenizer was modified from StopTokenizer which does a decent job for
- * most European languages. and it perferm other token method for double-byte
+ * most European languages. It performs other token methods for double-byte
* Characters: the token will return at each two charactors with overlap match.<br>
* Example: "java C1C2C3C4" will be segment to: "java" "C1C2" "C2C3" "C3C4" it
* also need filter filter zero length token ""<br>
@@ -71,7 +70,6 @@
* for more info on Asia language(Chinese Japanese Korean) text segmentation:
* please search <a
* href="http://www.google.com/search?q=word+chinese+segment";>google</a>
- * </p>
*
* @author Che, Dong
*/
@@ -132,14 +130,14 @@
/**
* Returns the next token in the stream, or null at EOS.
+ * See
http://java.sun.com/j2se/1.3/docs/api/java/lang/Character.UnicodeBlock.html
+ * for detail.
*
* @return Token
*
* @throws java.io.IOException - throw IOException when read error <br>
* hanppened in the InputStream
*
- * @see
"http://java.sun.com/j2se/1.3/docs/api/java/lang/Character.UnicodeBlock.html";
- * for detail
*/
public final Token next() throws java.io.IOException {
/** how many character(s) has been stored in buffer */
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
