Revision: 18321
          http://sourceforge.net/p/gate/code/18321
Author:   ian_roberts
Date:     2014-09-12 11:06:58 +0000 (Fri, 12 Sep 2014)
Log Message:
-----------
Note about supplementary characters in the tokeniser

Modified Paths:
--------------
    userguide/trunk/recent-changes.tex

Modified: userguide/trunk/recent-changes.tex
===================================================================
--- userguide/trunk/recent-changes.tex  2014-09-12 01:19:58 UTC (rev 18320)
+++ userguide/trunk/recent-changes.tex  2014-09-12 11:06:58 UTC (rev 18321)
@@ -21,6 +21,14 @@
 
 \rcSect[next-release]{Next Release}
 
+\rcSubsect{September 2014}
+
+Better support for Unicode supplementary characters (with codes above FFFF) in
+the tokeniser -- supplementary characters are now reported properly as their
+relevant character types (letter, symbol, etc.) rather than the two halves of
+the surrpgate pair being reported as two separate characters of type
+``surrogate''.
+
 \rcSubsect{August 2014}
 New plugin for exporting annotations as HTML5 microdata.
 

This was sent by the SourceForge.net collaborative development platform, the 
world's largest Open Source development site.


------------------------------------------------------------------------------
Want excitement?
Manually upgrade your production database.
When you want reliability, choose Perforce
Perforce version control. Predictably reliable.
http://pubads.g.doubleclick.net/gampad/clk?id=157508191&iu=/4140/ostg.clktrk
_______________________________________________
GATE-cvs mailing list
GATE-cvs@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gate-cvs

Reply via email to