Re: conversion performance: UTF-8 BOCU-1 SCSU

2002-04-05 Thread Markus Scherer
With a small improvement to the single-byte loop, the BOCU-1 converter became faster. This improves especially the speed for Latin text conversion. Please see new numbers at http://oss.software.ibm.com/icu/dropbox/bocuperf.html markus

conversion performance: UTF-8 BOCU-1 SCSU

2002-04-04 Thread Markus Scherer
I have numbers for text size and conversion performance of BOCU-1 and SCSU relative to UTF-8. Quick summary: For Latin text, UTF-8 is best. For CJK, BOCU-1 and SCSU provide smaller size, with some speed trade-off. For other scripts, BOCU-1 and SCSU are much better than UTF-8 in both speed and