On 8 Sep 2008, at 17:08, Jay Pipes wrote:

> Here is another option:

This doesn't seem to be another option, though. We still have to deal  
with UTF-8 somehow. We can't just use the binary string functions in  
PHP 5.

> Only use UTF8.  Process and display UTF8, store as UTF8 in the  
> database, and
> require the database to support UTF8 (which all of them do...at  
> least MySQL
> 4.1+ and PG and SQLite3).

We need to deal with things apart from UTF-8. Pingbacks require  
fetching arbitrary pages — they may well not be UTF-8. With regards to  
databases, MySQL can't represent characters above U+FFFF until version  
6.

> In Drizzle, we have just decided to scrap all other character sets
> completely, going with 4-byte UTF8 for everything, and only handle
> collations, not character sets.

"4-byte UTF-8" meaning UTF-8 per RFC 3629 and not RFC 2279?

> For Habari, which doesn't even have to deal with various performance  
> issues
> related to compression and other things with UTF8, I see no reason  
> not to
> just do UTF8 across the board and just assume everything is UTF8, so  
> all
> strings going into and out of Habari go through a String class which  
> always
> does UTF8.  Doing it this way will make porting to PHP6 a breeze,  
> since only
> the String class would have to be modified.

Porting to PHP6 seems no reason to use UTF-8 — it is all just as easy  
provided we abstract everything in a Unicode class.

> Sure, developers must learn to use the String class, but that's not  
> a big
> deal (that's what code reviews are for, anyway)
>
> +1 on String class, +1 on UTF8 for everything, +1 on a requirement  
> the DB
> must support UTF8, +1 on making all .schema files UTF8 as well...

The last three are already the case, the second we do insofar as  
storing and serving everything as UTF-8.


--
Geoffrey Sneddon
<http://gsnedders.com/>


--~--~---------~--~----~------------~-------~--~----~
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at http://groups.google.com/group/habari-dev
-~----------~----~----~----~------~----~------~--~---

Reply via email to