Re: [MacRuby-devel] String performance (yet another)

2011-01-18 Thread Vincent Isambart
>  File.read("test.txt").force_encoding("UTF-16LE").split("\n") > > This script returns an error (Encoding::CompatibilityError) even with > declaring char code at the beginning or the encoding of the file being > UTF-16LE. MacRuby completely ignores the encoding of the file (it always reads sour

Re: [MacRuby-devel] String performance (yet another)

2011-01-18 Thread Yasu Imao
Hi Vincent, I used force_encode for a testing purpose only, which was suggested somewhere. Using String#encode introduces another problem, so I don't want to use it in my app. It seems to be that I have to add String#encode to all the String objects used with the text read from a file. This

Re: [MacRuby-devel] String performance (yet another)

2011-01-16 Thread Vincent Isambart
Hi, > Indeed, String#[] will now perform slower on UTF8 non-ascii strings, because > computing the character index cannot be done in constant time anymore. > I don't believe this can be improved using the optimization we implemented > for #gsub and #scan. Maybe 1.9.2 has a better optimization, I w

Re: [MacRuby-devel] String performance (yet another)

2011-01-16 Thread Laurent Sansonetti
Hi Yasu, Indeed, String#[] will now perform slower on UTF8 non-ascii strings, because computing the character index cannot be done in constant time anymore. I don't believe this can be improved using the optimization we implemented for #gsub and #scan. Maybe 1.9.2 has a better optimization, I w

[MacRuby-devel] String performance (yet another)

2011-01-16 Thread Yasu Imao
Hi, I found another String performance issue, which is different from #1077. I used the same 8092 words English text in UTF-8 used in #1077. The latest nightly (2011/01/16) is about 6 times slower than MacRuby 0.8, which was as fast as 1.9.2. I'm just wondering if I should file this for 0.9