Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Florian Klaempfl

Graeme Geldenhuys schrieb:

On Sat, Aug 30, 2008 at 4:07 PM, Florian Klaempfl
<[EMAIL PROTECTED]> wrote:

I don't know what is "core", so would you mind forwarding the related
messages to this group?

Not really, we had enough useless and time wasting discussions about this.


Still doesn't answer my question as to what "core" is... Is that a
different mailing list to fpc-devel?  


Yes, invite only mailing list for active developers.


If so, is there a archive I can
search?  


No :)


I would just like to know the arguments (background
information) for both utf-[8,16]


utf-8 will be supported by an extended ansistring which will support 
different encodings.

___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Graeme Geldenhuys
On Sat, Aug 30, 2008 at 4:07 PM, Florian Klaempfl
<[EMAIL PROTECTED]> wrote:
>>
>> I don't know what is "core", so would you mind forwarding the related
>> messages to this group?
>
> Not really, we had enough useless and time wasting discussions about this.

Still doesn't answer my question as to what "core" is... Is that a
different mailing list to fpc-devel?  If so, is there a archive I can
search?  I would just like to know the arguments (background
information) for both utf-[8,16]


Regards,
 - Graeme -


___
fpGUI - a cross-platform Free Pascal GUI toolkit
http://opensoft.homeip.net/fpgui/
___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re[2]: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread JoshyFun
Hello Florian,

Saturday, August 30, 2008, 5:30:08 PM, you wrote:

>> I'm writting some unicode support functions, they are mostly based in
>> the current WideString format. Is there any important technical
>> difference which could prevent the current code to work as the
>> WideString one ?
FK> This depends on the code and that's why there is this branch :)

I had checked the branch, checking the source changes and it mostly
looks like a widestring alias. As my code "only uses" character array
access and Length() function, everything should continue to work as
expected.

I have some difficults to test it over the branch, my code currently
only compiles under Lazarus (test cases are mostly visuals) and make
my Lazarus work over a new FPC branch could be problematic for other
non related projects.

I'll try to compile a new FPC in the other computer to test the
functions. Thank you.

-- 
Best regards,
 JoshyFun

___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Florian Klaempfl

JoshyFun schrieb:

Hello Florian,

Saturday, August 30, 2008, 1:37:42 PM, you wrote:

FK> I've continued to work on support of an unicodestring type in fpc. It's
FK> currently in an svn branch at:
FK> http://svn.freepascal.org/svn/fpc/branches/unicodestring
FK> and will be merged later to trunk. The unicodestring type is a ref.
FK> counted utf-16 string. On non-windows, widestring is mapped to this
FK> type. If you're interested in unicode support please test, give feedback
FK> here and submit fixes.

I'm writting some unicode support functions, they are mostly based in
the current WideString format. Is there any important technical
difference which could prevent the current code to work as the
WideString one ?



This depends on the code and that's why there is this branch :)
___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Daniël Mantione



Op Sat, 30 Aug 2008, schreef Marco van de Voort:


In our previous episode, Michael Van Canneyt said:

and back with
svn switch http://svn.freepascal.org/svn/fpc/trunk


What happened to the idea of dynamical encoding ? And why utf-16 ? Unix
uses UTF-8 by default, which means that a conversion must be done each
time you interface to the OS ?


I assume this means Tiburon UTF-8 extension to ansistring follows on this
change.

So then you can (hopefully) pretty much do

{$ifdef unix} // in reality it is more complicated than ifdef unix, but for
now..
TNativeString = type ansistring (CP_UTF8);
{$else}
TNativeString = type TUnicodeString;
{$endif}

And use TNativeString for encoding agnostic purposes.


Well, really agnostic code should simply use "string" :)

Daniël___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread JoshyFun
Hello Florian,

Saturday, August 30, 2008, 1:37:42 PM, you wrote:

FK> I've continued to work on support of an unicodestring type in fpc. It's
FK> currently in an svn branch at:
FK> http://svn.freepascal.org/svn/fpc/branches/unicodestring
FK> and will be merged later to trunk. The unicodestring type is a ref.
FK> counted utf-16 string. On non-windows, widestring is mapped to this
FK> type. If you're interested in unicode support please test, give feedback
FK> here and submit fixes.

I'm writting some unicode support functions, they are mostly based in
the current WideString format. Is there any important technical
difference which could prevent the current code to work as the
WideString one ?

-- 
Best regards,
 JoshyFun

___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Marco van de Voort
In our previous episode, Michael Van Canneyt said:
> > and back with
> > svn switch http://svn.freepascal.org/svn/fpc/trunk
> 
> What happened to the idea of dynamical encoding ? And why utf-16 ? Unix
> uses UTF-8 by default, which means that a conversion must be done each
> time you interface to the OS ? 

I assume this means Tiburon UTF-8 extension to ansistring follows on this
change.
 
So then you can (hopefully) pretty much do

{$ifdef unix} // in reality it is more complicated than ifdef unix, but for
now..
 TNativeString = type ansistring (CP_UTF8);
{$else}
 TNativeString = type TUnicodeString;
{$endif}

And use TNativeString for encoding agnostic purposes.
___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Florian Klaempfl

Graeme Geldenhuys schrieb:

On Sat, Aug 30, 2008 at 3:45 PM, Florian Klaempfl
<[EMAIL PROTECTED]> wrote:

And why utf-16 ? Unix
uses UTF-8 by default, which means that a conversion must be done each
time you interface to the OS ?
Can you explain some of the decisions ?


See my post on core some weeks ago ;)


I don't know what is "core", so would you mind forwarding the related
messages to this group? 


Not really, we had enough useless and time wasting discussions about this.

I'm quite curious as well as to why UTF-16.  


Because it's the first step for more unicode support and because it was 
already started.



I
think the bigger user base is *nix systems like *BSD, Mac OS-X and
Linux, so from that point of view UTF-8 would be better? No?


Could be, but I'am using windows :)
___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Daniël Mantione



Op Sat, 30 Aug 2008, schreef Michael Van Canneyt:




On Sat, 30 Aug 2008, Florian Klaempfl wrote:


I've continued to work on support of an unicodestring type in fpc. It's
currently in an svn branch at:
http://svn.freepascal.org/svn/fpc/branches/unicodestring
and will be merged later to trunk. The unicodestring type is a ref. counted
utf-16 string. On non-windows, widestring is mapped to this type. If you're
interested in unicode support please test, give feedback here and submit
fixes.

An existing working copy of trunk can be switched to this branch by
cd fpc
svn switch http://svn.freepascal.org/svn/fpc/branches/unicodestring
and back with
svn switch http://svn.freepascal.org/svn/fpc/trunk


What happened to the idea of dynamical encoding ? And why utf-16 ? Unix
uses UTF-8 by default, which means that a conversion must be done each
time you interface to the OS ?


A conversion must be done for applications using UTF-8 as well. Only if 
you are writing charset agnostic code, no conversion is necessary.


Daniël___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Graeme Geldenhuys
On Sat, Aug 30, 2008 at 3:45 PM, Florian Klaempfl
<[EMAIL PROTECTED]> wrote:
>> And why utf-16 ? Unix
>> uses UTF-8 by default, which means that a conversion must be done each
>> time you interface to the OS ?
>> Can you explain some of the decisions ?
>>
>
> See my post on core some weeks ago ;)

I don't know what is "core", so would you mind forwarding the related
messages to this group? I'm quite curious as well as to why UTF-16.  I
think the bigger user base is *nix systems like *BSD, Mac OS-X and
Linux, so from that point of view UTF-8 would be better? No?


Regards,
 - Graeme -


___
fpGUI - a cross-platform Free Pascal GUI toolkit
http://opensoft.homeip.net/fpgui/
___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Florian Klaempfl

Michael Van Canneyt schrieb:


On Sat, 30 Aug 2008, Florian Klaempfl wrote:


I've continued to work on support of an unicodestring type in fpc. It's
currently in an svn branch at:
http://svn.freepascal.org/svn/fpc/branches/unicodestring
and will be merged later to trunk. The unicodestring type is a ref. counted
utf-16 string. On non-windows, widestring is mapped to this type. If you're
interested in unicode support please test, give feedback here and submit
fixes.

An existing working copy of trunk can be switched to this branch by
cd fpc
svn switch http://svn.freepascal.org/svn/fpc/branches/unicodestring
and back with
svn switch http://svn.freepascal.org/svn/fpc/trunk


What happened to the idea of dynamical encoding ? 


It will follow. UnicodeString was something which was started months ago 
and never finished so far.



And why utf-16 ? Unix
uses UTF-8 by default, which means that a conversion must be done each
time you interface to the OS ? 


Can you explain some of the decisions ?



See my post on core some weeks ago ;)
___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Michael Van Canneyt


On Sat, 30 Aug 2008, Florian Klaempfl wrote:

> I've continued to work on support of an unicodestring type in fpc. It's
> currently in an svn branch at:
> http://svn.freepascal.org/svn/fpc/branches/unicodestring
> and will be merged later to trunk. The unicodestring type is a ref. counted
> utf-16 string. On non-windows, widestring is mapped to this type. If you're
> interested in unicode support please test, give feedback here and submit
> fixes.
> 
> An existing working copy of trunk can be switched to this branch by
> cd fpc
> svn switch http://svn.freepascal.org/svn/fpc/branches/unicodestring
> and back with
> svn switch http://svn.freepascal.org/svn/fpc/trunk

What happened to the idea of dynamical encoding ? And why utf-16 ? Unix
uses UTF-8 by default, which means that a conversion must be done each
time you interface to the OS ? 

Can you explain some of the decisions ?

Michael.
___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Florian Klaempfl

Felipe Monteiro de Carvalho schrieb:

Will there be a new set of RTL routines designed to work with this
string type? Probably with the same name as normal RTL routines, just
overloaded.


Not by me. I consider the compiler and helper routines support as my part.
___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


Re: [fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Felipe Monteiro de Carvalho
Will there be a new set of RTL routines designed to work with this
string type? Probably with the same name as normal RTL routines, just
overloaded.

thanks,
-- 
Felipe Monteiro de Carvalho
___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel


[fpc-devel] Unicodestring branch, please test and help fixing

2008-08-30 Thread Florian Klaempfl
I've continued to work on support of an unicodestring type in fpc. It's 
currently in an svn branch at:

http://svn.freepascal.org/svn/fpc/branches/unicodestring
and will be merged later to trunk. The unicodestring type is a ref. 
counted utf-16 string. On non-windows, widestring is mapped to this 
type. If you're interested in unicode support please test, give feedback 
here and submit fixes.


An existing working copy of trunk can be switched to this branch by
cd fpc
svn switch http://svn.freepascal.org/svn/fpc/branches/unicodestring
and back with
svn switch http://svn.freepascal.org/svn/fpc/trunk
___
fpc-devel maillist  -  fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel