I'm re-sending this case due to that, including mailer failures, sac.sfbay
wasn't operating properly last week.
The timer has been extended from 5/14 (Fri) to 5/17 (Mon).
Ienup
-------- Original Message --------
Subject: Libc iconv enhancement [PSARC/2010/160 FastTrack timeout 05/14/2010]
Date: Fri, 07 May 2010 09:50:16 -0700
From: Ienup Sung
Organization: Oracle Corporation
To: PSARC-ext
CC: i18n-discuss
Template Version: @(#)sac_nextcase 1.70 03/30/10 SMI
This information is Copyright (c) 2010, Oracle and/or its affiliates. All rights
reserved.
1. Introduction
1.1. Project/Component Working Name:
Libc iconv enhancement
1.2. Name of Document Author/Supplier:
Author: Ienup Sung
1.3 Date of This Document:
07 May, 2010
4. Technical Description
OVERVIEW
This project extends the current iconv API framework at libc so that it will
be compatible with GNU libiconv. It also adds a few additional Solaris specific
features such as iconvstr(3C) and additional iconv code conversion behaviors on
non-identical and illegal byte sequences as described at below:
- iconv_open(3C) will understand and properly handle "" (i.e., empty string),
"char", and "wchar_t" as possible values for fromcode and tocode arguments as
shown with change bars at [2] and also described in [3].
- iconv_open(3C) will parse fromcode and tocode arguments, understand, and
properly handle transliteration and code conversion behavior modification
requests when one or more of the following indicators are appended to
the names pointed to by the arguments as described with change bars
at [2] and also described in [3]:
"//ILLEGAL_DISCARD"
"//ILLEGAL_REPLACE_HEX"
"//ILLEGAL_RESTORE_HEX"
"//NON_IDENTICAL_DISCARD"
"//NON_IDENTICAL_REPLACE_HEX"
"//NON_IDENTICAL_RESTORE_HEX"
"//NON_IDENTICAL_TRANSLITERATE"
"//IGNORE" (An alias to "//NON_IDENTICAL_DISCARD//ILLEGAL_DISCARD".)
"//REPLACE_HEX" (An alias to
"//NON_IDENTICAL_REPLACE_HEX//ILLEGAL_REPLACE_HEX".)
"//RESTORE_HEX" (An alias to
"//NON_IDENTICAL_RESTORE_HEX//ILLEGAL_RESTORE_HEX".)
"//TRANSLIT" (An alias to "//NON_IDENTICAL_TRANSLITERATE".)
The "//IGNORE" and the "//TRANSLIT" are primarily provided for GNU libiconv
compatibility.
- The current path-through iconv tocode and fromcode names will go through
alias matching mechanism so that the path-through iconvs will also recognize
and support alias names. (As an example, iconv_open("8859-1", "ISO-8859-1")
will also activate the path-through iconv code conversion unless there is
a corresponding iconv code conversion module in the current system.)
- iconvctl(3C) will be added as a new function with some additional Solaris
extensions as described in [2] and [3]. This is also to be compatible with
the same GNU libiconv API.
- iconvstr(3C) will be added as a new function as described in [2] and [3].
This is to be compatible with the kernel iconv framework and, in particular,
kiconvstr(9F) [10] and also to provide a string-based code conversion
scheme in addition to the current buffer-based code conversion scheme of
iconv(3C). The main focus of the function at this point is to be compatible
with kiconvstr(9F).
To support the above, we will add three more Contracted Consolidation Private
interfaces defined between libc (owned by ON) and iconv code conversion shared
object modules (owned by G11N mostly) as described in [3] and [4]:
- _icv_open_attr()
- _icv_iconvctl()
- _icv_iconvstr()
Without any modifications, existing iconv code conversion shared object
modules and geniconvtbl binary table driven iconv code conversions will still
be supported as they are and be compatible with the new and enhanced iconv
framework; they will just not provide the new functionalities specified in
this spec.
To provide the new functionalities mentioned in this spec, iconv code
conversion shared object modules and geniconvtbl binary tables must be updated
to supply the necessary changes as specified in [2] and [3].
Once the case is approved by PSARC, the project team will also seek
the approvals on the [4] from the responsible engineering managers of
the related parties.
As a side note, we will do follow-up projects that will update the existing
iconv code conversion shared object modules and geniconvtbl-based binary tables
and also add necessary iconv code conversions and name aliases to be more
compatible with other platforms and systems in terms of code conversion
coverage and support of additional codeset/charset names.
Lastly, there are iconv_open_into(3C) API and also some extra features
in iconv(1) CLI from GNU libiconv that are not included in this project at this
time. They are planned to be done as a future project or two in near future
as necessary.
INTERFACE STABILITY AND RELEASE BINDING
There is no notable interface imported. Exported interfaces are:
Interface Stability Note
--------- --------- ----
iconv_open(3C), Committed [2]
iconv(3C),
iconvctl(3C),
iconvstr(3C),
iconv.h(3HEAD),
geniconvtbl(4)
_icv_open_attr(), Contracted [3], [4]
_icv_iconvctl(), Consolidation
_icv_iconvstr() Private
This project seeks Micro/Patch release binding.
REFERENCES
[1] Related CRs:
6803313 Solaris iconv does not support transliteration (Rails need
transliteration to work on Solaris)
6912982 iconv_open() should allow an empty string / "" / as any argument
6913721 alias supported is wanted for pass-through iconv tocode and
fromcode names
Bug 11957 - iconv doesn't support wchar_t as an encoding name
(http://defect.opensolaris.org/bz/show_bug.cgi?id=11957)
[2] Updated and new man pages at the materials directory of the case:
iconv_open.3c, iconv_open.3c.diff,
iconv.3c, iconv.3c.diff,
iconvctl.3c (new man page),
iconvstr.3c (new man page),
iconv.h.3head, iconv.h.3head.diff,
geniconvtbl.4, geniconvtbl.4.diff (See geniconvtbl.4.diff first since
geniconvtbl.4 has text with change bars from PSARC/2001/659 too.)
[3] Localization guide at the materials directory of the case:
iconv-l10n-guide.txt
[4] Contract template file at the materials directory of the case:
contract-template.txt
[5] PSARC/1993/153 iconv/iconv_open/iconv_close
[6] PSARC/1999/292 Addition of geniconvtbl(1)
[7] PSARC/2001/072 GNU gettext support
(For /usr/lib/iconv/alias and alias support mechanism at iconv.)
[8] PSARC/2001/659 Non-identical character conversion support in geniconvtbl(1)
[9] PSARC/2007/173 kiconv
[10] PSARC/2009/561 Pass-through iconv code conversion
6. Resources and Schedule
6.4. Steering Committee requested information
6.4.1. Consolidation C-team Name:
G11N
6.5. ARC review type: FastTrack
6.6. ARC Exposure: open
_______________________________________________
opensolaris-arc mailing list
[email protected]
