In perl.git, the branch smoke-me/khw-encode has been created
<http://perl5.git.perl.org/perl.git/commitdiff/49b71f113027511dc5a1911dd909f3c0f87890e7?hp=0000000000000000000000000000000000000000>
at 49b71f113027511dc5a1911dd909f3c0f87890e7 (commit)
- Log -----------------------------------------------------------------
commit 49b71f113027511dc5a1911dd909f3c0f87890e7
Author: Karl Williamson <[email protected]>
Date: Tue Nov 1 22:23:47 2016 -0600
customized
M t/porting/customized.dat
commit 2058facc3e93dee85d9a66779b7387872ed615d7
Author: Karl Williamson <[email protected]>
Date: Tue Nov 1 22:12:51 2016 -0600
later
M embed.fnc
M embed.h
M ext/XS-APItest/t/utf8.t
M proto.h
M utf8.c
commit 8132bcd482e6be8e94bf264afaf62b67c3661cf5
Author: Karl Williamson <[email protected]>
Date: Tue Nov 1 22:13:21 2016 -0600
APItest/t/utf8.t: Correct to uppercase in print
This worked so long as we didn't have hex digits A-F.
M ext/XS-APItest/t/utf8.t
commit d96b7013f13dbe9a6b6e6499e67b21523046e6e0
Author: Karl Williamson <[email protected]>
Date: Fri Oct 28 05:03:37 2016 -0600
XXX For EBCDIC debug
M utf8.c
commit b4af00e5356f55e39a82ae7fcb9a7a5d5bae443d
Author: Karl Williamson <[email protected]>
Date: Tue Oct 18 14:09:43 2016 -0600
pali
M cpan/Encode/Encode.xs
commit b5f7e4fc1ac2ae6a2984487688e92cd784e7497f
Author: Karl Williamson <[email protected]>
Date: Wed Oct 12 20:33:29 2016 -0600
later
M utf8.h
commit bac538792f3353885f6bb2d4e80442ed30f7cbe5
Author: Karl Williamson <[email protected]>
Date: Thu Sep 15 09:09:07 2016 -0600
XXX incomplete: Add sv_utf8_decode_flags
M embed.fnc
M embed.h
M proto.h
M sv.c
M sv.h
commit c5cadd9fb6808c79bc606fe7ff8fb5a4eb2aea05
Author: Karl Williamson <[email protected]>
Date: Wed Sep 14 22:40:23 2016 -0600
customized
M t/porting/customized.dat
commit 84f8e99e9babd936287f1896b00879a34e7ddeaf
Author: Karl Williamson <[email protected]>
Date: Thu Sep 1 12:20:52 2016 -0600
Use core REPLACEMENT CHARACTER definition
This allows the code to now work on EBCDIC as well.
M cpan/Encode/Encode/encode.h
commit a42a2a635daa86c8278cd51bc7bfa4c99f11f43b
Author: Karl Williamson <[email protected]>
Date: Thu Sep 1 12:16:00 2016 -0600
XXX commit msg: Encode.xs: Rmv unused function
M cpan/Encode/Encode.xs
commit 79cc76b201a05619b933af76a225ca44916a9d71
Author: Karl Williamson <[email protected]>
Date: Thu Sep 1 12:12:39 2016 -0600
Encode.xs: white-space only
M cpan/Encode/Encode.xs
commit bb2ef0528d172468f3babd6360c17647ec3a94d9
Author: Karl Williamson <[email protected]>
Date: Thu Sep 1 12:12:06 2016 -0600
XXX maybe more in commit msg: Speed up Encode UTF-8 validation checking
This replaces the current scheme for checking UTF-8 validity by one
in which normal processing doesn't require having to decode the UTF-8
into code points. The copying of characters individually from the input
to the output is changed to be a single operation for each entire span
of valid input at once.
Thus in the normal case, what ends up happening is a tight loop to
check the validity, and then a memmove of the entire input to the
output, then return.
If an error is found, it copies all the valid input before the error,
then handles the character in error, then positions to the next input
position, and repeats the whole process starting from there.
It uses the functionality available from the Perl 5 core to to look at
just the bytes that comprise the UTF-8 to make the determination,
converting to code points only those that are defective some how in
order to display them in warnings and error messages.
Thus, this does not need to know about the intricacies of UTF-8
malformations, relying on the core to handle this.
This cannot be pushed to CPAN until Devel::PPPort has been updated to
implement all the functions now needed.
M cpan/Encode/Encode.pm
M cpan/Encode/Encode.xs
-----------------------------------------------------------------------
--
Perl5 Master Repository
