Bug#965029: console-setup: fonts missing numerous unicode->font mappings for box-drawing characters
On Mon, Jul 20, 2020 at 09:03:33PM -0400, Nick Black wrote: > > Tested all three using the same methodology as outlined earlier. > > Looks perfect =]. Thanks. Anton Zinoviev
Bug#965029: console-setup: fonts missing numerous unicode->font mappings for box-drawing characters
Anton Zinoviev left as an exercise for the reader: > Оk. I've attached updated versions of Arabic-Fixed16.psf, > Arabic-VGA16.psf and Lat15-Terminus16.psf. Hopefully, this time the > fonts are ok. Tested all three using the same methodology as outlined earlier. Looks perfect =]. -- nick black -=- https://www.nick-black.com to make an apple pie from scratch, you need first invent a universe.
Bug#965029: console-setup: fonts missing numerous unicode->font mappings for box-drawing characters
On Mon, Jul 20, 2020 at 09:34:36AM -0400, Nick Black wrote: > > I don't make use of the following, so they're not important to > me, but it might be worthwhile to handle these: > > U+2BBD BALLOT BOX WITH LIGHT X > U+2718 HEAVY BALLOT X > U+2717 BALLOT X Оk. I've attached updated versions of Arabic-Fixed16.psf, Arabic-VGA16.psf and Lat15-Terminus16.psf. Hopefully, this time the fonts are ok. > Will this work be going upstream? I'm not clear on whether > you're the upstream maintainer, or just Debian's. In this case Debian = upstream. Anton Zinoviev Arabic-VGA16.psf Description: Binary data Arabic-Fixed16.psf Description: Binary data Lat15-Terminus16.psf Description: Binary data
Bug#965029: console-setup: fonts missing numerous unicode->font mappings for box-drawing characters
Anton Zinoviev left as an exercise for the reader: > On Mon, Jul 20, 2020 at 05:32:55AM -0400, Nick Black wrote: > What about these? > > . for U+2610 BALLOT BOX > v for U+2611 BALLOT BOX WITH CHECK > x for U+2612 BALLOT BOX WITH X If that's what you like, it's fine with me =]. So long as they're differentiated. I don't make use of the following, so they're not important to me, but it might be worthwhile to handle these: U+2BBD BALLOT BOX WITH LIGHT X U+2718 HEAVY BALLOT X U+2717 BALLOT X So far as I'm aware, there's no way to map non-BMP UTF8 (e.g. U+1F5F6 BALLOT BOLD SCRIPT X) into the console Unicode->font table, since it only accepts UCS-2 (fixed 16-bit). I'm interested in putting together the necessary kernel work to address this, but until then it's not a thing. Will this work be going upstream? I'm not clear on whether you're the upstream maintainer, or just Debian's. -- nick black -=- https://www.nick-black.com to make an apple pie from scratch, you need first invent a universe.
Bug#965029: console-setup: fonts missing numerous unicode->font mappings for box-drawing characters
On Mon, Jul 20, 2020 at 05:32:55AM -0400, Nick Black wrote: > > To be more precise, U+2571 BOX DRAWINGS LIGHT DIAGONAL UPPER > RIGHT TO LOWER LEFT ought be getting mapped to U+002F SOLIDUS > aka '/', but is instead being mapped to U+0025 PERCENT SIGN aka > '%'. Thanks. On Mon, Jul 20, 2020 at 05:48:15AM -0400, Nick Black wrote: > While I've got you here, while the case isn't quite as clear-cut > for these two, I'd suggest mapping > > U+2612 BALLOT BOX WITH X -> U+0058 LATIN CAPITAL LETTER X > > and > > U+2610 BALLOT BOX -> U+002D HYPHEN-MINUS or, if you prefer, > U+004F LATIN CAPITAL LETTER O What about these? . for U+2610 BALLOT BOX v for U+2611 BALLOT BOX WITH CHECK x for U+2612 BALLOT BOX WITH X Anton Zinoviev
Bug#965029: console-setup: fonts missing numerous unicode->font mappings for box-drawing characters
While I've got you here, while the case isn't quite as clear-cut for these two, I'd suggest mapping U+2612 BALLOT BOX WITH X -> U+0058 LATIN CAPITAL LETTER X and U+2610 BALLOT BOX -> U+002D HYPHEN-MINUS or, if you prefer, U+004F LATIN CAPITAL LETTER O Right now they render as the same missing glyph, which does nothing good for anybody =]. I add these two mappings on the fly in Notcurses for my multiselector widget. -- nick black -=- https://www.nick-black.com to make an apple pie from scratch, you need first invent a universe.
Bug#965029: console-setup: fonts missing numerous unicode->font mappings for box-drawing characters
Anton Zinoviev left as an exercise for the reader: I tested your Arabic-Fixed16 and Lat15-Terminus16, I'm pretty sure. First, I verified that the targeted UTF-8 was being rendered as the absent glyph, as expected. I then ran "setfont FONTFILE", and verified that the UTF-8 was properly being rendered as the base of its class. Except for one: the weird "big foreslash" is being mapped to a percent sign instead of a foreslash. Everything else looks correct, and seems a big improvement. -- nick black -=- https://www.nick-black.com to make an apple pie from scratch, you need first invent a universe.
Bug#965029: console-setup: fonts missing numerous unicode->font mappings for box-drawing characters
Nick Black left as an exercise for the reader: > I tested your Arabic-Fixed16 and Lat15-Terminus16, I'm pretty > sure. First, I verified that the targeted UTF-8 was being > rendered as the absent glyph, as expected. I then ran "setfont > FONTFILE", and verified that the UTF-8 was properly being > rendered as the base of its class. Except for one: the weird > "big foreslash" is being mapped to a percent sign instead of a > foreslash. Everything else looks correct, and seems a big > improvement. To be more precise, U+2571 BOX DRAWINGS LIGHT DIAGONAL UPPER RIGHT TO LOWER LEFT ought be getting mapped to U+002F SOLIDUS aka '/', but is instead being mapped to U+0025 PERCENT SIGN aka '%'. I believe you've mapped to font index 37 when you want font index 47. -- nick black -=- https://www.nick-black.com to make an apple pie from scratch, you need first invent a universe.
Bug#965029: console-setup: fonts missing numerous unicode->font mappings for box-drawing characters
On Tue, Jul 14, 2020 at 12:54:59PM -0400, Nick Black wrote: > > I'm happy to make these patches and send them upstream, but Anton Zinoviev > requested that I file a bug here. In this way the requiest is documented. More difficult to forget about it... > I consider the following wide strings to be acceptable fallback sets (taken > from Notcurses src/lib/linux.c): Thanks. > Let me know how I can make myself useful. If you can, please test the fonts I have attached. Anton Zinoviev Arabic-VGA16.psf Description: Binary data Arabic-Fixed16.psf Description: Binary data Lat15-Terminus16.psf Description: Binary data
Bug#965029: console-setup: fonts missing numerous unicode->font mappings for box-drawing characters
Package: console-setup Version: 1.196 Severity: wishlist Tags: upstream Dear Maintainer, While working on Notcurses (https://notcurses.com), I realized that numerous Unicode Box-Drawing Characters resolve to the missing glyph (U+FFFD), despite being well-simulated by glyphs present in the font. I suggest that these Unicode->font mappings be added to the various psf files. Notcurses currently adds them (if not already present) at application start time, and I can verify that it significantly improves the console experience. I'm happy to make these patches and send them upstream, but Anton Zinoviev requested that I file a bug here. I consider the following wide strings to be acceptable fallback sets (taken from Notcurses src/lib/linux.c): .ws = L"/╱", .ws = L"\\╲", .ws = L"X╳", .ws = L"└┕┖┗╘╙╚╰", .ws = L"┘┙┚┛╛╜╝╯", .ws = L"┌┍┎┏╒╓╔╭", .ws = L"┐┑┒┓╕╖╗╮", .ws = L"─━┄┅┈┉╌╍═╼╾", .ws = L"│┃┆┇┊┋╎╏║╽╿", .ws = L"├┝┞┟┠┡┢┣╞╟╠", .ws = L"┤┥┦┧┨┩┪┫╡╢╣", .ws = L"┬┭┮┯┰┱┲┳╤╥╦", .ws = L"┴┵┶┷┸┹┺┻╧╨╩", .ws = L"┼┽┾┿╀╁╂╃╄╅╆╇╈╉╊╋╪╫╬", Let me know how I can make myself useful. -- System Information: Debian Release: bullseye/sid APT prefers unstable APT policy: (300, 'unstable'), (1, 'experimental') Architecture: amd64 (x86_64) Kernel: Linux 5.7.8nlb (SMP w/64 CPU threads) Kernel taint flags: TAINT_PROPRIETARY_MODULE, TAINT_WARN, TAINT_OOT_MODULE, TAINT_UNSIGNED_MODULE Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE not set Shell: /bin/sh linked to /bin/dash Init: systemd (via /run/systemd/system) Versions of packages console-setup depends on: ii console-setup-linux 1.196 ii debconf 1.5.74 ii keyboard-configuration 1.196 ii xkb-data2.29-2 console-setup recommends no packages. Versions of packages console-setup suggests: ii locales 2.30-8 ii lsb-base 11.1.0 Versions of packages keyboard-configuration depends on: ii debconf 1.5.74 ii liblocale-gettext-perl 1.07-4 Versions of packages console-setup-linux depends on: ii init-system-helpers 1.58 ii kbd 2.0.4-4 ii keyboard-configuration 1.196 console-setup-linux suggests no packages. Versions of packages console-setup is related to: pn console-common pn console-data pn console-tools ii gnome-control-center 1:3.36.4-1 ii kbd 2.0.4-4 ii systemd 245.6-2 -- debconf information: console-setup/store_defaults_in_debconf_db: true * keyboard-configuration/other: console-setup/codesetcode: Arabic * keyboard-configuration/toggle: No toggling console-setup/guess_font: keyboard-configuration/unsupported_config_layout: true * keyboard-configuration/modelcode: pc105 console-setup/fontsize-text47: 8x16 * keyboard-configuration/store_defaults_in_debconf_db: true * keyboard-configuration/variant: English (US) * console-setup/codeset47: . Arabic keyboard-configuration/unsupported_layout: true * console-setup/fontface47: VGA * keyboard-configuration/ctrl_alt_bksp: true * keyboard-configuration/altgr: The default for the keyboard layout * console-setup/fontsize-fb47: 8x16 * keyboard-configuration/variantcode: keyboard-configuration/unsupported_config_options: true * keyboard-configuration/optionscode: terminate:ctrl_alt_bksp console-setup/use_system_font: * keyboard-configuration/compose: No compose key * console-setup/charmap47: UTF-8 * keyboard-configuration/layout: debian-installer/console-setup-udeb/title: console-setup/fontsize: 8x16 * keyboard-configuration/xkb-keymap: us console-setup/framebuffer_only: * keyboard-configuration/model: Generic 105-key PC (intl.) keyboard-configuration/unsupported_options: true * keyboard-configuration/switch: No temporary switch * keyboard-configuration/layoutcode: us