1. Forum
  2. DOVE-Net
  3. Synchronet Programming

  • src/encode/utf8.c

    From Deucе@VERT to Git commit to main/sbbs/master on Thu Feb 10 16:12:52 2022
    https://gitlab.synchro.net/main/sbbs/-/commit/5ac964ab6818ebbc4f1295e2
    Modified Files:
    src/encode/utf8.c
    Log Message:
    Cleanup bad merge (WTF?)

    ---
    ￭ Synchronet ￭ Vertrauen ￭ Home of Synchronet ￭ [vert/cvs/bbs].synchro.net
  • From Rob Swindell (on Debian Linux)@VERT to Git commit to main/sbbs/master on Sat Feb 24 20:23:16 2024
    https://gitlab.synchro.net/main/sbbs/-/commit/6274d33bbfd6970264030322
    Modified Files:
    src/encode/utf8.c
    Log Message:
    Normalize fullwidth chars to 2-chars (ASCII char, followed by space)

    ---
    ■ Synchronet ■ Vertrauen ■ Home of Synchronet ■ [vert/cvs/bbs].synchro.net
  • From Deucе@VERT to Git commit to main/sbbs/master on Wed Jan 8 22:05:30 2025
    https://gitlab.synchro.net/main/sbbs/-/commit/b0533e269334f62d4fce5623
    Modified Files:
    src/encode/utf8.c
    Log Message:
    Suppress some more Coverity halucinations.

    ---
    ￭ Synchronet ￭ Vertrauen ￭ Home of Synchronet ￭ [vert/cvs/bbs].synchro.net
  • From Rob Swindell (on Debian Linux)@VERT to Git commit to main/sbbs/master on Wed Jul 29 23:14:42 2026
    https://gitlab.synchro.net/main/sbbs/-/commit/b1e66e262afaa7bc665a79b8
    Modified Files:
    src/encode/utf8.c
    Log Message:
    utf8: normalize EM DASH to a pair of ASCII hyphens

    utf8_normalize_str() folded U+2010 HYPHEN, U+2011 NON-BREAKING HYPHEN,
    U+2012 FIGURE DASH and U+2013 EN DASH to '-', but left U+2014 EM DASH
    alone. It fell through to unicode_to_cp437() instead and reached CP437 terminals as 0xC4, the box-drawing horizontal rule, which reads as a line rather than a dash in running prose - and is not ASCII at all for a
    US-ASCII terminal.

    Emit two hyphens, the conventional ASCII rendering of an em dash. The substitution consumes three bytes and writes two, so the in-place rewrite
    still never overtakes its source; HORIZONTAL ELLIPSIS, at three bytes to
    three characters, remains the tightest case in the function.

    U+2015 HORIZONTAL BAR is deliberately left alone: unicode_to_cp437()
    groups it with the box-drawing characters, for which CP437 0xC4 is an
    exact match rather than a fallback.

    Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

    ---
    ■ Synchronet ■ Vertrauen ■ Home of Synchronet ■ [vert/cvs/bbs].synchro.net
  • From Rob Swindell (on Debian Linux)@VERT to Git commit to main/sbbs/master on Wed Jul 29 23:14:42 2026
    https://gitlab.synchro.net/main/sbbs/-/commit/3b412fa2e195fe1e0a3a8cb1
    Modified Files:
    src/encode/utf8.c
    Log Message:
    utf8: make utf8_to_cp437_str() actually convert

    The function looked up every codepoint with unicode_to_cp437() and
    skipped any that returned zero. That function is a table of approximations
    for codepoints CP437 cannot represent directly, so it returns zero for all
    of U+0020 through U+007E - meaning every ASCII character was discarded and "Hello, world!" converted to an empty string. It also asked utf8_getc()
    for a character while passing the space remaining in the destination as
    the number of readable source bytes, and ignored 'minval' entirely.

    Convert the way print_utf8_as_cp437() does: pass ASCII straight through
    (CP437 and ASCII agree below 0x80), then prefer an exact match from cp437_unicode_tbl before falling back to the unicode_to_cp437()
    approximation, and emit an inverted question mark for what remains rather
    than dropping it. Codepoints below 'minval' are left untranslated, as in cp437_to_utf8_str(). utf8_getc() is now given the remaining source length.

    The function has had no callers since it was added, which is why none of
    this surfaced.

    Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

    ---
    ■ Synchronet ■ Vertrauen ■ Home of Synchronet ■ [vert/cvs/bbs].synchro.net