Re: python text, Byte Addressability And Beyond

Lawrence D'Oliveiro <ldo@nz.invalid> writes:

On Mon, 27 May 2024 06:20:33 GMT, Anton Ertl wrote:

In UTF-32 a character is a sequence of code points.  In UTF-8 it is a
sequence of code units.

>
UTF-8 is a sequence of bytes encoding code points.

Yes, but it is even rarer that code points are needed than that
characters are needed.  Another, better way of stating this is:

In UTF-32 a character is a sequence of (32-bit) code units.
In UTF-8  a character is a sequence of  (8-bit) code units.

Given that the data is present in files in UTF-8 form, any conversion
to and from UTF-32 is just an unnecessary complication.

- anton
--
'Anyone trying for "industrial quality" ISA should avoid undefined behavior.'
  Mitch Alsup, <c17fcd89-f024-40e7-a594-88a85ac10d20o@googlegroups.com>