Re: Unicode in strings

On 6/3/2024 3:06 AM, Lawrence D'Oliveiro wrote:

On Fri, 31 May 2024 12:14:19 -0500, BGB wrote:
 

Though, one thing that makes sense for text editors is if only the
"currently being edited" lines are fully unpacked, whereas the others
can remain in a more compact form (such as UTF-8), and are then unpacked
as they come into view (say, treating the editor window as a 32-entry
modulo cache or similar).

 That may make sense if you are implementing a *text* editor, like the vi/
vim family. Remember that Emacs is usable for editing things other than
text.

I was mostly imagining a Notepad style editor, but either way.
But, yeah, otherwise I was thinking one doesn't want to use a fully unpacked representation because this would waste excessive memory for larger text files. But, even then, there are practical limits as one still needs to be able to read the whole text file into memory, meaning one can't realistically deal with files too big to be loaded into RAM.
Though, in most contexts, one isn't going to be opening large files in a text-editor (though, this may still happen sometimes).
In general, I consider things with hypertext features / etc to be in a different category.
But, one may still deal with fonts or style/color for things like syntax highlighting (but, these are not generally stored in the text itself, but inferred at run-time from various rules).
...