Standard Compression Scheme for Unicode: Difference between revisions

Revision as of 15:22, 11 December 2021

Revision as of 22:09, 13 March 2022

Line 25:

== Comparison with general-purpose plain text compression schemes ==

Because UTF-16 or UTF-8 text might occupy more space than its equivalent in pre-Unicode encodings did, one might want to use compression such as SCSU to mitigate this problem.<ref>https://unicode.org/versions/Unicode3.0.0/ch05.pdf {{Bare URL PDF|date=March 2022}}</ref> In comparison with general-purpose compressors, it is not necessarily advantageous to use SCSU.<ref name=Ewellic/> Also, while it can be used as a text encoding, because of the stateful nature of the algorithm difficulties may arise when using it as an internal text representation since basic text operations become non-trivial.

Treated purely as a compression algorithm, SCSU is inferior to most commonly used general-purpose algorithms for texts of over a few kilobytes.