J. King
07d26e3f45
Add BOM handling
Per specification this does not extend to GB18030
3 years ago
J. King
d9d92e5e77
Test all spanning other than ISO-2022-JP
ISO-2022-JP will require a more careful implementation to deal with
mode changes to ASCII or Roman mode
3 years ago
J. King
81186973f1
Partial tests for ASCII spanning
3 years ago
J. King
bf81571ce4
Prototype strspn equivalent
3 years ago
J. King
0eb2a8ac24
Fix bugs in gb18030 and UTF-16
- UTF-16 needs to restore dirtyEOF after seeking
- gb18030 now tracks errors like other non-synchronizing encodings
- gb18030 could produce null when asked for a character
4 years ago
J. King
be034a08e0
Move dirty EOF handling to UTF-16
It remains useful for this encoding, which is other self-synchronizing
4 years ago
J. King
61a77086bb
Make GenericEncoding trait an abstract class
4 years ago
J. King
235fdc4103
Note self-synchronizing encodings for later
4 years ago
J. King
f69cd98b4c
Make posErr fully generic
4 years ago
J. King
7339176e3e
Split error handlers
4 years ago
J. King
6d9eba25d3
Fix bugs in gb18030 and UTF-16
- UTF-16 needs to restore dirtyEOF after seeking
- gb18030 now tracks errors like other non-synchronizing encodings
- gb18030 could produce null when asked for a character
4 years ago
J. King
b4c3f3c86d
Move dirty EOF handling to UTF-16
It remains useful for this encoding, which is other self-synchronizing
4 years ago
J. King
9421a3aca2
Make GenericEncoding trait an abstract class
4 years ago
J. King
7ec8f148ff
Note self-synchronizing encodings for later
4 years ago
J. King
87e34b3074
Make posErr fully generic
4 years ago
J. King
c115e3857a
Split error handlers
4 years ago
J. King
fc44bb1415
Generalize handling of dirty EOF
4 years ago
J. King
200a310f72
Optionally allow surrogates
Also removed unnecessary docblocks
4 years ago
J. King
dd9bed2e84
Implement UTF-16
6 years ago
J. King