J. King
2f3ad29ce6
Prototype ISO 2022-JP decoder
4 years ago
J. King
96846d061c
Complete Shift_JIS testing
4 years ago
J. King
915aa7ca93
Finally fix Shift_JIS seeker
4 years ago
J. King
4b2a396c64
Prototype for replacement encoding
4 years ago
J. King
ef9932ffcb
Correct various ShiftJIS errors
4 years ago
J. King
d9b8cd8dd1
Fixes for multi-byte index-base encoders
- array_flip() retains the last duplicate, when we need the first
- Indexes are now prepared with a list of first-duplicate code points
to search before flipping
- This affected only U+3000 in GBK
- Big5 did not use array_flip(), but its list of override code points
did not include U+2561; Big5 now flips like the others
- EUC-JP had a long list of errors, but this encoding was not
previously released
- Shift_JIS' indexes are probably not correct, still
4 years ago
J. King
9e812ffdf8
Second stab at Shift_JIS
- Decoder implemented, with correct table
- Modernized decoder; may have bugs
- Backwards seeker hopefully, though it does not yet pass fuzzer
4 years ago
J. King
b284056644
Encode correct duplicate pointers in EUC-JP
4 years ago
J. King
46b6ac3c44
Complete and correct EUC-JP implementation
4 years ago
J. King
0682e294c8
Add new labels
4 years ago
J. King
f7246ccc34
Fix gb18030 seeking; tidy up
4 years ago
J. King
0eb2a8ac24
Fix bugs in gb18030 and UTF-16
- UTF-16 needs to restore dirtyEOF after seeking
- gb18030 now tracks errors like other non-synchronizing encodings
- gb18030 could produce null when asked for a character
4 years ago
J. King
a12a2a0413
Simplify EUC-KR seeking
This is in line with Big5 logic
4 years ago
J. King
be034a08e0
Move dirty EOF handling to UTF-16
It remains useful for this encoding, which is other self-synchronizing
4 years ago
J. King
1f007b88f1
Fix UTF-8 seeking through truncated sequences
4 years ago
J. King
220cbce9a0
Address performance regression in peeking
4 years ago
J. King
9f08fb7424
Fix backwards seeking for Big5
Other non-synchronizing encodings will also need fixing
4 years ago
J. King
6417e8f0be
Start overhauling error handling; adjust coverage annotations
4 years ago
J. King
e06096c624
Ensure seekBack is defined
4 years ago
J. King
61a77086bb
Make GenericEncoding trait an abstract class
4 years ago
J. King
235fdc4103
Note self-synchronizing encodings for later
4 years ago
J. King
a3c16252b8
Correct documentation of StatefulEncoding
4 years ago
J. King
f69cd98b4c
Make posErr fully generic
4 years ago
J. King
7339176e3e
Split error handlers
4 years ago
J. King
befd1feb3a
Apply stricter house style where possible
4 years ago
J. King
85f06186f2
Partial Shift_JIS implementation
4 years ago
J. King
fc44bb1415
Generalize handling of dirty EOF
4 years ago
J. King
200a310f72
Optionally allow surrogates
Also removed unnecessary docblocks
4 years ago
J. King
eae901a9e2
Add new methods
4 years ago
J. King
106167ab39
Cleanup
6 years ago
J. King
8dfb1ba984
Initial implementation of EUC-JP
6 years ago
J. King
2810ed9b2a
Full tests for EUC-KR
6 years ago
J. King
fb70543c0f
Change gb18030 loop to be consistent with Big5 and EUC-KR
6 years ago
J. King
c4cdbdd5c8
Initial implementation of EUC-KR
6 years ago
J. King
bfc6c677c5
Complete Big5 tests, with numerous fixes
6 years ago
J. King
4a091610e9
Initial implementation of Big5 encoding
Only the decoder is tested, and even that requires more thorough testing.
Testing of seeking and encoding still to come
6 years ago
J. King
fdbeecdb17
Add name and label to x-user-defined
6 years ago
J. King
d5327a3b83
Implement x-user-defined decoder
Also further refactored tests to better account for one-way encodings
6 years ago
J. King
dd9bed2e84
Implement UTF-16
6 years ago
J. King
a0bf8a9b05
Don't check for dirty EOF on every iteration
6 years ago
J. King
e683167905
Style fixes
Because of the large arrays in the GBCommon class and its test suite,
memory limits had to be disabled in php-cs-fixer
6 years ago
J. King
1449fae908
Refactor UTF-8 seeking
6 years ago
J. King
4c686aa8a1
Complete battery of tests for gb18030
6 years ago
J. King
1b9889914a
Fix numerous bugs with gb18030
6 years ago
J. King
467c565e8c
Implement gb18030 seeking
Also fix some bugs in EOF handling
6 years ago
J. King
40d0054bd1
Implement gb18030 and GBK encoders
6 years ago
J. King
766643aa37
Common infrstructure for gb18030 and GBK
6 years ago
J. King
d6747532cd
Implement gb18030 decoder
6 years ago
J. King
3a19b93aab
Move nextChar to generic class
6 years ago
J. King
3ee653307c
Implement all other single-byte encodings
6 years ago
