Commit graph

80 commits

Author SHA1 Message Date
81186973f1 Partial tests for ASCII spanning 2021-03-24 08:59:59 -04:00
c64a43992b Prototype span test 2021-03-23 19:03:16 -04:00
87ec30a375 Explicit constant visibility
Also partially revert change to encoder determination
2020-10-24 22:53:12 -04:00
c234702cce Speed up encoding; make ISO 2022-JP more consistent
- The ISO 2022-JP encoder is now static as with all others; this is
slightly slower, but localises the encoder logic to its class
- Indexed encoders now cache pointer tables on first use, yielding
significant performance benefits
- Encoding multiple characters now uses fewer function calls, yielding
moderate performance benefits at the expense of slight complication
2020-10-19 23:12:45 -04:00
be2134cc71 API re-organization 2020-10-18 15:32:49 -04:00
808b4128dd Tests for replacement encoding; readme correction 2020-10-17 13:52:32 -04:00
ffa3f431d6 Coverage fixes 2020-10-16 20:35:27 -04:00
d580e93e52 ISO 2022-JP encoder tests and fixes 2020-10-16 20:13:53 -04:00
10328b6806 Tests for general encoder 2020-10-15 16:19:57 -04:00
db738bba99 Encoder for x-user-defined 2020-10-15 12:34:03 -04:00
a57dde6dbd Style fixes 2020-10-15 10:39:44 -04:00
cdd1c0182b Corrected ISO 2022-JP decoder and seeker 2020-10-14 12:29:19 -04:00
86c2b0d628 Fix coverage 2020-10-11 18:36:49 -04:00
53b27d1a55 Correct buggy Shift_JIS tests 2020-10-09 09:47:28 -04:00
96846d061c Complete Shift_JIS testing 2020-10-08 19:22:32 -04:00
d45e0be7c3 Typo 2020-10-08 17:18:48 -04:00
915aa7ca93 Finally fix Shift_JIS seeker 2020-10-07 22:48:50 -04:00
d9b8cd8dd1 Fixes for multi-byte index-base encoders
- array_flip() retains the last duplicate, when we need the first
- Indexes are now prepared with a list of first-duplicate code points
to search before flipping
- This affected only U+3000 in GBK
- Big5 did not use array_flip(), but its list of override code points
did not include U+2561; Big5 now flips like the others
- EUC-JP had a long list of errors, but this encoding was not
previously released
- Shift_JIS' indexes are probably not correct, still
2020-10-07 11:28:21 -04:00
9e812ffdf8 Second stab at Shift_JIS
- Decoder implemented, with correct table
- Modernized decoder; may have bugs
- Backwards seeker hopefully, though it does not yet pass fuzzer
2020-10-06 16:12:57 -04:00
b284056644 Encode correct duplicate pointers in EUC-JP 2020-10-06 15:39:33 -04:00
46b6ac3c44 Complete and correct EUC-JP implementation 2020-10-06 11:47:22 -04:00
f7246ccc34 Fix gb18030 seeking; tidy up 2020-10-06 11:42:32 -04:00
14d67ad49f Add fuzz test for backwards seeking
Test data is 1025 random bytes; gb18030 still fails
2020-10-06 11:42:32 -04:00
6417e8f0be Start overhauling error handling; adjust coverage annotations 2020-10-06 11:42:32 -04:00
befd1feb3a Apply stricter house style where possible 2020-10-06 11:42:30 -04:00
85f06186f2 Partial Shift_JIS implementation 2020-01-07 11:43:45 -05:00
f49d632642 Merge branch 'master' into multi-byte 2019-12-28 23:31:10 -05:00
c4a2ae1714 Tests for new features 2019-12-20 20:56:59 -05:00
200a310f72 Optionally allow surrogates
Also removed unnecessary docblocks
2019-12-18 14:57:54 -05:00
2e47fde774 Upgrade to PHPUnit 8 2019-12-13 11:05:01 -05:00
eae901a9e2 Add new methods 2019-12-13 11:00:25 -05:00
74d8e07a65 Fully corrected WPT test data for EUC-JP 2018-09-18 09:08:51 -04:00
8dfb1ba984 Initial implementation of EUC-JP 2018-09-17 19:33:46 -04:00
2810ed9b2a Full tests for EUC-KR 2018-09-15 19:46:42 -04:00
1121f32e96 Minor Big5 corrections 2018-09-15 13:53:21 -04:00
c4cdbdd5c8 Initial implementation of EUC-KR 2018-09-15 13:30:30 -04:00
c2a8b1ba52 Style fixes 2018-09-15 11:39:48 -04:00
bfc6c677c5 Complete Big5 tests, with numerous fixes 2018-09-15 11:38:51 -04:00
5217a6c0bc Tidying 2018-09-15 09:10:36 -04:00
32d7fc47b0 Fix HTML test generator; clean up 2018-09-05 11:44:54 -04:00
55cbc915c3 Refactor HTML-based test generators 2018-09-05 09:46:11 -04:00
63fccc3c3a Test UTF-16 EOF handling better 2018-09-04 09:41:05 -04:00
4a091610e9 Initial implementation of Big5 encoding
Only the decoder is tested, and even that requires more thorough testing.

Testing of seeking and encoding still to come
2018-08-30 23:27:29 -04:00
d5327a3b83 Implement x-user-defined decoder
Also further refactored tests to better account for one-way encodings
2018-08-30 12:26:50 -04:00
dd9bed2e84 Implement UTF-16 2018-08-30 11:06:15 -04:00
e683167905 Style fixes
Because of the large arrays in the GBCommon class and its test suite,
memory limits had to be disabled in php-cs-fixer
2018-08-29 23:47:42 -04:00
1449fae908 Refactor UTF-8 seeking 2018-08-29 23:39:56 -04:00
e4b6acb24a Refactor tests 2018-08-29 23:32:36 -04:00
4c686aa8a1 Complete battery of tests for gb18030 2018-08-29 17:16:16 -04:00
1b9889914a Fix numerous bugs with gb18030 2018-08-29 15:58:53 -04:00