J. King
3698aa8d8d
Tweaks and cleanup
6 years ago
J. King
84d103269f
30% improvement in performance for multibyte characters
6 years ago
J. King
e755699dd7
Changed performance test data
6 years ago
J. King
3aaaae0c74
More performance improvements, and a regression fix
6 years ago
J. King
3cb49bbc77
Further performance improvements
6 years ago
J. King
6a97da7435
Reduced number of performace tests
6 years ago
J. King
cd68883d07
Add a performance profiling script
6 years ago
J. King
aa58f619d7
Optimize for ASCII characters in ord()
This yields a 60% performance improvement on a typical HTML document
6 years ago
J. King
434e41cc2c
Initial round of decoding tests, with one fix
6 years ago
J. King
b725fddc6c
Clean up Robofile
6 years ago
J. King
9062f4e6a6
Add infrstructure required for tests
6 years ago
J. King
aa0d6ce20e
Split off UTF-8 tools from URL parser
6 years ago
J. King
30162e8525
Correct deficiencies in UTF-8 handling
Function now operates as defined by the WHATWG encoding standard; the practical implications of this are that:
- More invalid sequences are correctly identified as invalid
- Overlong encodings are normalized
- ord() and chr() functions have been added as a consequence of this work
6 years ago
J. King
7d13a6c3b7
Four more states
6 years ago
J. King
80975d595e
Implement relative state; slight refactor
6 years ago
J. King
fd8c333a68
Split off UTF-8 processing into its own class, greately expanded
Also simplified some parts of the algorithm implementation
Part of this simplification involves the use of goto statements
6 years ago
J. King
42dfd0171f
Process UTF-8 characters rather than single bytes
6 years ago
J. King
23fd5872f6
Minor clarifications
6 years ago
J. King
9786d25aa5
Initial commit with a few states; not yet tested
6 years ago
J. King