J. King
aa58f619d7
Optimize for ASCII characters in ord()
This yields a 60% performance improvement on a typical HTML document
6 years ago
J. King
434e41cc2c
Initial round of decoding tests, with one fix
6 years ago
J. King
b725fddc6c
Clean up Robofile
6 years ago
J. King
9062f4e6a6
Add infrstructure required for tests
6 years ago
J. King
aa0d6ce20e
Split off UTF-8 tools from URL parser
6 years ago
J. King
30162e8525
Correct deficiencies in UTF-8 handling
Function now operates as defined by the WHATWG encoding standard; the practical implications of this are that:
- More invalid sequences are correctly identified as invalid
- Overlong encodings are normalized
- ord() and chr() functions have been added as a consequence of this work
6 years ago
J. King
7d13a6c3b7
Four more states
6 years ago
J. King
80975d595e
Implement relative state; slight refactor
6 years ago
J. King
fd8c333a68
Split off UTF-8 processing into its own class, greately expanded
Also simplified some parts of the algorithm implementation
Part of this simplification involves the use of goto statements
6 years ago
J. King
42dfd0171f
Process UTF-8 characters rather than single bytes
6 years ago
J. King
23fd5872f6
Minor clarifications
6 years ago
J. King
9786d25aa5
Initial commit with a few states; not yet tested
6 years ago
J. King