See https://github.com/whatwg/html/pull/8271
Also removed test patches which are no longer needed, and fixed a bug
exposed by new tests
The testsuite includes tests for the new <search> element, but this is
not included in the specification yet, so the tests have been suppressed
This uncovered three bugs:
- Unconsuming at EOF with error reporting off yielded incorrect tokens
- Mangled end tags in foreign content were not being matched correctly
- Broken characters produced a fatal error with error reporting on
- Various new tests needed for full coverage, noted in comment
- Byte Order Mark detection methopd added
- Japanese encodings nt yet supported, so tests marked incomplete
- Tests requiring scripting suppressed
- End tags now emit errors if they have attributes
- End tags now emit errors if they are self-closing
- The last character before EOF is now correctly reconsumed
Also changed the tokenizer debug log to be zero-cost
Everything which can emit a parse error should have the error handler
and data stream as properties and use the ParseErrorEmitter trait to
avoid complicating the task of actually producing an error.
Normally the Parser would be expected to set the error handler before it
begins (this commit does not do this) and unset it after it's done.
Alternatively, the entire means of reporting errors can now be easily
replaced.
