Dustin Wilson
5027113596
Started injections, broken lol
3 years ago
Dustin Wilson
2f7f14dea1
Scope names now resolve, starting on first line and last line anchors
3 years ago
Dustin Wilson
63a5fb7367
One full line tokenizes lol
3 years ago
Dustin Wilson
ad23bf4c4d
Tokenization progress
3 years ago
Dustin Wilson
4ed8ffcd26
Reverting to using UTF-8 and preg_match. mb_ereg is garbage
3 years ago
Dustin Wilson
5a3322a0cb
Many changes
• Lines are now converted to UTF-32 while tokenizing so that byte
offsets may be cleanly converted to character offsets
• Now when grammars are parsed into Grammar objects begin and end
matches are converted to regular matches by adding end matches to the
pattern's pattern list to simplify tokenization.
• Highlight::withFile and Highlight::withString now accept an encoding
parameter which defaults to UTF-8.
3 years ago
Dustin Wilson
7717827259
Breaking Tokenizer
3 years ago
Dustin Wilson
bb4b90a7b0
Setting up Tokenizer for recursion
3 years ago
Dustin Wilson
a12ec9dbfc
Fixes to references in grammars, adoption of new owner grammars
3 years ago
Dustin Wilson
53151a674c
Break all the things!
3 years ago
Dustin Wilson
1763653eca
Tokenizing stuff... maybe? :)
3 years ago
Dustin Wilson
457cf39a56
Move Grammar\Registry to GrammarRegistry
3 years ago
Dustin Wilson
33e411ec63
Trying to start code tokenization
3 years ago
Dustin Wilson
f592d93e23
Added prefix retrieval
3 years ago
Dustin Wilson
379d9c791d
Maybe have scope selector matchers working
3 years ago
Dustin Wilson
7a3d0e5d2e
Starting to add matchers
3 years ago
Dustin Wilson
6a9fd79f11
Scope parsing fixes
3 years ago
Dustin Wilson
a4707060c0
Fixing bugs in scope serialization
3 years ago
Dustin Wilson
4147a207d4
Started adding serialization for scopes
3 years ago
Dustin Wilson
8d6c51a2d0
Use assertions for debugging scope parsing
3 years ago
Dustin Wilson
7e918f48be
Starting rewriting scope parsing
3 years ago
Dustin Wilson
cdc53456e0
Added cache for scope parsing
3 years ago
Dustin Wilson
d83916a57e
Includes now work like lazy WeakReferences except self
3 years ago
Dustin Wilson
dcb00c001f
Changed Pattern to Rule to be consistent with other implementations
3 years ago
Dustin Wilson
d6b55c8678
Grammar registry now automatically pulls from JSON pool
3 years ago
Dustin Wilson
e5869f8a8e
Reorganized data folder
3 years ago
Dustin Wilson
676971850e
Minor cleanup
3 years ago
Dustin Wilson
0a7b0e4f28
Cleaned up JSON capture list reading
3 years ago
Dustin Wilson
2be674cd2a
Added some comments to grammars and cleaned up exceptions
3 years ago
Dustin Wilson
900e462bcd
Wrote JSON to Grammar converter, successfully parses all grammars tested
3 years ago
Dustin Wilson
e2cc9adbd8
Working on Grammars
3 years ago
Dustin Wilson
5ae2d256d3
Cleaning up a bit
3 years ago
Dustin Wilson
e27408c662
Improvements to run command, starting on Grammar
3 years ago
Dustin Wilson
d179ad81b9
Changed structure of built-in languages
3 years ago
Dustin Wilson
785c03b1f8
Trying to figure out structure
3 years ago
Dustin Wilson
5edc6d32b3
Changed project name to Lit lol
3 years ago
Dustin Wilson
3cabeb519d
Add file extension to README
3 years ago
Dustin Wilson
e2dcac2bf4
Changed Project name to Fukkus
3 years ago
Dustin Wilson
b039ced5f9
Added documentation to Scope/Data and Scope/Parser
3 years ago
Dustin Wilson
080dfaa36e
Removed errant json file
3 years ago
Dustin Wilson
f6b9cd24e0
Fixing composite scope matching
3 years ago
Dustin Wilson
a073df1c5d
Cleaning up
3 years ago
Dustin Wilson
aaa1e70c75
Removed Scope\ParseError
3 years ago
Dustin Wilson
93ea83aedd
Removed Segment and True scope matchers, reverted to throwing exceptions
3 years ago
Dustin Wilson
b7d700416d
Changed to using an error handler for the scope parser
3 years ago
Dustin Wilson
5d64330e96
Changed scope exceptions to match new parser's behavior
3 years ago
Dustin Wilson
3e939feadf
Scope parsing improvements
3 years ago
Dustin Wilson
6badf94277
Getting further with parsing
3 years ago
Dustin Wilson
ce318968d6
More parsing experimentation
3 years ago
Dustin Wilson
010c0ddca5
Playing around with parsing using VSCode-style tokenization
3 years ago
