Draft: Move inline tokens to external scanner and split the grammar into two pieces

.gitignore

@@ -9,3 +9,4 @@ build
 /target/
 log.html
 *.dj
+broken.txt

README.md

@@ -1,45 +1,12 @@
 # tree-sitter-djot
 
-This is an experimental [Tree-sitter][] grammar for [Djot][].
-
-# Features
-
-Aims to be fully feature complete with the [Djot specification][]:
-
-- [x] Inline syntax
-    - [x] Links
-    - [x] Image
-    - [x] Autolink
-    - [x] Verbatim
-    - [x] Emphasis/strong
-    - [x] Highlighted
-    - [x] Super/subscript
-    - [x] Insert/delete
-    - [x] Smart punctuation
-    - [x] Math
-    - [x] Footnote reference
-    - [x] Line break
-    - [x] Comment
-    - [x] Symbols
-    - [x] Raw inline
-    - [x] Span
-    - [x] Inline attributes
-- [x] Block syntax
-    - [x] Paragraph
-    - [x] Heading
-    - [x] Block quote
-    - [x] List item with the different marker types
-    - [x] List
-    - [x] Code block
-    - [x] Thematic break
-    - [x] Raw block
-    - [x] Div
-    - [x] Pipe table
-    - [x] Reference link definition
-    - [x] Footnote
-    - [x] Block attribute
-
-Also contains some extra features not included in the Djot standard:
+A [Djot][] parser for [tree-sitter][].
+
+## Features
+
+Aims to be feature complete with the [Djot specification][].
+
+The parser contains some features outside the [Djot][] standard:
 
 - Parses an optional frontmatter at the very start of the file, e.g:
 
@@ -51,6 +18,20 @@ Also contains some extra features not included in the Djot standard:
 
 - Highlights standalone `TODO`, `NOTE` and `FIXME`.
 
-[Tree-sitter]: https://tree-sitter.github.io/tree-sitter/
+## Split parser
+
+The parser is split into two grammars that you'll need to install/include:
+
+1. `djot` that parses the block syntax on the top level.
+2. `djot_inline` that parses all inline contexts and should be injected into the `inline` nodes from the block level parser.
+
+> [!note]
+> `split` is the main branch of this repository and the `master` branch with the old combined parser won't be maintained.
+
+> [!warning]
+> The generated language bindings for the split parsers haven't been thoroughly tested.
+> If you find a problem please file an issue.
+
+[tree-sitter]: https://tree-sitter.github.io/tree-sitter/
 [Djot]: https://djot.net/
 [Djot specification]: https://htmlpreview.github.io/?https://github.com/jgm/djot/blob/master/doc/syntax.html