Class
LatexTokenizer
OfficeIMO.Latex
Dependency-free TeX-aware tokenizer that never expands commands.
Inheritance
- object
- LatexTokenizer
Methods
public static IReadOnlyList<LatexToken> Tokenize(string source, LatexParseOptions? options = null, CancellationToken cancellationToken = default) #Tokenizes every input character exactly once.
Parameters
- source string
- options OfficeIMO.Latex.LatexParseOptions? = null
- cancellationToken System.Threading.CancellationToken = default
Returns
IReadOnlyList<LatexToken>