# LatexTokenizer

Dependency-free TeX-aware tokenizer that never expands commands.

Class 

`OfficeIMO.Latex`

**Namespace**

`OfficeIMO.Latex`

**Assembly**

`OfficeIMO.Latex`

**Source revision**

`ba882f6b0d07` with working tree changes

**Source**

[LatexTokenizer.cs:10](https://github.com/EvotecIT/OfficeIMO/blob/ba882f6b0d07acddd884b5e7d3086b0cfff0a05a/OfficeIMO.Latex/Parsing/LatexTokenizer.cs#L10)

**Modifiers**

static

Dependency-free TeX-aware tokenizer that never expands commands.

## Inheritance

- object
- LatexTokenizer

Filter members 

Show inherited

## Methods

`public static IReadOnlyList<LatexToken> Tokenize(string source, LatexParseOptions? options = null, CancellationToken cancellationToken = default)` [#](#method-tokenize-string-officeimo-latex-latexparseoptions-threading-cancellationtoken)

[LatexTokenizer.cs:10](https://github.com/EvotecIT/OfficeIMO/blob/ba882f6b0d07acddd884b5e7d3086b0cfff0a05a/OfficeIMO.Latex/Parsing/LatexTokenizer.cs#L10)

Tokenizes every input character exactly once.

Parameters

**source string required**

**options OfficeIMO.Latex.LatexParseOptions? = null optional**

**cancellationToken System.Threading.CancellationToken = default optional**

Returns

`IReadOnlyList<LatexToken>`

## Inherited Methods

`public virtual bool Equals(object? obj)` [#](#method-equals-object)

Inherited from object

Parameters

**obj object? required**

Returns

`bool`

`public virtual int GetHashCode()` [#](#method-gethashcode)

Inherited from object

Returns

`int`

`public Type GetType()` [#](#method-gettype)

Inherited from object

Returns

`Type`

`public virtual string? ToString()` [#](#method-tostring)

Inherited from object

Returns

`string?`

<!-- PowerForge markdown artifact sha256:FC88724F9FC2161D4EB0196297E136F190E561E50A4F8828150B83D7F786D92F -->
