ReaderHeuristicTokenCounter

Namespace OfficeIMO.Reader

Assembly OfficeIMO.Reader.Core

Implements

IReaderTokenCounter

Modifiers sealed

Dependency-free token estimate using approximately four characters per token.

Inheritance

This type appears in these public API surfaces even when no hand-authored example is attached directly to the page.

public Int32 CountTokens(String text) #

Returns: Int32

Counts tokens in the supplied text.

public static ReaderHeuristicTokenCounter Instance { get; } #

Shared stateless instance.

public String Id { get; } #

Stable counter identifier retained in chunking evidence.