Class
OfficeTextAnalyzer
OfficeIMO.TextAnalysis
Splits text into UAX #29 word tokens and normalizes them into index terms: Unicode normalization, case folding and optional accent folding. Punctuation, whitespace, symbols and emoji are not tokens.
Inheritance
- object
- OfficeTextAnalyzer
Usage
Explore 1 API references to this type
This type appears in these public API surfaces even when no hand-authored example is attached directly to the page.
Returned or exposed by 1
- Property OfficeTextIndex.Analyzer
Constructors
public OfficeTextAnalyzer(OfficeTextAnalyzerOptions? options = null) #Creates an analyser. The options are copied.
Parameters
- options OfficeIMO.TextAnalysis.OfficeTextAnalyzerOptions? = null
Methods
public IReadOnlyList<OfficeTextToken> Analyze(string text) #Returns the tokens of text in source order.
Parameters
- text string
Returns
IReadOnlyList<OfficeTextToken>public string NormalizeTerm(string word) #Applies normalization and folding to one word without segmenting it. Used for prefixes, which may end inside a word.
Parameters
- word string
Returns
string