Skip to content

Commit

Permalink
Update keyword-tokenizers.md
Browse files Browse the repository at this point in the history
Signed-off-by: leanneeliatra <[email protected]>
  • Loading branch information
leanneeliatra authored Oct 9, 2024
1 parent 548e607 commit c04c58d
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions _analyzers/tokenizers/keyword-tokenizers.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ The keyword tokenizer is a straightforward tokenizer that takes in text and outp
The keyword tokenizer can be paired with token filters to modify or clean up the text, such as normalizing the data or removing unnecessary characters.

## Example

By analyzing the text "OpenSearch Example", we can see the text is preserved:

```
Expand Down

0 comments on commit c04c58d

Please sign in to comment.