Struct SentenceDetector

pub struct SentenceDetector { /* private fields */ }

A sentence boundary detector

Implementations

impl SentenceDetector

pub fn new() -> Self

pub fn with_limit(limit: usize) -> Self

pub fn get_eos( &self, input: &str, checker: Option<&NonBreakChecker<'_>>, ) -> SudachiResult<isize>

Returns the byte index of the detected end of the sentence.

If NonBreakChecker is given, it is used to determine if there is a word that crosses the detected boundary, and if so, the next boundary is returned.

If there is no boundary, this returns a relatively harmles boundary as a negative value.

Examples

let sd = sudachi::sentence_detector::SentenceDetector::new();
assert_eq!(12, sd.get_eos("あいう。えお", None).unwrap());
assert_eq!(-15, sd.get_eos("あいうえお", None).unwrap());

Trait Implementations

impl Default for SentenceDetector

fn default() -> Self

Returns the “default value” for a type.