Struct Grammar

pub struct Grammar<'a> {
    pub pos_list: Vec<Vec<String>>,
    pub storage_size: usize,
    pub character_category: CharacterCategory,
    /* private fields */
}

Dictionary grammar

Contains part_of_speech list and connection cost map. It also holds character category.

Fields

pos_list: Vec<Vec<String>>

storage_size: usize

character_category: CharacterCategory

The mapping from character to character_category_type

Implementations

impl<'a> Grammar<'a>

pub const INHIBITED_CONNECTION: i16 = 32_767i16

pub const BOS_PARAMETER: (i16, i16, i16) = _

pub const EOS_PARAMETER: (i16, i16, i16) = _

pub fn parse(buf: &[u8], offset: usize) -> SudachiResult<Grammar<'_>>

Creates a Grammar from dictionary bytes

buf: reference to the dictionary bytes offset: offset to the grammar section in the buf

pub fn connect_cost(&self, left_id: i16, right_id: i16) -> i16

Returns connection cost of nodes

left_id: right_id of left node right_id: left_if of right node

pub fn conn_matrix(&self) -> &ConnectionMatrix<'_>

pub fn set_character_category(&mut self, character_category: CharacterCategory)

Sets character category

This is the only way to set character category. Character category will be a empty map by default.

pub fn set_connect_cost(&mut self, left_id: i16, right_id: i16, cost: i16)

Sets connect cost for a specific pair of ids

left_id: right_id of left node right_id: left_if of right node

pub fn get_part_of_speech_id<S>(&self, pos1: &[S]) -> Option<u16>

where S: AsRef<str>,

Returns a pos_id of given pos in the grammar

pub fn register_pos<S>(&mut self, pos: &[S]) -> SudachiResult<u16>

where S: AsRef<str> + ToString,

pub fn pos_components(&self, pos_id: u16) -> &[String]

Gets POS components for POS ID. Panics if out of bounds.

pub fn merge(&mut self, other: Grammar<'_>)

Merge a another grammar into this grammar

Only pos_list is merged