pub struct LexicalCoarseScorer<'a> { /* private fields */ }Expand description
トークナイザーのサブワード語彙を活用した外部モデル不要の語彙スコアラー。
State + Instructions と各候補説明文の語彙重複度・頻度重み付けにより 高速かつアロケーションフリーにスクリーニングを行う。
Implementations§
Source§impl<'a> LexicalCoarseScorer<'a>
impl<'a> LexicalCoarseScorer<'a>
Sourcepub fn new(tokenizer: &'a JevTokenizer) -> Self
pub fn new(tokenizer: &'a JevTokenizer) -> Self
トークナイザー参照から語彙スコアラーを生成する。
Trait Implementations§
Source§impl<'a> Clone for LexicalCoarseScorer<'a>
impl<'a> Clone for LexicalCoarseScorer<'a>
Source§fn clone(&self) -> LexicalCoarseScorer<'a>
fn clone(&self) -> LexicalCoarseScorer<'a>
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl CoarseScorer for LexicalCoarseScorer<'_>
impl CoarseScorer for LexicalCoarseScorer<'_>
Auto Trait Implementations§
impl<'a> Freeze for LexicalCoarseScorer<'a>
impl<'a> RefUnwindSafe for LexicalCoarseScorer<'a>
impl<'a> Send for LexicalCoarseScorer<'a>
impl<'a> Sync for LexicalCoarseScorer<'a>
impl<'a> Unpin for LexicalCoarseScorer<'a>
impl<'a> UnsafeUnpin for LexicalCoarseScorer<'a>
impl<'a> UnwindSafe for LexicalCoarseScorer<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more