Skip to main content

approx_tokens

av_core::tokens

Function approx_tokens 

Source 
pub fn approx_tokens(text: &str) -> u64
Expand description

Approximate token count for text.