Skip to main content

tokens

Function tokens 

Source
fn tokens(chars: &[char]) -> Vec<Token>
Expand description

Maximal runs of letters, digits and hyphens.