Fills the 'tokens' variable with word tokens.

jl_tokenize_words(x, ...)

Arguments

x

a tibble

...

extra arguments to tokenizers::tokenize_*

Value

a tibble