essence v0.1.1 Essence.Token

This module contains helpful functions around Tokens

Summary

Calculates the average word length over the given list of tokens

Count the number of syllabels in a token

Determines whether a given token is a polysyllabic or not

Calculates the length of a token as the number of graphemes in that token

avg_word_length(tokens)

Calculates the average word length over the given list of tokens.

count_syllabels(token)

Count the number of syllabels in a token.

is_polysyllabic?(token)

Determines whether a given token is a polysyllabic or not.

token_length(token)

Calculates the length of a token as the number of graphemes in that token.