essence v0.1.0 Essence.Vocabulary

This module exports helpful methods around Vocabularies.

Summary

The freq_dist method calculates the frequency distribution of tokens in the given text

The lexical_richness method computes the lexical richness of a given text

The vocabulary method computes the vocabulary of a given Essence.Document. The vocabulary is the unique set of dictionary words in that text

freq_dist(tokens)

The freq_dist method calculates the frequency distribution of tokens in the given text.

lexical_richness(text)

The lexical_richness method computes the lexical richness of a given text.

vocabulary(frequency_distribution)

vocabulary(Essence.Document.t) :: List.t

The vocabulary method computes the vocabulary of a given Essence.Document. The vocabulary is the unique set of dictionary words in that text.