mix nasty.eval (Nasty v0.3.0)

View Source

Evaluates trained statistical models on test data.

Usage

mix nasty.eval --model priv/models/en/pcfg.model --test data/test.conllu --type pcfg
mix nasty.eval --model priv/models/en/ner_crf.model --test data/test.conllu --type crf --task ner

Options

  • --model - Path to trained model file (required)
  • --test - Path to test data in CoNLL-U format (required)
  • --type - Model type: pcfg, crf (required)
  • --task - Task type for CRF: ner, pos, chunking (default: ner)
  • --verbose - Show detailed per-example results (default: false)

Examples

# Evaluate PCFG
mix nasty.eval \
  --model priv/models/en/pcfg.model \
  --test data/en_ewt-ud-test.conllu \
  --type pcfg

# Evaluate CRF with verbose output
mix nasty.eval \
  --model priv/models/en/ner_crf.model \
  --test data/test.conllu \
  --type crf \
  --task ner \
  --verbose