Nous.Eval.SuiteResult (nous v0.9.0)

View Source

Result of running an entire test suite.

Summary

Types

t()

Functions

errors(suite_result)

Get error test cases (tests that failed to run).

failed(suite_result)

Get failed test cases.

from_results(suite_name, results, started_at, completed_at)

Create a suite result from individual test results.

passed(suite_result)

Get passed test cases.

Types

t()

@type t() :: %Nous.Eval.SuiteResult{
  aggregate_score: float(),
  completed_at: DateTime.t(),
  duration_ms: non_neg_integer(),
  error_count: non_neg_integer(),
  fail_count: non_neg_integer(),
  metrics_summary: Nous.Eval.Metrics.Summary.t() | nil,
  pass_count: non_neg_integer(),
  pass_rate: float(),
  results: [Nous.Eval.Result.t()],
  started_at: DateTime.t(),
  suite_name: String.t(),
  total_count: non_neg_integer()
}

Functions

errors(suite_result)

@spec errors(t()) :: [Nous.Eval.Result.t()]

Get error test cases (tests that failed to run).

failed(suite_result)

@spec failed(t()) :: [Nous.Eval.Result.t()]

Get failed test cases.

from_results(suite_name, results, started_at, completed_at)

@spec from_results(String.t(), [Nous.Eval.Result.t()], DateTime.t(), DateTime.t()) ::
  t()

Create a suite result from individual test results.

passed(suite_result)

@spec passed(t()) :: [Nous.Eval.Result.t()]

Get passed test cases.