Feline.Services.OpenAI.StreamingLLM (feline v0.1.0-rc.1)

Copy Markdown View Source

OpenAI LLM service with streaming SSE support. Spawns a task per request that pushes LLMTextFrame tokens as they arrive. Supports interruption by killing the in-flight task.

Summary

Functions

child_spec(opts)