openhands.llm.streaming_llm

StreamingLLM Objects

class StreamingLLM(AsyncLLM)

Streaming LLM class.

async_streaming_completion

@property
def async_streaming_completion()

Decorator for the async litellm acompletion function with streaming.