Skip to main content

InferenceResponse

Agent Runtimes

Agent Runtimes / types/inference / InferenceResponse

Interface: InferenceResponse

Defined in: types/inference.ts:92

Response from inference provider

Properties​

finishReason?​

optional finishReason?: "length" | "error" | "stop" | "tool_calls" | "content_filter"

Defined in: types/inference.ts:104

Finish reason

message​

message: ChatMessage

Defined in: types/inference.ts:94

Generated message

usage?​

optional usage?: object

Defined in: types/inference.ts:97

Usage statistics

completionTokens​

completionTokens: number

promptTokens​

promptTokens: number

totalTokens​

totalTokens: number