InferenceRequestOptions

Agent Runtimes

---

Agent Runtimes / types/inference / InferenceRequestOptions

Interface: InferenceRequestOptions

Defined in: types/inference.ts:63

Request options for sending messages

Properties

agentName?

optional agentName?: string

Defined in: types/inference.ts:83

Agent name for multi-agent scenarios

---

instructions?

optional instructions?: string

Defined in: types/inference.ts:65

System prompt / instructions

---

maxTokens?

optional maxTokens?: number

Defined in: types/inference.ts:71

Maximum tokens to generate

---

metadata?

optional metadata?: Record<string, unknown>

Defined in: types/inference.ts:86

Additional metadata

---

signal?

optional signal?: AbortSignal

Defined in: types/inference.ts:77

Abort signal for cancellation

---

temperature?

optional temperature?: number

Defined in: types/inference.ts:68

Temperature for response generation

---

threadId?

optional threadId?: string

Defined in: types/inference.ts:80

Thread/conversation ID

---

tools?

optional tools?: ToolDefinition[]

Defined in: types/inference.ts:74

Tools available for the LLM