Input interface for ChatCohere

interface ChatCohereInput {
    apiKey?: string;
    model?: string;
    streamUsage?: boolean;
    streaming?: boolean;
    temperature?: number;
}

Hierarchy (view full)

Implemented by

Properties

apiKey?: string

The API key to use.

Default

{process.env.COHERE_API_KEY}
model?: string

The name of the model to use.

Default

{"command"}
streamUsage?: boolean

Whether or not to include token usage when streaming. This will include an extra chunk at the end of the stream with eventType: "stream-end" and the token usage in usage_metadata.

Default

{true}
streaming?: boolean

Whether or not to stream the response.

Default

{false}
temperature?: number

What sampling temperature to use, between 0.0 and 2.0. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic.

Default

{0.3}

Generated using TypeDoc