Interface GradientLLMParams

The GradientLLMParams interface defines the input parameters for the GradientLLM class.

interface GradientLLMParams {
    adapterId?: string;
    cache?: boolean | BaseCache<Generation[]>;
    callbackManager?: CallbackManager;
    callbacks?: Callbacks;
    concurrency?: number;
    gradientAccessKey?: string;
    inferenceParameters?: Record<string, unknown>;
    maxConcurrency?: number;
    maxRetries?: number;
    metadata?: Record<string, unknown>;
    modelSlug?: string;
    onFailedAttempt?: FailedAttemptHandler;
    tags?: string[];
    verbose?: boolean;
    workspaceId?: string;
}

Hierarchy

  • BaseLLMParams
    • GradientLLMParams

Properties

adapterId? cache? callbackManager? callbacks? concurrency? gradientAccessKey? inferenceParameters? maxConcurrency? maxRetries? metadata? modelSlug? onFailedAttempt? tags? verbose? workspaceId?

Properties

OptionaladapterId

adapterId?: string

Gradient Adapter ID for custom fine tuned models.

Optionalcache

cache?: boolean | BaseCache<Generation[]>

OptionalcallbackManager

callbackManager?: CallbackManager

Deprecated

Use callbacks instead

Optionalcallbacks

callbacks?: Callbacks

Optionalconcurrency

concurrency?: number

Deprecated

Use maxConcurrency instead

OptionalgradientAccessKey

gradientAccessKey?: string

Gradient AI Access Token. Provide Access Token if you do not wish to automatically pull from env.

OptionalinferenceParameters

inferenceParameters?: Record<string, unknown>

Parameters accepted by the Gradient npm package.

OptionalmaxConcurrency

maxConcurrency?: number

The maximum number of concurrent calls that can be made. Defaults to Infinity, which means no limit.

OptionalmaxRetries

maxRetries?: number

The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.

Optionalmetadata

metadata?: Record<string, unknown>

OptionalmodelSlug

modelSlug?: string

Gradient AI Model Slug.

OptionalonFailedAttempt

onFailedAttempt?: FailedAttemptHandler

Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.

Optionaltags

tags?: string[]

Optionalverbose

verbose?: boolean

OptionalworkspaceId

workspaceId?: string

Gradient Workspace Id. Provide workspace id if you do not wish to automatically pull from env.

Settings

Member Visibility

On This Page

Properties