The maximum number of concurrent calls that can be made.
Defaults to Infinity, which means no limit.
OptionalmaxRetries
maxRetries?:number
The maximum number of retries that can be made for a single call,
with an exponential backoff between each attempt. Defaults to 6.
maximum_tokens
maximum_tokens:number
Optionalmetadata
metadata?:Record<string, unknown>
Optionalminimum_tokens
minimum_tokens?:number
model
model:string
Optionaln
n?:number
OptionalonFailedAttempt
onFailedAttempt?:FailedAttemptHandler
Custom handler to handle failed attempts. Takes the originally thrown
error object as input, and should itself throw an error if the input
error is not retryable.
Interface for the input parameters specific to the Aleph Alpha LLM.