Optional
apiSome APIs allow an API key instead
Optional
apiThe version of the API functions. Part of the path.
Optional
authOptional
defaultOptional
defaultOptional
endpointHostname for the API call (if this is running on GCP)
Optional
locationRegion where the LLM is stored (if this is running on GCP)
Optional
maxThe maximum number of concurrent calls that can be made.
Defaults to Infinity
, which means no limit.
Optional
maxThe maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.
Optional
onCustom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.
Optional
platformWhat platform to run the service on. If not specified, the class should determine this from other means. Either way, the platform actually used will be in the "platform" getter.
Parameters needed to setup the client connection. AuthOptions are something like GoogleAuthOptions (from google-auth-library) or WebGoogleAuthOptions.