Class AbstractGoogleLLMConnection<MessageType, AuthOptions>Abstract

Parameters needed to setup the client connection. AuthOptions are something like GoogleAuthOptions (from google-auth-library) or WebGoogleAuthOptions.

Type Parameters

  • MessageType
  • AuthOptions

Hierarchy (view full)

Constructors

Properties

api: any
apiVersion: string = "v1"

The version of the API functions. Part of the path.

caller: AsyncCaller
endpoint: string = "us-central1-aiplatform.googleapis.com"

Hostname for the API call (if this is running on GCP)

location: string = "us-central1"

Region where the LLM is stored (if this is running on GCP)

model: string

Model to use

modelName: string

Model to use Alias for model

platformType: undefined | GooglePlatformType

What platform to run the service on. If not specified, the class should determine this from other means. Either way, the platform actually used will be in the "platform" getter.

streaming: boolean

Whether or not to stream.

false

Accessors

Methods

  • Parameters

    Returns undefined | {
        functionCallingConfig: {
            allowedFunctionNames?: string[];
            mode: "auto" | "any" | "none";
        };
    }