The Friendli class is used to interact with Friendli inference Endpoint models. This requires your Friendli Token and Friendli Team which is autoloaded if not specified.

Hierarchy (view full)



baseUrl: string = ""
model: string = "mixtral-8x7b-instruct-v0-1"
frequencyPenalty?: number
friendliTeam?: string
friendliToken?: string
maxTokens?: number
modelKwargs?: Record<string, unknown>
stop?: string[]
temperature?: number
topP?: number

Generated using TypeDoc