Type Alias EmbeddingDistance

EmbeddingDistance: {
    agentTools?: undefined | StructuredToolInterface<ZodObjectAny>[];
    chainOptions?: undefined | Partial<Omit<LLMEvalChainInput<EvalOutputType, BaseLanguageModelInterface<any, BaseLanguageModelCallOptions>>, "llm">>;
    criteria?: undefined | CriteriaLike;
    distanceMetric?: undefined | EmbeddingDistanceType;
    embedding?: undefined | EmbeddingsInterface;
    evaluatorType: "embedding_distance";
    feedbackKey: undefined | string;
    formatEvaluatorInputs: EvaluatorInputFormatter;
    llm?: undefined | BaseLanguageModelInterface<any, BaseLanguageModelCallOptions>;
}

Configuration to load a "EmbeddingDistanceEvalChain" evaluator, which embeds distances to score semantic difference between a prediction and reference.

Type declaration

  • OptionalagentTools?: undefined | StructuredToolInterface<ZodObjectAny>[]

    A list of tools available to the agent, for TrajectoryEvalChain.

  • OptionalchainOptions?: undefined | Partial<Omit<LLMEvalChainInput<EvalOutputType, BaseLanguageModelInterface<any, BaseLanguageModelCallOptions>>, "llm">>
  • Optionalcriteria?: undefined | CriteriaLike

    The criteria to use for the evaluator.

  • OptionaldistanceMetric?: undefined | EmbeddingDistanceType

    The distance metric to use for comparing the embeddings.

  • Optionalembedding?: undefined | EmbeddingsInterface

    The embedding objects to vectorize the outputs.

  • evaluatorType: "embedding_distance"
  • feedbackKey: undefined | string
  • formatEvaluatorInputs: EvaluatorInputFormatter
  • Optionalllm?: undefined | BaseLanguageModelInterface<any, BaseLanguageModelCallOptions>

Settings

Member Visibility