OptionalapiAPI key to use when making requests. Defaults to the value of
MOONSHOT_API_KEY environment variable.
OptionalfrequencyFrequency penalty, a number between -2.0 and 2.0. Positive values penalize the newly generated words based on their existing frequency in the text, making the model less likely to repeat the same words verbatim. The default value is 0
OptionalmaxDifferent models have different maximum values. For example, the maximum value of moonshot-v1-8k is 8192. Defaults to 1024
OptionalmessagesMessages to pass as a prefix to the prompt
OptionalnThe default value is 1 and cannot be greater than 5. In particular, when temperature is very small and close to 0, we can only return 1 result. If n is already set and > 1, Moonshot will return an invalid input parameter (invalid_request_error).
OptionalpresenceThere is a penalty, a number between -2.0 and 2.0. Positive values penalize the newly generated words based on whether they appear in the text, increasing the likelihood that the model will discuss new topics. The default value is 0
OptionalstopOptionalstreamingWhether to stream the results or not. Defaults to false.
OptionaltemperatureAmount of randomness injected into the response. Ranges from 0 to 1 (0 is not included). Use temp closer to 0 for analytical / multiple choice, and temp closer to 1 for creative and generative tasks. Defaults to 0, recommended 0.3
OptionaltopPTotal probability mass of tokens to consider at each step. Range from 0 to 1. Defaults to 1
Interface defining the input to the MoonshotChatInput class.