OptionalapiAPI key to use when making requests. Defaults to the value of
ZHIPUAI_API_KEY environment variable.
Optionaldoturn on sampling strategy when do_sample is true, do_sample is false, temperature、top_p will not take effect
Optionalmaxmax value is 8192,defaults to 1024
OptionalmessagesMessages to pass as a prefix to the prompt
OptionalrequestUnique identifier for the request. Defaults to a random UUID.
OptionalstopOptionalstreamingWhether to stream the results or not. Defaults to false.
OptionaltemperatureAmount of randomness injected into the response. Ranges from 0 to 1 (0 is not included). Use temp closer to 0 for analytical / multiple choice, and temp closer to 1 for creative and generative tasks. Defaults to 0.95
OptionaltopPTotal probability mass of tokens to consider at each step. Range from 0 to 1 Defaults to 0.7
OptionalzhipuAIApiAPI key to use when making requests. Defaults to the value of
ZHIPUAI_API_KEY environment variable.
Alias for apiKey
Interface defining the input to the ZhipuAIChatInput class.