Table of contents
Temperature parameter in GPTCache
a. Randomly choose from multiple candidate answers
b. Adjust the probability to skip the cache and call the model directly
-
Temperature parameter in GPTCache
In order to balance the randomness and consistency of the response, and to meet the user preference or application requirements, it is crucial to choose the appropriate temperature parameter values in multimodal AI applications. GPTCache retains the concept of temperature parameters in machine learning. When using GPTCache, you can choose the following 3 options to adjust the temperature:
<