Nucleus/ Top_p Sampling
Overview Nucleus sampling is also known as Top_p Sampling. In Nucleus sampling, the model only considers the tokens with the highest probability mass, which is determined by the top_p parameter. OpenAI recommends to use either one but not both: nucleus sampling or temperature sampling Top_p Sampling The Top_P parameter controls the diversity of the text […]