top_p

Property

Belongs to type Completion_Request

Open in TypeHub

Number

An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered.

part of the Apioo-Project