LogitSamplers

Min_p(pbase)

A logit transform that masks out logits below pbase times the maximum probability.

See: https://arxiv.org/pdf/2407.01082

Temperature(T)

A logit transform that scales (divides) the logits by a temperature parameter.

Top_nσ(n)

A logit transform that masks out logits below n standard deviations of the maximum logit.

Top-nσ is temperature-invariant, i.e. the candidate set does not change with temperature.

See: https://arxiv.org/pdf/2411.07641

Top_pk(p, k)

A logit transform that masks out logits outside the top p cumulative probability or top k logits.

logitsample([rng], logits)

Sample an index from a logit distribution using the Gumbel argmax trick.