Large Language Models

Don't Repeat Yourself: Stopping Verbatim Loops at Sampling Time

Reducing verbatim loops during generation by penalizing tokens that continue a previously seen sequence.

XTC: Head-Aware Sampling by Excluding Top Choices

Encouraging varied text by occasionally excluding dominant choices when several plausible next tokens are available.

Antislop: A Comprehensive Framework for Identifying and Eliminating Repetitive Patterns in Language Models

Detecting and reducing repetitive language patterns through sampling and targeted fine-tuning.

The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs

Reassessing hallucination detection with evaluation metrics that better reflect meaning.

LiveBench: A Challenging, Contamination-Limited LLM Benchmark

An evolving language-model benchmark with recent questions and objective scoring, designed to limit test contamination.