ReContext Improves Utilization of 128K Context Windows Without Retraining
Researchers from the University of Illinois developed ReContext — an inference technique that recursively replays relevant evidence from a long context window and consistently improves performance across three LLM architectures over eight benchmarks, without any retraining.