Learning More from Less: Unlocking Internal Representations for Benchmark Compression
RepCore, a new method for compressing LLM benchmarks, uses aligned hidden states from neural networks to identify representative test subsets rather than relying solely on correctness labels. The approach achieves accurate performance estimation with as few as ten source models, addressing the statistical instability that plagues existing coreset methods when evaluation data is limited.