MMTABREAL: Real-World Benchmark for Multimodal Table Understanding
Researchers introduce MMTABREAL, a new benchmark dataset of 500 real-world multimodal tables with 4,021 question-answer pairs designed to rigorously evaluate how well AI language models understand tables containing charts, maps, icons, and color encodings. Testing reveals significant performance gaps in state-of-the-art models, particularly in visual grounding and multi-step reasoning, indicating that current architectures lack tight fusion between vision and tabular structure.