y0news
#ai-benchmarks3 articles
3 articles
AIBullisharXiv โ€“ CS AI ยท 4h ago4
๐Ÿง 

Domain-Partitioned Hybrid RAG for Legal Reasoning: Toward Modular and Explainable Legal AI for India

Researchers developed a domain-partitioned hybrid RAG system with knowledge graphs specifically for Indian legal research, combining three specialized pipelines for Supreme Court cases, statutory texts, and penal codes. The system achieved a 70% pass rate on legal questions, nearly doubling the performance of traditional RAG-only approaches at 37.5%.

AINeutralarXiv โ€“ CS AI ยท 4h ago3
๐Ÿง 

DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model

Researchers introduce DLEBench, the first benchmark specifically designed to evaluate instruction-based image editing models' ability to edit small-scale objects that occupy only 1%-10% of image area. Testing on 10 models revealed significant performance gaps in small object editing, highlighting a critical limitation in current AI image editing capabilities.

AIBearisharXiv โ€“ CS AI ยท 4h ago4
๐Ÿง 

CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers

Researchers created CMT-Benchmark, a new dataset of 50 expert-level condensed matter theory problems to evaluate large language models' capabilities in advanced scientific research. The best performing model (GPT5) solved only 30% of problems, with the average across 17 models being just 11.4%, highlighting significant gaps in current AI's physical reasoning abilities.