AIBearisharXiv – CS AI · 6h ago6/10
🧠
BIM-Edit: Benchmarking Large Language Models for IFC-Based Building Information Modeling
Researchers introduce BIM-Edit, a benchmark that evaluates large language models on their ability to edit existing Building Information Models in IFC format based on natural language instructions. The benchmark reveals significant capability gaps, with the best-performing LLM achieving only 49.5% accuracy and none solving more than 3.4% of tasks, highlighting that current AI systems struggle with the semantic preservation and relational understanding required for professional engineering workflows.