y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#ai-quality-assessment News & Analysis

2 articles tagged with #ai-quality-assessment. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AINeutralarXiv – CS AI · Jun 256/10
🧠

Physics Question Scene Graph: Fine-grained Evaluation of Physical Plausibility in Text-to-Video Generation

Researchers introduce Physics Question Scene Graph (PQSG), a new evaluation framework that uses vision-language models to assess whether AI-generated videos obey physical laws. The framework evaluates videos from models like Sora 2 and Veo 3 through hierarchical question graphs, revealing that closed-source models outperform open-source alternatives in physical realism.

🧠 Sora
AINeutralarXiv – CS AI · Jun 116/10
🧠

Geometric Metrics and LLMs: What They Measure and When They Work

Researchers systematically tested geometric metrics for evaluating large language models, finding that several popular metrics like Schatten Norm and MOM primarily measure output length rather than quality. While geometric metrics add modest discriminative value beyond standard text statistics for tasks like generator identification, they show inconsistent correlation with actual text quality measures.