#nlp-systems News & Analysis

2 articles tagged with #nlp-systems. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Jun 96/10

🧠

PIPE-Cypher: Automatic Enterprise Benchmark Generation for Text-to-Cypher Systems

Researchers introduced PIPE-Cypher, an automated pipeline for generating Text-to-Cypher benchmarks tailored to enterprise property graphs. The system combines schema profiling, LLM generation, and validation to create deployment-relevant datasets that reflect real user queries, addressing the challenge that enterprise graphs have unique structures and evolving schemas that make standardized benchmarks inadequate.

AIBullisharXiv – CS AI · Apr 136/10

🧠

Adaptive Rigor in AI System Evaluation using Temperature-Controlled Verdict Aggregation via Generalized Power Mean

Researchers introduce Temperature-Controlled Verdict Aggregation (TCVA), a novel evaluation method that adapts AI system assessment rigor based on application domain requirements. By combining verdict scoring with generalized power-mean aggregation and a tunable temperature parameter, TCVA achieves human-aligned evaluation comparable to existing benchmarks while offering computational efficiency.