#automated-annotation News & Analysis

2 articles tagged with #automated-annotation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · May 117/10

🧠

A Large-Scale Dataset for Molecular Structure-Language Description via a Rule-Regularized Method

Researchers have developed an automated framework to generate a large-scale dataset of 163,000 molecule-description pairs by combining rule-based chemical nomenclature parsing with LLM guidance, achieving 98.6% precision in aligning molecular structures with natural language descriptions. This addresses a critical bottleneck in training language models for chemistry applications where manual annotation is prohibitively expensive.

🏢 Hugging Face

AIBullisharXiv – CS AI · Apr 77/10

🧠

Robust LLM Performance Certification via Constrained Maximum Likelihood Estimation

Researchers propose a new constrained maximum likelihood estimation (MLE) method to accurately estimate failure rates of large language models by combining human-labeled data, automated judge annotations, and domain-specific constraints. The approach outperforms existing methods like Prediction-Powered Inference across various experimental conditions, providing a more reliable framework for LLM safety certification.