#automated-annotation News & Analysis

3 articles tagged with #automated-annotation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles

AIBullisharXiv – CS AI · May 117/10

🧠

A Large-Scale Dataset for Molecular Structure-Language Description via a Rule-Regularized Method

Researchers have developed an automated framework to generate a large-scale dataset of 163,000 molecule-description pairs by combining rule-based chemical nomenclature parsing with LLM guidance, achieving 98.6% precision in aligning molecular structures with natural language descriptions. This addresses a critical bottleneck in training language models for chemistry applications where manual annotation is prohibitively expensive.

🏢 Hugging Face

AIBullisharXiv – CS AI · Apr 77/10

🧠

Robust LLM Performance Certification via Constrained Maximum Likelihood Estimation

Researchers propose a new constrained maximum likelihood estimation (MLE) method to accurately estimate failure rates of large language models by combining human-labeled data, automated judge annotations, and domain-specific constraints. The approach outperforms existing methods like Prediction-Powered Inference across various experimental conditions, providing a more reliable framework for LLM safety certification.

AINeutralarXiv – CS AI · Jun 96/10

🧠

Bidirectional Small-Granularity Search between Code and Text

Researchers introduce a bidirectional search task linking code snippets with text descriptions and vice versa, addressing the gap between scientific publications and their implementations. They present a large dataset with automatically-generated training data and manually-annotated test sets, along with a modular encoder-based approach that achieves strong in-domain results with promising out-of-domain generalization.

🧠 GPT-4