7 articles tagged with #decision-systems. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Trace2Policy introduces EISR, a systematic method to extract and refine implicit decision rules from expert behavior through iterative error analysis. Deployed at a major logistics carrier for 22 days, the approach achieved 79.6% accuracy with deterministic Python execution, outperforming LLM-based baselines by 9.8 percentage points and eliminating inference-time LLM dependency.
Researchers identify a critical failure mode called Cherry-pick Override (CCO) where large language model judges make unsafe directional commitments when evaluating mixed evidence containing both supporting and refuting claims. The study demonstrates that LLM judges incorrectly return definitive verdicts on over 84% of conflicting-evidence cases instead of acknowledging ambiguity, with panel voting amplifying rather than mitigating this bias.
Researchers identify a critical vulnerability in agentic memory systems where Large Language Models retrieve and amplify spurious correlations from stored information, leading to erroneous reasoning in downstream decisions. The study benchmarks this risk and proposes CAMEL, a lightweight calibration method that mitigates spurious pattern reliance while maintaining performance on clean data.
Researchers propose Cognitive Core, a governed AI architecture designed for high-stakes institutional decisions that achieves 91% accuracy on prior authorization appeals while eliminating silent errors—a critical failure mode where AI systems make incorrect determinations without human review. The framework introduces 'governability' as a primary evaluation metric alongside accuracy, demonstrating that institutional AI requires fundamentally different design principles than general-purpose agents.
Researchers examine how statistical calibration—the alignment between predicted confidence and actual accuracy—functions in human-AI collaborative systems. Their findings show that standard prediction combination methods fail to preserve human calibration quality, while delegation-based approaches shift calibration burdens to a meta-model that must accurately identify when each team member excels, a challenge that intensifies when humans access information unavailable to the AI system.
Researchers introduce Repair-Augmented Constraint Learning (RACL), a machine learning framework that decides whether to repair constraint violations before rejecting candidates, rather than applying hard vetoes immediately. The method achieves significantly lower false-veto rates (0.25%) compared to baseline approaches (26.4%) on real-world airline data, with applications to automated decision systems.
Researchers present an LLM-agent framework that enhances time series forecasting by incorporating business context and expert judgment into statistical predictions. The system bridges the gap between raw forecasts and decision-ready outputs through structured reasoning, contextual evidence retrieval, and auditable revision mechanisms.
