#knowledge-injection News & Analysis

2 articles tagged with #knowledge-injection. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · 7h ago7/10

🧠

Diffusion-Inspired Masked Fine-Tuning for Knowledge Injection in Autoregressive LLMs

Researchers demonstrate that masked fine-tuning—a demasking objective borrowed from diffusion models—significantly improves knowledge injection in autoregressive LLMs without requiring expensive paraphrase augmentation and while remaining resistant to the reversal curse. This technique closes the performance gap between autoregressive and diffusion language models, with applications extending to math tasks and large-scale knowledge-intensive benchmarks.

AINeutralarXiv – CS AI · Mar 64/10

🧠

A unified foundational framework for knowledge injection and evaluation of Large Language Models in Combustion Science

Researchers developed the first comprehensive framework for creating domain-specialized Large Language Models for combustion science, using 3.5 billion tokens from scientific literature and code. The study found that standard RAG approaches hit a performance ceiling at 60% accuracy, highlighting the need for more advanced knowledge injection methods including knowledge graphs and continued pretraining.