#bert-models News & Analysis

6 articles tagged with #bert-models. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

6 articles

AIBullisharXiv – CS AI · Jun 256/10

🧠

Neural Machine Translation for Low-Resource Tangkhul--English

Researchers have developed a neural machine translation system for Tangkhul, a severely under-resourced Tibeto-Burman language spoken in Manipur, India, achieving a BLEU score of 39.97 using a fine-tuned ByT5-large model trained on 38,336 parallel sentences. This work addresses a significant gap in NLP infrastructure for one of India's marginalized linguistic communities and demonstrates practical approaches to machine translation for languages with minimal computational resources.

AINeutralarXiv – CS AI · Jun 85/10

🧠

Supervision versus Demonstration-Based In-Context Learning for Multiword Expression Classification

Researchers compared supervised learning and large language model prompting approaches for detecting Turkish idiomatic light verb constructions, finding that while zero-shot LLMs struggle with recall, few-shot demonstrations significantly improve performance. The study reveals that careful prompt engineering can match or exceed traditional supervised baselines, though results remain highly model-sensitive.

AIBullisharXiv – CS AI · Jun 46/10

🧠

MimeLens: Position-Agnostic Content-Type Detection for Binary Fragments

MimeLens is a new BERT-based machine learning model designed to classify file types from binary fragments at any position within a file, without requiring file headers or complete files. It outperforms Google's Magika on standard benchmarks and uniquely handles use cases like packet inspection and forensic recovery where Magika fails.

🏢 Hugging Face

AINeutralarXiv – CS AI · May 126/10

🧠

GESR: A Genetic Programming-Based Symbolic Regression Method with Gene Editing

Researchers propose GESR, a genetic programming method that uses BERT language models to intelligently guide mutations and crossovers in symbolic regression tasks, rather than relying on random evolutionary processes. The approach significantly improves computational efficiency compared to traditional genetic programming algorithms while maintaining strong performance across multiple regression problems.

AINeutralarXiv – CS AI · May 96/10

🧠

Systematic Evaluation of Large Language Models for Post-Discharge Clinical Action Extraction

Researchers systematically evaluated large language models against supervised BERT models for extracting post-discharge clinical actions from narrative hospital notes. LLMs matched or exceeded supervised baselines on binary actionability detection but lagged on fine-grained multi-label classification, revealing that performance gaps stem from misalignment between model reasoning and annotation conventions rather than pure capability limitations.

AINeutralarXiv – CS AI · Apr 106/10

🧠

Large Language Models for Outpatient Referral: Problem Definition, Benchmarking and Challenges

Researchers have developed a comprehensive evaluation framework for Large Language Models applied to outpatient referral systems in healthcare, revealing that LLMs offer limited advantages over simpler BERT-like models in static referral tasks but demonstrate potential in interactive dialogue scenarios. The study addresses the absence of standardized evaluation criteria for assessing LLM effectiveness in dynamic healthcare settings.