y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#transfer-learning News & Analysis

99 articles tagged with #transfer-learning. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

99 articles
AINeutralarXiv – CS AI · Jun 26/10
🧠

TERRA: Task-Embedded Reasoning and Representation Architecture for Cross-Domain Applications

TERRA introduces a theoretical framework for transferring machine learning representations across structurally similar but unrelated domains—from driving scenes to robot workspaces to financial markets. The research formalizes when and how well a model trained in one domain generalizes to another through mathematical constructs like Markov decision process homomorphisms and Gromov-Wasserstein distances, presenting a preregistered experimental program without empirical validation.

AINeutralarXiv – CS AI · Jun 26/10
🧠

Task diversity produces systematic transfer but inhibits continual reinforcement learning

Researchers introduce Banyan, a benchmark for studying continual reinforcement learning that reveals task diversity improves immediate transfer between tasks but fails to sustain learning across multiple distribution shifts. While agents trained on diverse tasks generalize well to new task distributions, they forget earlier tasks and struggle with longer-horizon objectives as training continues.

AINeutralarXiv – CS AI · Jun 26/10
🧠

Attention mechanisms and transfer learning for robust peach leaf damage classification under domain shift

Researchers developed an AI-powered image classification system for detecting peach leaf damage using deep learning and attention mechanisms, achieving 93.3% accuracy on a benchmark dataset. The study demonstrates that EfficientNet models with attention modules provide robust generalization across different farming environments, addressing a critical need in automated agricultural disease diagnosis.

AINeutralarXiv – CS AI · Jun 26/10
🧠

What Do LLMs Know About Alzheimer's Disease? Multi-loss Fine-Tuning and Probing for AD Detection

Researchers demonstrate that fine-tuned large language models, particularly BERT, T5, and Llama-1B, achieve state-of-the-art performance in detecting Alzheimer's disease from speech transcripts across multiple datasets. The study reveals how these models encode disease-related linguistic signals through fine-tuning, advancing the potential for early AD diagnosis through text analysis.

🧠 Llama
AINeutralarXiv – CS AI · Jun 16/10
🧠

Unicorn: Scaling High-Dimensional Time Series Forecasting via Universal Correlation Modeling

Researchers introduce Unicorn, a universal correlation network that addresses a key limitation in time series forecasting by enabling models to scale across high-dimensional datasets while capturing inter-channel dependencies. The framework uses a latent prototype codebook to learn identity-agnostic patterns that transfer across diverse domains, significantly outperforming existing architectures in few-shot transfer scenarios.

AINeutralarXiv – CS AI · Jun 16/10
🧠

Prior Availability in Industrial Visual Sim-to-Real: A Review of CAD-Guided and CAD-Unavailable Regimes

This arXiv paper reviews industrial visual sim-to-real transfer in computer vision, proposing a taxonomy organized by CAD (Computer-Aided Design) data availability. The research distinguishes between CAD-available settings using explicit geometry for rendering and verification, CAD-unavailable settings relying on appearance and feature priors, and hybrid approaches, using benchmark datasets to demonstrate that raw synthetic data volume matters less than source-distribution design, detector capacity, and real-world calibration.

AINeutralarXiv – CS AI · Jun 16/10
🧠

Routing on the Stiefel Manifold: When Does Adaptive Subspace Selection Help for Cross-Domain EEG Decoding?

Researchers propose dynamic Stiefel routing, a novel machine learning approach using expert projection filters on the Stiefel manifold to improve cross-domain EEG decoding without requiring target-domain calibration data. The method addresses a fundamental degeneracy problem where naive routing collapses to ensemble averaging, introducing three structural properties that enable genuine domain-specialized routing with significant accuracy improvements across datasets.

AINeutralarXiv – CS AI · Jun 16/10
🧠

Weight Decay Improves Language Model Plasticity

Researchers demonstrate that weight decay during language model pretraining significantly improves model plasticity—the ability to adapt to downstream tasks through fine-tuning. The study reveals counterintuitive findings where higher weight decay produces weaker base models but stronger performance after task-specific training, challenging conventional approaches to hyperparameter optimization.

AIBullisharXiv – CS AI · May 296/10
🧠

Uncertainty-Aware Transfer Learning for Cross-Building Energy Forecasting: Toward Robust and Scalable District-Level Energy Management

Researchers developed an uncertainty-aware transfer learning framework using Temporal Fusion Transformers to enable energy forecasting models trained on one building to work effectively on different buildings with minimal retraining. The approach achieved 93.2% prediction interval coverage and demonstrated that freezing most model parameters while fine-tuning only output layers produces superior cross-building generalization compared to full model retraining.

AINeutralarXiv – CS AI · May 296/10
🧠

Architecture-Sensitive Supervised Fine-Tuning for Screen-Conditioned Action Prediction: A PiSAR Benchmark

Researchers benchmark supervised fine-tuned vision-language models against frontier zero-shot AI baselines on screen-conditioned action prediction using the PiSAR dataset. A fine-tuned Qwen3-VL-8B model substantially outperforms GPT and Claude zero-shot approaches (0.783 vs 0.459-0.482 semantic similarity), but the same training recipe fails on Gemma-4-26B, revealing critical architecture-to-method misalignment in model optimization.

🧠 GPT-5🧠 Claude🧠 Opus
AINeutralarXiv – CS AI · May 296/10
🧠

Make LLM Learn to Synthesize from Streaming Experiences through Feedback

Researchers introduce StreamSynth, a new framework enabling large language models to learn and improve synthetic data generation across sequential tasks by accumulating experience and transferring knowledge between related synthesis problems. The SynLearner framework demonstrates that LLMs can leverage historical task insights to enhance future data generation quality, establishing synthetic data creation as an experience-driven process rather than isolated operations.

AINeutralarXiv – CS AI · May 296/10
🧠

Learning A Simulation-based Visual Policy for Real-world Peg In Unseen Holes

Researchers propose a learning-based visual peg-in-hole system that trains on multiple shapes in simulation and adapts to unseen shapes in real-world environments with minimal sim-to-real transfer costs. The approach decouples perception from control through modular networks, achieving 100% success rates on EV charging systems with only hundreds of auto-labeled training samples.

AINeutralarXiv – CS AI · May 296/10
🧠

Model Fusion via Retrofitting

Researchers introduce a neuron-centric model fusion algorithm that combines independently trained neural networks without retraining by matching intermediate representations and using neuron attribution scores. The method outperforms existing approaches in zero-shot and non-IID scenarios across multiple architectures including VGGs, ResNets, and Vision Transformers.

AINeutralarXiv – CS AI · May 296/10
🧠

An accuracy-aware extension to LRP-based pruning for CNNs to prevent cascading accuracy degradation in data-scarce transfer learning

Researchers propose an accuracy-aware pruning mechanism for CNNs that improves upon existing Layer-wise Relevance Propagation (LRP) methods to reduce model size without degrading performance in transfer learning scenarios with limited data. The approach dynamically adjusts pruning rates using harmonic mean of class accuracy, achieving 15% improvement in compression efficiency while maintaining task-specific accuracy.

AINeutralarXiv – CS AI · May 286/10
🧠

FLORO: A Multimodal Geospatial Foundation Model for Ecological Remote Sensing Across Sensors and Scales

FLORO is a multimodal geospatial foundation model that learns from diverse remote sensing data across multiple sensor types and resolutions with minimal pretraining data. Despite using significantly smaller datasets than competing models, FLORO demonstrates strong transfer learning performance on ecological and environmental applications, achieving competitive results on scene classification, segmentation, and regression tasks.

AINeutralarXiv – CS AI · May 286/10
🧠

A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Models

Researchers propose a multi-dimensional evaluation framework for EEG foundation models that tests performance under realistic biomedical constraints like limited labeled data and reduced sensor coverage. Analysis of models including LaBraM, CSBrain, and CBraMod reveals foundation models excel at long-context tasks but struggle with short-window Brain-Computer Interface applications and channel constraints compared to supervised alternatives.

AINeutralarXiv – CS AI · May 286/10
🧠

Emergent Analogical Reasoning in Transformers

Researchers demonstrate that Transformers develop analogical reasoning—the ability to transfer relational patterns across different domains—through two key mechanisms: geometric alignment of structures in embedding space and functor application. This mechanistic understanding bridges cognitive science and neural network architecture, with findings validated across both synthetic tasks and pretrained large language models.

AINeutralarXiv – CS AI · May 276/10
🧠

Graph is a Substrate Across Data Modalities

Researchers propose G-Substrate, a novel graph framework that treats graph structures as persistent substrates across multiple data modalities and tasks rather than isolated, task-specific constructs. The approach uses unified structural schemas and role-based training to enable graph representations to accumulate knowledge across heterogeneous domains, demonstrating superior performance compared to traditional isolated and multi-task learning methods.

AINeutralarXiv – CS AI · May 276/10
🧠

CogAdapt: Transferring Clinical ECG Foundation Models to Wearable Cognitive Load Assessment via Lead Adaptation

Researchers introduce CogAdapt, a framework that adapts clinical ECG foundation models to wearable cognitive load assessment by bridging the gap between hospital-grade 12-lead sensors and 3-lead wearable devices. The approach achieves strong cross-subject generalization on benchmark datasets, demonstrating the feasibility of transferring pre-trained medical models to consumer health applications.

AINeutralarXiv – CS AI · May 126/10
🧠

Decoupling Endpoint and Semantic Transition Learning for Zero-Shot Composed Image Retrieval

Researchers propose DeCIR, a new approach to zero-shot composed image retrieval that separates endpoint matching from semantic transition learning to overcome limitations in projection-based methods. The technique uses decoupled text adapters and low-rank directional merging to improve performance on image retrieval tasks without increasing computational complexity at inference time.

AINeutralarXiv – CS AI · May 126/10
🧠

Structure-Centric Graph Foundation Model via Geometric Bases

Researchers propose Structure-Centric Graph Foundation Models (SCGFM), a novel approach that treats graph topology as the primary source of transferable knowledge using geometric bases and Gromov-Wasserstein distances. The method addresses key limitations in existing graph foundation models by handling structural heterogeneity and incompatible node feature spaces, demonstrating improved generalization across both in-domain and cross-domain graph tasks.

AINeutralarXiv – CS AI · May 126/10
🧠

From Traditional Taggers to LLMs: A Comparative Study of POS Tagging for Medieval Romance Languages

Researchers conducted a systematic evaluation of large language models for part-of-speech tagging in Medieval Romance languages, comparing them against traditional taggers. The study demonstrates that LLM-based approaches with fine-tuning and cross-lingual transfer learning significantly outperform conventional methods, offering practical applications for digital humanities research on historical texts.

AINeutralarXiv – CS AI · May 126/10
🧠

Cross-Family Universality of Behavioral Axes via Anchor-Projected Representations

Researchers introduce an anchor-projection framework that enables behavioral directions to transfer across different large language model families by mapping their diverse hidden representations into a shared coordinate space. The approach achieves high cross-model alignment (0.83 ten-way detection accuracy) without fine-tuning, demonstrating that interpretability and control mechanisms can be standardized across architecturally different models.

🧠 Llama
AIBullisharXiv – CS AI · May 126/10
🧠

CORTEG: Foundation Models Enable Cross-Modality Representation Transfer from Scalp to Intracranial Brain Recordings

Researchers introduce CORTEG, a framework that adapts pretrained scalp-EEG foundation models to intracranial ECoG recordings, enabling brain-computer interfaces to learn across patients with minimal calibration time. The approach demonstrates competitive or superior performance on finger trajectory and audio envelope decoding tasks while reducing per-patient training requirements to 10-30 minutes.

AINeutralarXiv – CS AI · May 126/10
🧠

Digital Image Forgery Detection Using Transfer Learning

Researchers present a transfer learning framework for detecting digitally forged images by combining RGB data with compression-difference features and optimized thresholds. Testing across multiple CNN architectures on the CASIA v2.0 dataset shows DenseNet121 achieves highest accuracy while ResNet50 provides most reliable predictions, addressing critical forensic security needs.

← PrevPage 3 of 4Next →