#financial-nlp News & Analysis

6 articles tagged with #financial-nlp. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

6 articles

AINeutralarXiv – CS AI · Jun 257/10

🧠

InvestPhilBench: A Multi-Layer Dynamic Benchmark for Evaluating Large Language Model Procedural Reasoning in Expert Investment Philosophy

Researchers introduce InvestPhilBench, a comprehensive benchmark for testing large language models' ability to reconstruct and apply expert investment decision frameworks. The v0.6 release reveals that while state-of-the-art models achieve high composite scores (0.932), they exhibit significant procedural reasoning deficits (GRA scores of 0.57-0.77), indicating that fluent prose masks deeper gaps in step-by-step investment logic.

🧠 Claude

AIBearisharXiv – CS AI · May 17/10

🧠

Measurement Risk in Supervised Financial NLP: Rubric and Metric Sensitivity on JF-ICR

Researchers demonstrate that supervised financial NLP benchmarks used to evaluate LLMs contain hidden measurement risks, where rubric wording, metric selection, and aggregation methods materially alter model performance rankings. Testing on the Japanese Financial Implicit-Commitment Recognition dataset reveals 13-point agreement variance across rubric variants and shows that certain metrics produce unreliable signals, highlighting the need for standardized evaluation governance in financial AI model selection.

AIBullisharXiv – CS AI · Jun 106/10

🧠

Instruction Finetuning DeepSeek-R1-8B Model Using LoRA and NEFTune

Researchers demonstrate that DeepSeek-R1-8B, enhanced with LoRA and NEFTune fine-tuning techniques, achieves 91.2% accuracy on financial named-entity recognition tasks, outperforming larger baseline models. This advance shows open-source models can match specialized financial AI capabilities through efficient adaptation methods.

🧠 Llama

AINeutralarXiv – CS AI · Jun 16/10

🧠

Enhancing Regime Shift Detection Using Unstructured Data: A Study on the Treasury Market

Researchers developed a hybrid framework combining large language models with statistical analysis to detect regime shifts in financial markets by analyzing Federal Reserve communications alongside Treasury market data. The approach achieved 82% accuracy in identifying monetary policy regime changes, outperforming traditional data-only methods and detecting shifts on the same day they occur.

AINeutralarXiv – CS AI · May 16/10

🧠

FinChain: A Symbolic Benchmark for Verifiable Chain-of-Thought Financial Reasoning

Researchers introduce FinChain, a new benchmark dataset designed to evaluate chain-of-thought reasoning in financial AI systems. The dataset addresses gaps in existing finance benchmarks by emphasizing verifiable intermediate reasoning steps rather than just final answers, and reveals that even leading LLMs struggle with multi-step symbolic financial reasoning.

AIBullisharXiv – CS AI · Mar 27/1012

🧠

FinBloom: Knowledge Grounding Large Language Model with Real-time Financial Data

Researchers have developed FinBloom 7B, a specialized large language model trained on 14 million financial news articles and SEC filings, designed to handle real-time financial queries. The model introduces a Financial Agent system that can access up-to-date market data and financial information to support decision-making and algorithmic trading applications.