Taxonomy-Aware Representation Alignment for Hierarchical Visual Recognition with Large Multimodal Models

Researchers propose TARA (Taxonomy-Aware Representation Alignment), a new method to improve Large Multimodal Models' ability to recognize visual categories in hierarchical taxonomies. The approach aligns visual features with biology foundation models to enable better recognition of both known and novel biological categories.