#protein-language-models News & Analysis

4 articles tagged with #protein-language-models. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles

AIBearisharXiv – CS AI · Jun 47/10

🧠

Retrieval and competition: how a protein foundation model starts a protein

Researchers traced how ESM2-8M, a protein language model, predicts that proteins begin with methionine—a near-universal biological rule. The analysis reveals the model doesn't recognize methionine through direct evidence detection, but rather retrieves it via a distributed computational circuit anchored at the sequence start token. Critically, the model fails on sequences where biology diverges from the statistical default, suggesting that model confidence may not reflect genuine biological understanding.

AINeutralarXiv – CS AI · May 296/10

🧠

HD-Prot: A Protein Language Model for Joint Sequence-Structure Modeling with Continuous Structure Tokens

Researchers introduce HD-Prot, a hybrid diffusion protein language model that integrates continuous structure tokens with discrete sequence tokens for joint sequence-structure modeling. The approach achieves competitive performance on protein generation and prediction tasks while using significantly fewer computational resources than existing multimodal protein language models.

AIBullisharXiv – CS AI · May 116/10

🧠

Conditional generation of antibody sequences with classifier-guided germline-absorbing discrete diffusion

Researchers have developed a novel discrete diffusion model that improves computational antibody design by using germline sequences as an anchor point rather than masked tokens, reducing memorization of genetic patterns and enabling better conditional generation of antibodies with specific therapeutic properties like improved binding affinity.

AIBullisharXiv – CS AI · May 116/10

🧠

ProteinJEPA: Latent prediction complements protein language models

Researchers demonstrate that ProteinJEPA, a latent-space prediction technique, can complement traditional masked language modeling (MLM) in protein language models, achieving better downstream task performance when combined strategically. The optimal approach—masked-position MLM+JEPA—wins 10 out of 16 evaluation tasks against MLM-only baselines while maintaining computational efficiency.