y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#user-interface News & Analysis

8 articles tagged with #user-interface. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

8 articles
AIBullisharXiv โ€“ CS AI ยท 3d ago7/10
๐Ÿง 

Generative UI: LLMs are Effective UI Generators

Researchers demonstrate that modern LLMs can robustly generate custom user interfaces directly from prompts, moving beyond static markdown outputs. The approach shows emergent capabilities with results comparable to human-crafted designs in 50% of cases, accompanied by the release of PAGEN, a dataset for evaluating generative UI implementations.

AIBullishGoogle DeepMind Blog ยท Oct 237/106
๐Ÿง 

Introducing the Gemini 2.5 Computer Use model

Google introduces Gemini 2.5 Computer Use model, a specialized AI system built on Gemini 2.5 Pro that enables agents to interact with user interfaces. The model is currently available in preview through Google's API for developers and businesses.

AIBullisharXiv โ€“ CS AI ยท Apr 66/10
๐Ÿง 

Attribution Gradients: Incrementally Unfolding Citations for Critical Examination of Attributed AI Answers

Researchers have developed "attribution gradients," a new technique to improve AI answer engines by making citations more informative and easier to evaluate. The method consolidates evidence amounts, supporting/contradictory excerpts, and contextual explanations in one place, while also allowing users to explore second-degree citations without leaving the interface.

AIBullisharXiv โ€“ CS AI ยท Mar 36/103
๐Ÿง 

See, Think, Act: Teaching Multimodal Agents to Effectively Interact with GUI by Identifying Toggles

Researchers have developed State-aware Reasoning (StaR), a new multimodal AI method that significantly improves AI agents' ability to interact with graphical user interfaces, particularly with toggle controls. The method enables agents to better perceive current states and execute instructions accordingly, improving toggle execution accuracy by over 30%.

AIBullishMicrosoft Research Blog ยท Dec 106/103
๐Ÿง 

Promptions helps make AI prompting more precise with dynamic UI controls

Microsoft Research introduces Promptions, a tool that helps developers add dynamic UI controls to chat interfaces for more precise AI prompting. The system allows users to guide generative AI responses through intuitive controls rather than complex written instructions.

AIBullisharXiv โ€“ CS AI ยท Mar 95/10
๐Ÿง 

Lexara: A User-Centered Toolkit for Evaluating Large Language Models for Conversational Visual Analytics

Researchers have developed Lexara, a user-centered toolkit for evaluating Large Language Models in Conversational Visual Analytics applications. The toolkit addresses current evaluation challenges by providing interpretable metrics for both visualization and language quality, along with real-world test cases and an interactive interface that doesn't require programming expertise.

AINeutralarXiv โ€“ CS AI ยท Mar 34/108
๐Ÿง 

Texterial: A Text-as-Material Interaction Paradigm for LLM-Mediated Writing

Researchers introduce Texterial, a new interaction paradigm that reimagines text as a malleable material that can be sculpted like clay or cultivated like plants in AI-assisted writing tools. The study presents two technical probes demonstrating gestural text refinement and serendipitous idea growth, expanding the design space for LLM-mediated writing interfaces.

AINeutralarXiv โ€“ CS AI ยท Mar 34/106
๐Ÿง 

PleaSQLarify: Visual Pragmatic Repair for Natural Language Database Querying

Researchers present PleaSQLarify, a visual interface system that helps resolve ambiguity in natural language database queries through pragmatic repair - an incremental clarification process. The system uses interpretable decision variables and visual exploration to help users efficiently disambiguate queries when their intent doesn't match system interpretation.