y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#user-interface News & Analysis

9 articles tagged with #user-interface. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

9 articles
AIBullisharXiv – CS AI · Apr 147/10
🧠

Generative UI: LLMs are Effective UI Generators

Researchers demonstrate that modern LLMs can robustly generate custom user interfaces directly from prompts, moving beyond static markdown outputs. The approach shows emergent capabilities with results comparable to human-crafted designs in 50% of cases, accompanied by the release of PAGEN, a dataset for evaluating generative UI implementations.

AIBullishGoogle DeepMind Blog · Oct 237/106
🧠

Introducing the Gemini 2.5 Computer Use model

Google introduces Gemini 2.5 Computer Use model, a specialized AI system built on Gemini 2.5 Pro that enables agents to interact with user interfaces. The model is currently available in preview through Google's API for developers and businesses.

AINeutralarXiv – CS AI · 18h ago6/10
🧠

Neither Replacement nor Panacea: Comparing LLM-Based Conversational and Graphical Decision Support in Industrial Tasks

A study comparing LLM-based conversational interfaces with traditional dashboards for industrial decision-making found that conversational AI reduces perceived mental workload and speeds up simple tasks, but provides no consistent advantage in decision accuracy and loses effectiveness as task complexity increases. The research suggests conversational agents complement rather than replace visual dashboards for manufacturing decision support.

AIBullisharXiv – CS AI · Apr 66/10
🧠

Attribution Gradients: Incrementally Unfolding Citations for Critical Examination of Attributed AI Answers

Researchers have developed "attribution gradients," a new technique to improve AI answer engines by making citations more informative and easier to evaluate. The method consolidates evidence amounts, supporting/contradictory excerpts, and contextual explanations in one place, while also allowing users to explore second-degree citations without leaving the interface.

AIBullisharXiv – CS AI · Mar 36/103
🧠

See, Think, Act: Teaching Multimodal Agents to Effectively Interact with GUI by Identifying Toggles

Researchers have developed State-aware Reasoning (StaR), a new multimodal AI method that significantly improves AI agents' ability to interact with graphical user interfaces, particularly with toggle controls. The method enables agents to better perceive current states and execute instructions accordingly, improving toggle execution accuracy by over 30%.

AIBullishMicrosoft Research Blog · Dec 106/103
🧠

Promptions helps make AI prompting more precise with dynamic UI controls

Microsoft Research introduces Promptions, a tool that helps developers add dynamic UI controls to chat interfaces for more precise AI prompting. The system allows users to guide generative AI responses through intuitive controls rather than complex written instructions.

AIBullisharXiv – CS AI · Mar 95/10
🧠

Lexara: A User-Centered Toolkit for Evaluating Large Language Models for Conversational Visual Analytics

Researchers have developed Lexara, a user-centered toolkit for evaluating Large Language Models in Conversational Visual Analytics applications. The toolkit addresses current evaluation challenges by providing interpretable metrics for both visualization and language quality, along with real-world test cases and an interactive interface that doesn't require programming expertise.

AINeutralarXiv – CS AI · Mar 34/108
🧠

Texterial: A Text-as-Material Interaction Paradigm for LLM-Mediated Writing

Researchers introduce Texterial, a new interaction paradigm that reimagines text as a malleable material that can be sculpted like clay or cultivated like plants in AI-assisted writing tools. The study presents two technical probes demonstrating gestural text refinement and serendipitous idea growth, expanding the design space for LLM-mediated writing interfaces.

AINeutralarXiv – CS AI · Mar 34/106
🧠

PleaSQLarify: Visual Pragmatic Repair for Natural Language Database Querying

Researchers present PleaSQLarify, a visual interface system that helps resolve ambiguity in natural language database queries through pragmatic repair - an incremental clarification process. The system uses interpretable decision variables and visual exploration to help users efficiently disambiguate queries when their intent doesn't match system interpretation.