8 articles tagged with #user-interface. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
AIBullisharXiv โ CS AI ยท 3d ago7/10
๐ง Researchers demonstrate that modern LLMs can robustly generate custom user interfaces directly from prompts, moving beyond static markdown outputs. The approach shows emergent capabilities with results comparable to human-crafted designs in 50% of cases, accompanied by the release of PAGEN, a dataset for evaluating generative UI implementations.
AIBullishGoogle DeepMind Blog ยท Oct 237/106
๐ง Google introduces Gemini 2.5 Computer Use model, a specialized AI system built on Gemini 2.5 Pro that enables agents to interact with user interfaces. The model is currently available in preview through Google's API for developers and businesses.
AIBullisharXiv โ CS AI ยท Apr 66/10
๐ง Researchers have developed "attribution gradients," a new technique to improve AI answer engines by making citations more informative and easier to evaluate. The method consolidates evidence amounts, supporting/contradictory excerpts, and contextual explanations in one place, while also allowing users to explore second-degree citations without leaving the interface.
AIBullisharXiv โ CS AI ยท Mar 36/103
๐ง Researchers have developed State-aware Reasoning (StaR), a new multimodal AI method that significantly improves AI agents' ability to interact with graphical user interfaces, particularly with toggle controls. The method enables agents to better perceive current states and execute instructions accordingly, improving toggle execution accuracy by over 30%.
AIBullishMicrosoft Research Blog ยท Dec 106/103
๐ง Microsoft Research introduces Promptions, a tool that helps developers add dynamic UI controls to chat interfaces for more precise AI prompting. The system allows users to guide generative AI responses through intuitive controls rather than complex written instructions.
AIBullisharXiv โ CS AI ยท Mar 95/10
๐ง Researchers have developed Lexara, a user-centered toolkit for evaluating Large Language Models in Conversational Visual Analytics applications. The toolkit addresses current evaluation challenges by providing interpretable metrics for both visualization and language quality, along with real-world test cases and an interactive interface that doesn't require programming expertise.
AINeutralarXiv โ CS AI ยท Mar 34/108
๐ง Researchers introduce Texterial, a new interaction paradigm that reimagines text as a malleable material that can be sculpted like clay or cultivated like plants in AI-assisted writing tools. The study presents two technical probes demonstrating gestural text refinement and serendipitous idea growth, expanding the design space for LLM-mediated writing interfaces.
AINeutralarXiv โ CS AI ยท Mar 34/106
๐ง Researchers present PleaSQLarify, a visual interface system that helps resolve ambiguity in natural language database queries through pragmatic repair - an incremental clarification process. The system uses interpretable decision variables and visual exploration to help users efficiently disambiguate queries when their intent doesn't match system interpretation.