Academic Journal
Chat Modeling: Interaction-Enhanced Agent Framework for Visualizing Literature-Grounded Biological Structures.
| Τίτλος: | Chat Modeling: Interaction-Enhanced Agent Framework for Visualizing Literature-Grounded Biological Structures. |
|---|---|
| Συγγραφείς: | Jia D, Wang Y, Viola I |
| Πηγή: | IEEE transactions on visualization and computer graphics [IEEE Trans Vis Comput Graph] 2026 Aug; Vol. 32 (8), pp. 7453-7467. |
| Τύπος έκδοσης: | Journal Article |
| Γλώσσα: | English |
| Στοιχεία περιοδικού: | Publisher: IEEE Computer Society Country of Publication: United States NLM ID: 9891704 Publication Model: Print Cited Medium: Internet ISSN: 1941-0506 (Electronic) Linking ISSN: 10772626 NLM ISO Abbreviation: IEEE Trans Vis Comput Graph Subsets: MEDLINE |
| Imprint Name(s): | Original Publication: New York, NY : IEEE Computer Society, c1995- |
| Ιατρικοί όροι (MeSH): | Imaging, Three-Dimensional*/methods , Computer Graphics* , User-Computer Interface* , Models, Biological*, Software ; Humans |
| Περίληψη: | Bioscientists frequently seek to visualize the biological systems they have empirically characterized and reported in the literature. Realizing such visualizations requires biological structure modeling, an inherently complex process that demands both biological and geometric understanding. This paper addresses the problem of constructing such 3D models for visualization. In this paper, we introduce a novel agent framework that mitigates the challenges of operating 3D modeling software by transforming user inputs, including natural language descriptions, research publication content, and textual descriptions of the existing objects and structures in the current scene, into modeling operations in a structured JSON format and final 3D results. The major technical contribution lies in the collaborative agent design that simultaneously supports model planning, execution, and novel user interaction design, such as interactive modeling execution and dynamic widget generation that fuse text and mouse interaction within the chat window. The framework further incorporates a customized modeling memory to enhance user interaction, featuring components such as personalized memory management, feedback collection, and skill library design. This modeling memory is leveraged to enable improved 3D modeling performance over time. The quantitative evaluation on our collected dataset showcases the effectiveness of our framework. We also develop a prototype tool, Chat Modeling, and demonstrate its usage through two modeling case studies. Our user study and expert interviews highlight the potential of our approach for use in scientific workflows. |
| Entry Date(s): | Date Created: 20260519 Date Completed: 20260702 Latest Revision: 20260702 |
| Update Code: | 20260703 |
| DOI: | 10.1109/TVCG.2026.3694805 |
| PMID: | 42154686 |
| Βάση Δεδομένων: | MEDLINE |
καταχωρήστε σχόλιο πρώτοι!