AI | VALIANT /valiant ý Advanced Lab for Immersive AI Translation (VALIANT) Mon, 24 Aug 2026 19:21:59 +0000 en-US hourly 1 Patients’ perceptions of ethical issues in semi-autonomous robot-assisted surgery /valiant/2026/08/24/patients-perceptions-of-ethical-issues-in-semi-autonomous-robot-assisted-surgery/ Mon, 24 Aug 2026 18:56:41 +0000 /valiant/?p=7355 Wu, Jie Ying; Varnado, Sydney; Leon, Ashley; Carlson, Camella J.; Langerman, Alexander J.; Novak, Laurie L.; Houston, Michelle L.; Feurer, Irene D.; Gordon, Elisa J. (2026). . Surgical Endoscopy.

Artificial intelligence is allowing surgical robots to perform some tasks with limited direct control from surgeons. However, patients’ willingness to undergo surgery involving semi-autonomous robots may influence how widely these technologies are adopted. This study explored patients’ views about the ethical concerns surrounding semi-autonomous robot-assisted surgery and how these concerns affect their willingness to undergo such procedures. Researchers interviewed 50 adults who had undergone surgery within the previous three years, either without a robot or with a robot that was not autonomous. Overall, 56% said they would be willing to undergo semi-autonomous robot-assisted surgery, although willingness depended on which parts of the procedure the robot controlled. Four main factors shaped participants’ views: having enough information to make an informed decision, concerns about new risks introduced by robotic autonomy, trust and the relationship between patients and surgeons, and the potential benefits of robotic technology. Patients also considered the balance of control between the surgeon and robot important. These findings suggest that many patients may be open to semi-autonomous robot-assisted surgery, but acceptance depends on clear informed consent, confidence in safety, trust in surgeons, and understanding the technology’s potential benefits.

Fig 2 . Percent of participants by their willingness to undergo semi-autonomous robot-assisted surgery and by the type of control the robot would have over the different types of surgical processes

]]>
Privacy and Security Throughout the Health Data Life Cycle: From Primary Care to Research Networks /valiant/2026/08/24/privacy-and-security-throughout-the-health-data-life-cycle-from-primary-care-to-research-networks/ Mon, 24 Aug 2026 18:49:08 +0000 /valiant/?p=7345 Malin, Bradley A.; Yan, Chao; Bonomi, Luca. (2026). . Annual Review of Biomedical Data Science, 9(1), 47–67.

Health data are increasingly collected and shared across healthcare, research, and artificial intelligence (AI) applications, creating new opportunities for medical discovery and clinical decision-making. At the same time, these uses raise growing concerns about privacy, security, and trust. This review examines risks and protections throughout the health data life cycle, from their initial collection and use in healthcare to their later use in research and AI development. We discuss how regulations, organizational practices, and technology influence data protection, as well as emerging risks such as unintended disclosure of sensitive information through AI tools. We review methods for protecting health data, including controlling and monitoring access, assessing the risk that individuals could be re-identified, using statistical privacy techniques such as differential privacy, and generating synthetic data that resemble real data without directly representing individual patients. We also discuss approaches that allow organizations to collaborate without directly sharing sensitive data, including federated learning and secure cryptographic methods. These approaches involve important trade-offs between protecting privacy and preserving the usefulness of data. Overall, greater standardization, transparency, and practical guidance are needed to strengthen privacy and trust while supporting responsible use of health data in healthcare, research, and AI.

Figure 1Simplified representation of different stages in the health data flow with potential risks and mitigation strategies. In the data-generation stage, health data are generated by individuals (e.g., patients). In the primary use stage (pink), data are collected for care by healthcare organizations or third-party systems. In the secondary use stage (yellow), data are shared and analyzed to accelerate knowledge discovery.

]]>
Retaining Emotions, Removing Identity: Valence-Arousal Guided De-Identification for Educational Applications /valiant/2026/07/28/retaining-emotions-removing-identity-valence-arousal-guided-de-identification-for-educational-applications/ Tue, 28 Jul 2026 20:58:05 +0000 /valiant/?p=7240

Ashwin, T. S.; Sanda, Nihar; Coursey, Austin; Gupta, Vaibhav; Biswas, Gautam. (2026)..Proceedings of the ACM Symposium on Applied Computing, 87–94.

Artificial intelligence (AI) systems are increasingly being used to analyze students’ facial expressions to better understand engagement and emotions in classroom settings. However, using images of children raises important privacy and ethical concerns, making it essential to protect students’ identities without losing the emotional information needed for analysis. This study presents a new facede-identificationmethod that replaces a person’s face with a realistic synthetic face while preserving the original facial expressions. The approach usesStyleGAN, an AI model for generating realistic images, to select synthetic faces that match the emotional characteristics of the original face while removing identifying features. The method was evaluated using a real-world dataset of 40 middle school students and the publicly availableDAiSEEdataset. Compared with conventional anonymization techniques, it achieved nearly 90% accuracy in protecting identity while maintaining high fidelity of facial expressions, with more than 92% agreement in manual evaluations and minimal loss of facial movement information. These findings suggest that the approach can better balance privacy protection with emotion recognition, supporting the development of privacy-preserving AI tools for classroom analytics and educational research.

]]>
An evaluation of ambient artificial intelligence scribes at two academic medical centers /valiant/2026/07/28/an-evaluation-of-ambient-artificial-intelligence-scribes-at-two-academic-medical-centers/ Tue, 28 Jul 2026 18:30:53 +0000 /valiant/?p=7170

Franklin, Jacob; Chu, Ling; McDonald, Samuel A.; Turer, Robert W.; Webb, Janet; Steitz, Bryan D.; Yi, Haoyang; Chen, Qingxia; McCoy, Allison B.; Nall, Carolynn; Chen, Catherine; Rousseau, Justin F.; Lehmann, Christoph U.; Willett, Duwayne L.; Kumah-Crystal, Yaa A.; Mize, Dara E. (2026)..Discover Artificial Intelligence, 6(1), 550.

Ambient AI scribesare designed to reduce the time clinicians spend documenting patient visits by automatically generating clinical notes during appointments. To better understand how these tools perform in real-world practice, this study evaluatedDragon Copilotacross two academic medical centers. A total of 120 physicians and advanced practice providers completed surveys assessing the system’s usability, documentation quality, and overall satisfaction. Overall, clinicians rated Dragon Copilot as highly usable and reported that it fit well into their clinical workflows. Many participants said the tool reduced the time spent on documentation, improved their ability to focus on patients during visits, and enhanced the overall patient encounter. However, the AI scribe did not eliminate broader challenges such as burnout, frustration with electronic health records, work-life balance, or cognitive workload. Overall satisfaction with the tool was positive but mixed, indicating that experiences varied among users. As one of the first multi-site evaluations of an ambient AI scribe, the findings suggest that Dragon Copilot can improve documentation workflows and support clinician well-being, while also highlighting that it is not a complete solution to the broader challenges clinicians face in everyday practice.

]]>
HAT-SAM3: endoscopy-aware adaptation of a foundation segmentation model for generalizable polyp segmentation /valiant/2026/07/28/hat-sam3-endoscopy-aware-adaptation-of-a-foundation-segmentation-model-for-generalizable-polyp-segmentation/ Tue, 28 Jul 2026 15:56:26 +0000 /valiant/?p=7153 Li, Hao; Masood, Anum. (2026)..The Visual Computer, 42(9), 371.

This study addresses the challenge ofautomatic polyp segmentation, the process of identifying and outlining polyps in colonoscopy images. While many artificial intelligence (AI) models perform well on the data they were trained on, they often struggle when tested on images from different hospitals or datasets because polyps can vary widely in size, shape, color, and appearance. Differences in image quality, such as glare from reflected light, blur, fluid, and changes in lighting during colonoscopy, add to this challenge. To improve performance across different datasets, the researchers developedHAT-SAM3, an adaptation of theSegment Anything Model 3 (SAM 3), a large pre-trained AI model originally designed for image segmentation. HAT-SAM3 uses a training technique calledhighlight-aware training (HAT), which helps the model better handle bright reflections commonly seen in endoscopy images without changing how the model operates during testing. When evaluated on five publicly available datasets, HAT-SAM3 achieved an averageDice score(a measure of how closely the model’s predicted outlines match the true polyp boundaries) of 0.884 and produced the best reported results on four of the five datasets. In additional testing, where the model was trained on one dataset and evaluated on three completely separate datasets without further training, HAT-SAM3 consistently outperformed the strongest previously reported method. These results suggest that adapting a pre-trained foundation model with endoscopy-specific training techniques can improve the accuracy and reliability of automated polyp segmentation across a wide range of clinical datasets. The researchers have also made their code publicly available to support future research.

 

Fig 1: Motivation of HAT-SAM3. A task-specific polyp segmenter can perform well when training and test images come from the same visual distribution, but degrade under cross-domain changes in illumination, blur, specular reflection, and polyp appearance. HAT-SAM3 uses a broad segmentation prior with endoscopy-aware adaptation to improve cross-domain polyp segmentation

]]>
Factors influencing the effectiveness of artificial intelligence-assisted decision-making in medicine: a scoping review /valiant/2026/05/26/factors-influencing-the-effectiveness-of-artificial-intelligence-assisted-decision-making-in-medicine-a-scoping-review/ Tue, 26 May 2026 21:23:41 +0000 /valiant/?p=6794 Jackson, Nicholas J.; Brown, Katherine E.; Miller, Rachael.; Murrow, Matthew.; Cauley, Michael R.; Collins, Benjamin X.; Novak, Laurie L.; Benda, Natalie C.; Ancker, Jessica S. (2026)..Journal of the American Medical Informatics Association, 33(5), 1054–1064.

Research on artificial intelligence tools that help clinicians make decisions has had mixed results: sometimes these tools improve decision-making, and sometimes they do not, and it is not always clear why. This review looked at what factors affect how well AI-based clinical decision-support systems, or AI-CDS, work in medicine. The authors searched three medical databases and found 45 relevant studies out of 5,850 screened articles. They focused on how both clinician factors and technology design features influenced three things: how clinicians feel about AI, whether they accept AI recommendations, and how well they perform when using AI. The review found that experienced clinicians may gain less from AI support than less experienced clinicians, although the results were not consistent across studies. It also found that explainable AI, meaning AI that gives reasons for its suggestions, can increase trust, but it may also lead clinicians to trust incorrect recommendations too much, which can hurt performance when humans and AI work together. Clinicians’ existing attitudes toward AI also influenced whether they accepted its advice. Overall, the review suggests that future research should focus on “appropriate trust,” meaning clinicians should rely on AI only when the advice is actually trustworthy, rather than simply trying to increase trust in AI overall.

Figure 1.

PRISMA diagram for study inclusion.

]]>
Policy Search, Retrieval, and Composition via Task Similarity in Collaborative Agentic Systems /valiant/2026/04/29/policy-search-retrieval-and-composition-via-task-similarity-in-collaborative-agentic-systems/ Wed, 29 Apr 2026 03:52:07 +0000 /valiant/?p=6564 Nath, Saptarshi; Peridis, Christos; Benjamin, Eseoghene; Liu, Xinran; Kolouri, Soheil; Kinnell, Peter; Li, Zexin; Liu, Cong; Dora, Shirin; Soltoggio, Andrea (2026)..Proceedings of the AAAI Conference on Artificial Intelligence, 40(29), 24504–24512.

Agentic AIrefers to systems that can set their own goals, adapt to new situations, and improve over time through experience. This study explores how such systems can learn more efficiently by sharing knowledge with one another, instead of learning everything from scratch. In particular, it looks at how an AI agent can decidewhat knowledge to reuse, which other agents to learn from, and how to incorporate that knowledgeinto its own decision-making process (often called apolicy, or strategy for choosing actions).

The researchers introduce a new method calledMOSAIC (Modular Sharing and Composition in Collective Learning). This approach allows agents to compare tasks using mathematical representations, select useful knowledge from others based on performance and similarity, and integrate it using flexible, modular neural network components. In simple terms, agents can “borrow” and adapt pieces of what others have already learned.

The results show that agents using MOSAIC learn faster and perform better than those learning alone or sharing information indiscriminately. In some cases, they can even solve problems that individual agents cannot. The study also finds that targeted, selective sharing reduces confusion between tasks and leads to a kind ofself-organization, where agents working on easier problems help others tackle more complex ones. Overall, this work highlights the potential of collaborative learning strategies to make AI systems more efficient and adaptable.

]]>
ComCat: Expertise-Guided Context Generation to Enhance Code Comprehension /valiant/2026/03/26/comcat-expertise-guided-context-generation-to-enhance-code-comprehension/ Thu, 26 Mar 2026 19:50:56 +0000 /valiant/?p=6346

Skyler Grandel; Scott Thomas Andersen; Yu Huang; Kevin Leach (2026)..ACM Transactions on Software Engineering and Methodology, 35(3), Article 82.

Software maintenance makes up a large share of the total cost of software over its lifetime, and a big part of that cost comes from understanding existing code. One way to make code easier to understand is through documentation, especially comments that summarize what the code does or explain why it does it. In this work, we introduce ComCat, a system that uses large language models (LLMs, which are AI models trained on very large amounts of text) together with expert guidance to automatically generate useful comments for source code. ComCat is designed to choose the most relevant and informative comment for a specific piece of code. For C/C++ files, the system works in three steps: it first finds places where comments would be most helpful, then decides what kind of comment is needed, and finally writes the comment. In a study with human participants, ComCat’s comments improved code understanding on three software engineering tasks by up to 13% for most participants. The generated comments were also judged to be at least as accurate and readable as human-written comments, and they were preferred over standard ChatGPT-generated comments for up to 92% of code snippets. We also released a dataset containing code snippets, human-written comments, and human-labeled comment categories. Overall, ComCat shows that LLMs can be used to meaningfully improve how well people understand code.

Fig. 1.

ComCatpipeline and study procedure. We use three instances of HSR to informComCat’s design (1) and evaluate developer performance (2) and preference (3) with our tool.ComCattakes C/C++ code as input, using a Code Parser to identify code Snippets to be commented. These Snippets are classified, and the class of each Snippet is used in combination with our Template Catalog to create a prompt for each Snippet. These prompt ChatGPT, which outputs the commented code. This pipeline is informed by developer expertise, but it is fully automated and requires no human intervention.

]]>
A Vision-Based Deep Learning Framework for Monitoring and Recognition of Chemical Laboratory Operations /valiant/2026/03/26/a-vision-based-deep-learning-framework-for-monitoring-and-recognition-of-chemical-laboratory-operations/ Thu, 26 Mar 2026 19:09:53 +0000 /valiant/?p=6328 Chuntao Guo; Jing Lin; Shunxing Bao; Xin Liu; Yaru Wang; Yunlin Chen (2026)..Sensors, 26(4), 1106.

This study explores a way to automatically monitor how laboratory tasks are performed, focusing on pipetting—a common technique where small amounts of liquid are transferred using a pipette. Ensuring that such procedures are done correctly is important for safety and for producing reliable results, but it is difficult to track in real time because it involves complex hand movements, tool use, and multiple steps that vary between users. To address this, the researchers developed a vision-based artificial intelligence system that uses video recordings instead of physical sensors. The system first applies a YOLO-based model (a type of object detection algorithm) to identify human body positions and interactions with the pipette. It then uses a bidirectional long short-term memory (LSTM) network, a type of deep learning model designed to analyze sequences over time, to understand how the actions unfold step by step.

The results show that this approach can successfully distinguish between correct (standard) and incorrect (non-standard) pipetting behaviors, including different types of errors, and performs better than methods that analyze images one frame at a time without considering motion over time. Overall, the study demonstrates that AI systems using video analysis can provide a practical, non-contact way to monitor laboratory techniques, potentially improving quality control and extending to other manual procedures in scientific labs.

Figure 1.Representative incorrect pipetting behaviors and key challenges for vision-based QA in chemical laboratory environments.

]]>
Monitoring morphometric drift in lifelong learning segmentation of the spinal cord /valiant/2026/03/26/monitoring-morphometric-drift-in-lifelong-learning-segmentation-of-the-spinal-cord/ Thu, 26 Mar 2026 19:08:20 +0000 /valiant/?p=6319 Enamundram Naga Karthik; Sandrine Bédard; Jan Valošek; Christoph S. Aigner; Elise Bannier; Josef Bednařík; Virginie Callot; Anna Combes; Armin Curt; Gergely David; Falk Eippert; Lynn Farner; Michael G. Fehlings; Patrick Freund; Tobias Granberg; Cristina Granziera; Ulrike Horn; Tomáš Horák; Suzanne Humphreys; Markus Hupp; Anne Kerbrat; Nawal Kinany; Shannon Kolind; Petr Kudlička; Anna Lebret; Lisa Eunyoung Lee; Caterina Mainero; Allan R. Martin; Megan McGrath; Govind Nair; Kristin P. O’Grady; Jiwon Oh; Russell Ouellette; Nikolai Pfender; Dario Pfyffer; Pierre-François Pradat; Alexandre Prat; Emanuele Pravatà; Daniel S. Reich; Ilaria Ricchi; Naama Rotem-Kohavi; Simon Schading-Sassenhausen; Maryam Seif; Andrew Smith; Seth A. Smith; Grace Sweeney; Roger Tam; Anthony Traboulsee; Constantina Andrada Treaba; Charidimos Tsagkas; Zachary Vavasour; Dimitri Van De Ville; Kenneth Arnold Weber II; Sarath Chandar; Julien Cohen-Adad (2026)..Imaging Neuroscience, 4, Article a.1105.

This study looks at how measurements of the spinal cord—such as itscross-sectional area(the size of the cord when viewed in a slice)—can be used as important indicators (biomarkers) for diagnosing and tracking neurological diseases like multiple sclerosis or spinal cord compression. Modern artificial intelligence methods can automatically identify and outline (segment) the spinal cord in MRI scans, but it is unclear whether these measurements stay consistent as models are updated with new data over time. This consistency is especially important when building “normal” reference values from healthy individuals.

To address this, the researchers developed a spinal cord segmentation model trained on a large and diverse dataset collected from 75 sites and over 1,600 participants, covering different MRI types and various spinal cord conditions. They also created a “lifelong learning” system that continuously monitors changes in measurements (calledmorphometric drift) whenever the model is updated. This system automatically runs through a workflow (via GitHub Actions, an automated coding tool) to track how measurements evolve over time.

The results showed that the new model performs very well, accurately identifying the spinal cord even in challenging cases such as severe compression or tissue damage, with a high Dice score (a measure of how closely the model’s segmentation matches the true anatomy) of 0.95. The monitoring system also proved useful for quickly detecting any changes in measurements between model versions. Importantly, the study found that updates to the model caused only minimal shifts in spinal cord measurements, meaning the results remain stable and reliable. This allowed the researchers to safely update an existing database of normal spinal cord measurements. Overall, this work provides a reliable and transparent way to maintain consistency in AI-based medical measurements as models evolve.

Fig 1

Overview of the dataset and image characteristics. Representative axial slices of nine contrasts and the total of images used for each contrast in brackets, the orientation (axial/sagittal) along with the median resolution of images. The respective doughnut chart illustrates the proportion of clinical status among the scanned participants, including healthy controls (HC), patients with radiologically isolated syndrome (RIS), patients with multiple sclerosis (MS), and their different phenotypes, including primary progressive (PPMS) and relapsing-remitting (RRMS), patients with amyotrophic lateral sclerosis (ALS), patients with neuromyelitis optica spectrum disorder (NMOSD), pre-decompression acute traumatic SCI (AcuteSCI), post-decompression traumatic spinal cord injury (SCI), degenerative cervical myelopathy (DCM), and syringomyelia (SYR; not shown). Labels indicate the phenotype associated with the patient, with their respective colors shared across contrast sets.

]]>