Cognition Envelopes for Bounded AI Reasoning in Autonomous UAS OperationsFull Paper
Cyber-physical systems increasingly rely on foundational models, such as Large Language Models (LLMs) and Vision-Language Models (VLMs) to increase autonomy through enhanced perception, inference, and planning. However, these models also introduce new types of errors, such as hallucinations, over-generalizations, and context misalignments, resulting in incorrect and flawed decisions. To address this, we introduce the concept of Cognition Envelopes, designed to establish reasoning boundaries that constrain AI-generated decisions while complementing the use of meta-cognition and traditional safety envelopes. As with safety envelopes, Cognition Envelopes require practical guidelines and systematic processes for their definition, validation, and assurance. In this paper we describe an LLM/VLM-supported pipeline for dynamic clue analysis within the domain of small autonomous Uncrewed Aerial Systems deployed on Search and Rescue (SAR) missions, and a Cognition Envelope based on probabilistic reasoning and resource analysis. We evaluate the approach through assessing decisions made by our Clue Analysis Pipeline in a series of SAR missions. Finally, we identify key software engineering challenges for systematically designing, implementing, and validating Cognition Envelopes for AI-supported decisions in cyber-physical systems.
Mon 13 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
16:00 - 17:30 | Engineering GenAI SystemsIndustry Track / Research Track / CAIN Program at Oceania X Chair(s): Karthik Vaidhyanathan IIIT Hyderabad | ||
16:00 8mShort-paper | Graphical-Probabilistic Modeling of Generative Flows in LLM-Native Software SystemsShort Paper Research Track | ||
16:08 12mFull-paper | Cognition Envelopes for Bounded AI Reasoning in Autonomous UAS OperationsFull Paper Research Track Pedro Antonio Alarcon Granadeno University of Notre Dame, Arturo Miguel Russell Bernal University of Notre Dame, Sofia Nelson University of Notre Dame, Demetrius Hernandez University of Notre Dame, Maureen Petterson University of Notre Dame, Michael Murphy University of Notre Dame, Walter J. Scheirer University of Notre Dame, Jane Cleland-Huang University of Notre Dame Pre-print | ||
16:20 8mIndustry talk | Current challenges and new prospects in software engineering practices for Geospatial AIShort Paper Industry Track | ||
16:28 8mShort-paper | The Physics of AIShort Paper Research Track Scott Barnett Applied Artificial Intelligence Initiative, Deakin University, Aleksandar Pasquini Deakin University, Stefanus Kurniawan Deakin University, Shangeetha Sivasothy Applied Artificial Intelligence Institute, Deakin University, Rhys Hill Deakin University, Rajesh Vasa Deakin University, Australia | ||
16:36 12mFull-paper | RAG-DIVE: A Dynamic Approach for Multi-Turn Dialogue Evaluation in Retrieval-Augmented GenerationFull Paper Research Track Lorenz Brehme University of Innsbruck, Austria, Benedikt Dornauer University of Innsbruck; University of Cologne, Jan-Henrik Böttcher University of Hildesheim, Klaus Schmid University of Hildesheim, Ruth Breu University of Innsbruck, Mircea-Cristian Racasan c.c.com Moser GmbH, 8074 Grambach, Austria | ||
16:48 8mShort-paper | Assisting Developers in the Selection of Generative AI ModelsShort Paper Research Track Raquel Berenguer Mueller Universitat Oberta de Catalunya, Sergio Cobos IN3 - UOC, Javier Luis Cánovas Izquierdo Universitat Oberta de Catalunya, Robert Clarisó Universitat Oberta de Catalunya | ||
16:56 19mLive Q&A | Joint Q&A (Engineering GenAI Systems) CAIN Program | ||
17:15 15mDay closing | Closing CAIN Program | ||