Cocobo: Exploring Large Language Models as the Engine for End-User Robot Programming
End-user development allows everyday users to tailor service robots or applications to their needs. One userfriendly approach is natural language programming. However, it encounters challenges such as an expansive user expression space and limited support for debugging and editing, which restrict its application in end-user programming. The emergence of large language models (LLMs) offers promising avenues for the translation and interpretation between human language instructions and the code executed by robots, but their application in end-user programming systems requires further study. We introduce Cocobo, a natural language programming system with interactive diagrams powered by LLMs. Cocobo employs LLMs to understand users’ authoring intentions, generate and explain robot programs, and facilitate the conversion between executable code and flowchart representations. Our user study shows that Cocobo has a low learning curve, enabling even users with zero coding experience to customize robot programs successfully.
Tue 3 SepDisplayed time zone: London change
14:00 - 15:30 | Session 2: End User Programming + EducationResearch Papers at LT1 Chair(s): Alexander Repenning University of Colorado, Boulder | ||
14:00 20mTalk | Investigating the Usability of Coding Applications for Children: Insights from Teacher Interviews Research Papers Mika Morgan University of North Texas, Stephanie Ludi University of North Texas, Katherine Gash University of North Texas, Thien Truong University of North Texas | ||
14:20 20mTalk | Game Elements to Engage Students Learning the Open Source Software Contribution Process Research Papers Italo Santos Northern Arizona University, Katia Felizardo Federal Technological University of Paraná, Igor Steinmacher Northern Arizona University, Marco Gerosa Northern Arizona University Pre-print | ||
14:40 20mTalk | Physical vs. Virtual Representations Within Concreteness Fading for Primary School Computing Research Papers Anthony Trory University of Sussex, Kate Howland University of Sussex, Judith Good University of Amsterdam, Benedict du Boulay University of Sussex | ||
15:00 15mShort-paper | The Paradox of Spreadsheet Self-Efficacy: Social Incentives for Informal Knowledge Sharing in End-User Programming Research Papers Qing (Nancy) Xia University College London, Advait Sarkar Microsoft Research and University of Cambridge, Duncan Brumby University College London, Anna Cox University College London | ||
15:15 15mShort-paper | Cocobo: Exploring Large Language Models as the Engine for End-User Robot Programming Research Papers Yate Ge College of Design and Innovation, Tongji University, Shanghai, China, Yi Dai Shanghai Research Institute for intelligent Autonomous Systems, Tongji university, Shanghai, China, Run Shan College of Design and Innovation, Tongji University, Shanghai, China, Kechun Li College of Design and Innovation, Tongji University, Shanghai, China, Yuanda Hu College of Design and Innovation, Tongji University, Shanghai, China, Xiaohua Sun School of Design, Southern University of Science and Technology, Shenzhen, China Pre-print | ||