LLMAppHub: A Large Collection of LLM-based Applications for the Research Community
Tue 24 Jun 2025 15:30 - 16:00 at Space - Poster Session 2 Chair(s): Earl T. Barr
With the increasing adoption of large language models (LLMs), a growing number of applications leveraging these models have emerged. However, LLM-based applications face significant security challenges. The OWASP Top 10 for LLMs has identified critical vulnerabilities, including prompt injections, data leakage, and unauthorized code execution. While previous research has explored specific security issues, these studies often focus on a narrow range of problems and a small number of applications, leaving gaps in our understanding of security threats in real-world LLM-based applications. To facilitate research in this field, an automated tool was developed to systematically collect LLM applications and construct a dataset, particularly focusing on independent applications that leverage LLM APIs or frameworks. Our dataset includes 33,001 repositories, providing a broad and representative foundation for security analysis. Both our dataset and tool are publicly available to support further research and foster advancements in the security and development of LLM-based applications.
Tue 24 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
10:00 - 10:30 | |||
10:00 30mPoster | Logprobs Know Uncertainty: Fighting LLM Hallucinations Posters Mengyao Xu ByteDance, Qiaoyin Gan Institute of Computing Technology, Chinese Academy of Sciences, Zhenyu Zhu ByteDance, Haojun Qin ByteDance | ||
10:00 30mPoster | Symbolic Execution Based Automatic Performance Optimization for MPI Programs Posters Zheng Bian National University of Defense Technology, Zhenbang Chen College of Computer, National University of Defense Technology, Ji Wang National University of Defense Technology | ||
10:00 30mPoster | Autonomous agents in software development for information retrieval using LLM models Posters Aneta Poniszewska-Maranda Institute of Information Technology, Lodz University of Technology, Maciej Kopa Lodz University of Technology | ||
10:00 30mPoster | Detecting Data Races in Language Virtual Machines with RaceHunter. Lessons Learned. Posters Pavel Andrianov ISP RAS Research Center for Trusted Artificial Intelligence, Vadim Mutilin ISP RAS Research Center for Trusted Artificial Intelligence, Evgeny Gerlits Ivannikov Institute for System Programming of the Russian Academy of Sciences | ||
10:00 30mPoster | Enhancing Deep Learning Transpilation with LLMs: Automation and Semantic Consistency Posters Xingpei Li National University of Defense Technology, China, Zhijie Jiang National University of Defense Technology, Zhouyang Jia National University of Defense Technology, Yuanliang Zhang National University of Defense Technology, Si Zheng National University of Defense Technology, Haifang Zhou National University of Defense Technology, Shanshan Li National University of Defense Technology | ||
10:00 30mPoster | Pn4PLC: Verification of Software Upgrade for PLC Code Posters | ||
10:00 30mPoster | SODAOpt: Socio-Demographic and Textual Adaptive Fusion for Optimizing Developer Task Assignment Posters Karina Romanova Al Talent Hub, ITMO University, Wildberries, Sergey Senichev ITMO University, MTS AI, Lina Veltman Wildberries, Ivan Nasonov Moscow Institute of Physics and Technology, Andrey Kuznetsov AIRI, Ilya Makarov AIRI, ISP RAS, Moscow, Russia | ||
10:00 30mPoster | LLMAppHub: A Large Collection of LLM-based Applications for the Research Community Posters Zixuan Wu Zhejiang University, Chen Zhi Zhejiang University, Junxiao Han Hangzhou City University, Shuiguang Deng Zhejiang University; Alibaba-Zhejiang University Joint Institute of Frontier Technologies, Jianwei Yin Zhejiang University | ||
10:00 30mPoster | Refining Fuzzed Crashing Inputs for Better Fault Diagnosis Posters Kieun Kim Chungbuk National University, Seongmin Lee Max Planck Institute for Security and Privacy (MPI-SP), Shin Hong Chungbuk National University Pre-print |
15:30 - 16:00 | |||
15:30 30mPoster | Refining Fuzzed Crashing Inputs for Better Fault Diagnosis Posters Kieun Kim Chungbuk National University, Seongmin Lee Max Planck Institute for Security and Privacy (MPI-SP), Shin Hong Chungbuk National University Pre-print | ||
15:30 30mPoster | Logprobs Know Uncertainty: Fighting LLM Hallucinations Posters Mengyao Xu ByteDance, Qiaoyin Gan Institute of Computing Technology, Chinese Academy of Sciences, Zhenyu Zhu ByteDance, Haojun Qin ByteDance | ||
15:30 30mPoster | Symbolic Execution Based Automatic Performance Optimization for MPI Programs Posters Zheng Bian National University of Defense Technology, Zhenbang Chen College of Computer, National University of Defense Technology, Ji Wang National University of Defense Technology | ||
15:30 30mPoster | SODAOpt: Socio-Demographic and Textual Adaptive Fusion for Optimizing Developer Task Assignment Posters Karina Romanova Al Talent Hub, ITMO University, Wildberries, Sergey Senichev ITMO University, MTS AI, Lina Veltman Wildberries, Ivan Nasonov Moscow Institute of Physics and Technology, Andrey Kuznetsov AIRI, Ilya Makarov AIRI, ISP RAS, Moscow, Russia | ||
15:30 30mPoster | Pn4PLC: Verification of Software Upgrade for PLC Code Posters | ||
15:30 30mPoster | LLMAppHub: A Large Collection of LLM-based Applications for the Research Community Posters Zixuan Wu Zhejiang University, Chen Zhi Zhejiang University, Junxiao Han Hangzhou City University, Shuiguang Deng Zhejiang University; Alibaba-Zhejiang University Joint Institute of Frontier Technologies, Jianwei Yin Zhejiang University | ||
15:30 30mPoster | Detecting Data Races in Language Virtual Machines with RaceHunter. Lessons Learned. Posters Pavel Andrianov ISP RAS Research Center for Trusted Artificial Intelligence, Vadim Mutilin ISP RAS Research Center for Trusted Artificial Intelligence, Evgeny Gerlits Ivannikov Institute for System Programming of the Russian Academy of Sciences | ||
15:30 30mPoster | Enhancing Deep Learning Transpilation with LLMs: Automation and Semantic Consistency Posters Xingpei Li National University of Defense Technology, China, Zhijie Jiang National University of Defense Technology, Zhouyang Jia National University of Defense Technology, Yuanliang Zhang National University of Defense Technology, Si Zheng National University of Defense Technology, Haifang Zhou National University of Defense Technology, Shanshan Li National University of Defense Technology | ||
15:30 30mPoster | Autonomous agents in software development for information retrieval using LLM models Posters Aneta Poniszewska-Maranda Institute of Information Technology, Lodz University of Technology, Maciej Kopa Lodz University of Technology |
Space is the name for the main conference area where the registration desk is located.
Posters will be exposed in this area on Tuesday, and authors will be available during the coffee breaks.
This is the same place as the Foyer.