Unlocking Potential of Open Source Model Training in Decentralized Federated Learning Environment
The field of artificial intelligence (AI) is rapidly evolving, creating a demand for sophisticated models that rely on substantial data and computational resources for training. However, the high costs associated with training these models have limited accessibility, leading to concerns about transparency, biases, and hidden agendas within AI systems. As AI becomes more integrated into governmental services and the pursuit of Artificial General Intelligence (AGI) advances, the necessity for transparent and reliable AI models becomes increasingly critical. Decentralized Federated Learning (DFL) offers decentralized approaches to model training while safeguarding data privacy and ensuring resilience against adversarial participants. Nonetheless, guarantees provided are not absolute, and even open weights AI models do not qualify as truly open source. This paper suggests utilizing blockchain technology, smart contracts, and publicly verifiable secret sharing in DFL environments to bolster trust, cooperation, and transparency in model training processes. Our numerical experiments illustrate that the overhead required to offer robust assurances to all peers regarding the correctness of the training process is relatively small. By incorporating these tools, participants can trust that trained models adhere to specified procedures, addressing accountability issues within AI systems and promoting the development of more ethical and dependable applications of artificial intelligence.
Sat 27 JulDisplayed time zone: Beijing, Chongqing, Hong Kong, Urumqi change
15:15 - 16:30 | Session 6 - Federated Learning & MiscResearch Track at The ballroom B Chair(s): Jingyue Li Norwegian University of Science and Technology (NTNU) | ||
15:30 15mPaper | Research and Development Assessment of Blockchain Standardization Research Track Qi Zhang China Academy of Information and Communications Technology, Weiwei Pang China Academy of Information and Communications Technology, Chunyu Jiang China Academy of Information and Communications Technology, Yang Cheng China Academy of Information and Communications Technology, Bin Liu China Academy of Information and Communications Technology, Lifeng Zhang China Academy of Information and Communications Technology, Liu tingting China Academy of Information and Communications Technology | ||
15:45 15mPaper | Private, Atomic, Incentive mechanism for Federated Learning based on Blockchain Research Track Kejia Chen Zhejiang University, Jiawen Zhang Zhejiang University, Xuanming Liu Zhejiang University, Zunlei Feng Zhejiang University, Xiaohu Yang Zhejiang University | ||
16:00 15mPaper | A Layer-2 Expansion Shared Sequencer Model for Blockchain Scalability Research Track Huijian Han School of Computer Science and Technology, Shandong University of Finance and Economics, Mingwei Wang School of Computer Science and Technology, Shandong University of Finance and Economics, Feng Yang School of Computer Science and Technology, Shandong University of Finance and Economics, Linpeng Jia Institute of Computing Technology, Chinese Academy of Sciences, Yi Sun Chinese Academy of Sciences, Rui Zhang School of Computer Science and Technology, Shandong University of Finance and Economics | ||
16:15 15mPaper | Unlocking Potential of Open Source Model Training in Decentralized Federated Learning Environment Research Track Ekaterina Pavlova Skolkovo Institute of Science and Technology, Grigorii Melnikov B4B.World, Yury Yanovich Skolkovo Institute of Science and Technology; Faculty of Computer Science, HSE University, Alexey Frolov Skolkovo Institute of Science and Technology |