Architectural smells have been widely studied in the literature, and several approaches have been developed to demonstrate their impact on software quality. Yet, empirical evidence bridging architectural smells and software quality attributes, while jointly considering security and performance issues, is limited. In this study, we investigate whether refactoring architectural smells can impact the quality, as well as security and performance issues that frequently occur in open-source projects. For this purpose, we analyze projects spanning various application domains and automatically detect architectural smells, along with security and performance issues, using a diverse set of tools. Then, we remove some instances of smells and check if their removal has an impact on the quality, security, and performance metrics originally collected in the selected projects. Our experimental results demonstrate that refactoring architectural smells contributes to an improvement in software quality and performance indicators, whereas it has a less significant impact on security vulnerabilities.