Building easily modifiable software systems is a challenge for engineers. AI-based systems add AI models and data, which change frequently. This research identifies change scenario’s and their impact in a framework for modifiable AI-based systems. This holistic framework consists of three architectural views and three AI-based themes. We apply this framework to various industry cases, to elicit which factors drive the evolution.