Integrated into smartphones or smart speakers, Intelligent Personal Assistants (IPAs) have grown into the most prevalent example of speech-based interfaces today. Enabling hands-free completion of tasks such as checking the weather, playing music, or controlling smart devices, IPAs have become a central feature of millions of homes. Yet, end-users are faced with barriers to understanding their `black box’ devices, and a lack of opportunity to engage in end-user development (EUD) activities. Our current work considers the state of existing tools and platforms for development of IPAs, the key challenges to be overcome, and the potential benefits of doing so.