I kinda thought that was what it did already.
IDE already “Reloads script dependencies on file change”, I just guessed it would also run the
refineConfiguration
in that step. It seems like its going to be a common enough use case when kotlin scripting is out of experimental (ie including dependencies based on some annotation value)