You'll probably get a better answer in the Gradle slack (linked in the description of this channel).
Maybe try opening the configuration cache report? My best guesses are either:
• your disk is very slow
• the configuration cache archive is massive (maybe some plugin stores a lot of stuff in it?)