Switched to vanniktech plugin for publishing. You can see the commit
by clicking here.
The API changed recently and they havent updated the documentation, so took a lot of time to figure out what was going on.
On the bright side it seems very fast and the random error on Github Actions I posted about the other days seems to be fixed