I think we need to set some required status check for the merge queue to work properly. It felt like it just merged PRs straight away.
I recall we removed the hard requirement because docs-PRs would never actually run the status check that was required and so on.. I'm thinking perhaps we can have a root workflow which triggers tests / docs depending on what changes, and set that one as required.