Spacer and Box use different strategies to decide their actual size. See their MeasurePolicy implementations. I recommend you to learn how measurement is performed in compose first, like this series:
https://youtube.com/playlist?list=PLWz5rJ2EKKc94tpHND8pW8Qt8ZfT1a4cq (I can't recall if MeasurePolicy is covered but these are worth watching). Anyway,
choose the one with the best semantics, like from your description you'd better use a Box because Spacer should only be used for spacing and not have any visual effects or interactions itself.