Another solution right now is simply to just use an hbox instead of the field, since you're not using any properties of Field to support your button: