A quick search uncovers [0] with a hint towards an answer: just train the model to output multiple tokens at once.

[0] https://arxiv.org/abs/2111.12701