> I'm confused how the heat retention could be around 80-90% without expending a ton of energy.

Imagine two air streams counter-flowing. They "swap places" within your heat exchanger, so you can (theoretically) get 100% heat recovery.

This principle is used by animals to minimize the heat waste, by counter-flowing warm and cold blood: https://en.wikipedia.org/wiki/Rete_mirabile