I’d hazard a guess that most of the losses are from when you open the door and the seal around the door. Also while cooler than ambient my fridge and freezer don’t feel cool to the touch so I think that the walls are thick enough.
Otherwise fridges and freezers would ship with thicker insulation.