I seem to remember that even when Cortana is shut off, it was found to be listening and sending telemetry back to Microsoft. Based on their past behaviour, I'd guess that even is it is "removed", those elements will remain.
Oh, I'm sorry for pointing out the fact that speech recognition wants outbound access through the firewall even on Cortana-less LTSC. That must be so hurtful! Please forgive me, I'm on your side, I don't even vaccinate!