It is also constantly being emitted by radioactive elements decaying on Earth, that's how it got in the natural gas deposits in the first place and also the atmosphere. Alpha decay makes helium, or more accurately is helium. An alpha particle is just a helium-4 nucleus.