Didn't use to be. VIA/centaur was the first to add AES instructions, later picked up by Intel and AMD. Its not free, but not expensive.
A brilliant woman from, where, Slovenia? figured a way to use SSE instructions to encrypt just as fast as the built-in instructions, I think 2 cycles per byte.
I guess DJB's ciphers run much the same way, nowadays.
Wow. I had no idea. This may be one of the dumbest things I've ever read. Encryption is free.