Ignoring latency but not throughput, How does this compare in terms of Cost ( cards Acquisition cost and Power needed) with Nvidia GPU for inference?

We intend to be very competitive on cost, power, hardware, TCO, whatever it is. Custom-built silicon+hardware has the advantage in this space.

Do they make money from LLM service or by selling hardware? Homepage is confusing without any reference to other products.

Both, we sell tokens as a service and we sell enterprise systems.

Then reference that in the homepage? If not for this HN thread, I wouldn't have know you sell hardware.