I don't know if this is true or not, but I have heard that most of the US's rail is unsuitable for passenger travel because it is unsuitable for speeds that would make passenger travel reasonable. With freight it doesn't matter so much since the name of the game is moving lots of things cheap, not moving things fast.