Not everywhere. It depends on the jurisdiction.

But surely an US private investigator would have to respect french laws when following people in France?

The core of the issue is about fundamentally transnational transactions, and who has jurisdiction in that matter.