U.S. v. Jones and Riley v. California aren't that clear cut.

IIRC they both said that mass surveillance that would "out" people's private lives (e.g. going to a gay club) might cross the boundary into an unreasonable search.