I'm an American and I make the same distinction. Cultural travel is not on the radar of the typical vacationer, so most people don't make the distinction.

I'd add "tourists" as a third category, ranging from the one week family trip somewhere new to see the sights up to and including those racing city to city, hostel to hostel, site to site, collecting likes on instagram or whatever.