That's a very dangerous road you're suggesting walking down there, "observing" others and making judgements about the whole of their character based on isolated examples is a fruitful source of prejudice and cognitive bias.
Well, no. In the best case you have a panopticon into their life. But since people will rarely give you that in real life, you do the best you can and always take what you observe with a grain of salt.