Sure they have. We see every level of cognition in animals today, and the fossil record proves that they all came from the same evolutionary tree. For every species that can claim cognition (there’s lots of them), you can trace it back to predecessors which were increasingly simple.

Obviously cognition isn’t a binary thing, it’s a huge gradient, and the tree of life shows that gradient in full.