> That's the fun with these sorts of doubts, if we assume nothing, then we can form an argument for anything.

We can form a counter-argument to anything, to be precise. :)

It's very hard to analyze ourselves only from our own consciousness. Especially since the consciousness itself is very likely an illusion [0].

[0] https://en.wikipedia.org/wiki/Neuroscience_of_free_will