With regards to The Scientific Method (and other ideas mentioned), I found some of David Deutsch's work thought-provoking. Namely, the idea that deductive reasoning is more effective than inductive when seeking new hypotheses. The Beginning of Infinity is a decent starting place [0]. Also related to some of Nassim Taleb's work.

[0] https://www.amazon.com/dp/0143121359