Economic theory reduces the concept of rationality to internal consistency. As far as beliefs are concerned, rationality is equated with having a prior belief over a “Grand State Space”, describing all possible sources of uncertainties. We argue that this notion is too weak in some senses and too strong in others. It is too weak because it does not distinguish between rational and irrational beliefs. Relatedly, the Bayesian approach, when applied to the Grand State Space, is inherently incapable of describing the formation of prior beliefs. On the other hand, this notion of rationality is too strong because there are many situations in which there is not sufficient information for an individual to generate a Bayesian prior. It follows that the Bayesian approach is neither sufficient not necessary for the rationality of beliefs.