Probability is just a measure of our ignorance about a system. For example, when we know everything, probability is either 0 or 100%. When we know nothing, the probability is 50%.