> The signicant aspect is that the actual message is one selected from a set of possible messages
> If the number of messages in the set is finite then this number [...] can be regarded as a measure of the information produced when one message is chosen from the set, all choices being equally likely.
> If the number of messages in the set is finite then this number [...] can be regarded as a measure of the information produced when one message is chosen from the set, all choices being equally likely.
From the abstract of his famous paper http://math.harvard.edu/~ctm/home/text/others/shannon/entrop...