Chap. 12 An Introduction to Information Theory12.1 Modeling Information Sources12.1.1 Measure of InformationDMSA Discrete Memoryless Source (DMS) is the simplest model of an information source.It is a discrete-time, discrete-amplitude i.i.d. random process. AlphabetA full description of the DMS is given by the set $\mathcal{A}$, called the alphabet.$\mathcal{A} = \{a_i\}_{i=1}^{N}$ with $\{p_i\}..
