Related information entropy

Missing Persons is back! ! !

Has recently been busy with other, forget the original intention to maintain the blog, I hope to be able to maintain a daily blog.

Has recently been doing the work of registration aspect of the image, then expanded around this point some of the content of it.

**************************************************************************************

1. The amount of information

  Usually we call the event contains much amount of information. In the computer world, everything is fundamentally a binary expression, so we can use how many bits of storage space required for an event as a measure of how much information the way. For example, a event message contains m kinds, the number of bits required to store \ (log_ {2} m \ ).

  Next, we discuss how much information at a random variable or random events included. Mentioned random event, it is certainly related to the probability of this event occurring \ (p (x) \)

Guess you like

Origin www.cnblogs.com/SshunWang/p/11116407.html