Tuesday, April 2, 2019

MATHEMATICAL PRELIMINARIES FOR LOSSLESS COMPRESSION MODELS SELF INFORMATION


MATHEMATICAL PRELIMINARIES FOR LOSSLESS COMPRESSION MODELS


Self-Information

Suppose we have an element A which is set of outcomes of some random experiments.

If P(A) is the probability that the event is occurred then the self-information associated with the event A then event A can be represented as:



Here, b=unit of Information
So, b= bits or binary (b=2)

Here, we take calculation of Fair and Unfair Coin

Fair Coin:


Unfair Coin:

If we toss the coin 8 time. If we get only 1 time head then other 7 time we get tail.

We take the probability of Head:


We take the probability of Tail:

SORT TRICK:








No comments:

Post a Comment