An Efficient Coding Technique for Stochastic Processes

Favorite this paper
How to cite this paper?
Details
  • Presentation type: Oral Presentation and Poster (LACSC)
  • Track: LACSC
  • Keywords: Partition Markov Models; Huffman Coding; Entropy;
  • 1 University of Campinas
  • 2 Universidade Estadual de Campinas
  • 3 Universidade Federal Fluminense

An Efficient Coding Technique for Stochastic Processes

Jesus Enrique Garcia

University of Campinas

Abstract

In the framework of coding theory, under the assumption of a Markov process (X_t) on a finite alphabet A, the compressed representation of the data will be composed of a description of the model used to code the data and the encoded data. Given the model, the Huffman algorithm is optimal for the number of bits needed to encode the data, see [1]. On the other hand, modeling (X_t) through a Partition Markov Model (PMM) - see [2] - promotes a reduction in the number of transition probabilities needed to define the model. This paper shows how the use of Huffman code with a PMM reduces the number of bits needed in this process. We prove the estimation of a PMM allows estimating the entropy of (X_t), providing an estimator of the minimum expected codeword length per symbol. We show the efficiency of the new methodology on a simulation study and, through a real problem of compression of DNA sequences of SARS-CoV-2, obtaining in the real data at least a reduction of 10.4%.

[1] Cover TM. Elements of Information Theory. Wiley Series in Telecommunications and Signal Processing. Wiley-Interscience; 2006.

[2] García JE, González-López VA (2017) Consistent Estimation of Partition Markov Models. Entropy, 19(4): 160. https://doi.org/10.3390/e19040160

Share your ideas or questions with the authors!

Did you know that the greatest stimulus in scientific and cultural development is curiosity? Leave your questions or suggestions to the author!

Sign in to interact

Have a question or suggestion? Share your feedback with the authors!