The context-tree weighting method: basic properties

F.M.J. Willems, Yu.M. Shtarkov, T.J. Tjalkens

Onderzoeksoutput: Bijdrage aan tijdschriftTijdschriftartikelAcademicpeer review

531 Citaten (Scopus)
304 Downloads (Pure)


Describes a sequential universal data compression procedure for binary tree sources that performs the "double mixture." Using a context tree, this method weights in an efficient recursive way the coding distributions corresponding to all bounded memory tree sources, and achieves a desirable coding distribution for tree sources with an unknown model and unknown parameters. Computational and storage complexity of the proposed procedure are both linear in the source sequence length. The authors derive a natural upper bound on the cumulative redundancy of the method for individual sequences. The three terms in this bound can be identified as coding, parameter, and model redundancy, The bound holds for all source sequence lengths, not only for asymptotically large lengths. The analysis that leads to this bound is based on standard techniques and turns out to be extremely simple. The upper bound on the redundancy shows that the proposed context-tree weighting procedure is optimal in the sense that it achieves the Rissanen (1984) lower bound
Originele taal-2Engels
Pagina's (van-tot)653-664
Aantal pagina's12
TijdschriftIEEE Transactions on Information Theory
Nummer van het tijdschrift3
StatusGepubliceerd - 1995

Vingerafdruk Duik in de onderzoeksthema's van 'The context-tree weighting method: basic properties'. Samen vormen ze een unieke vingerafdruk.

  • Citeer dit