Advanced

Conservation of mutual and directed information

Massey, James L. LU and Massey, P (2005) IEEE International Symposium on Information Theory (ISIT), 2005 In 2005 IEEE International Symposium on Information Theory (ISIT) p.157-158
Abstract
Two conservation laws for mutual information in terms of directed informations between two synchronized sequences of random variables are derived, the first for the case of no conditioning and the second for the case of causal conditioning on a third synchronized sequence. As a byproduct of the derivation of the first conservation law, the directed information specifying the feedback flowing from the second sequence to the first sequence is identified, which leads to a simple proof that a previously known sufficient condition for equality of mutual and directed information is also a necessary condition
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
conservation law, directed informations, causal conditioning, synchronized sequences, random variables
in
2005 IEEE International Symposium on Information Theory (ISIT)
pages
157 - 158
publisher
IEEE--Institute of Electrical and Electronics Engineers Inc.
conference name
IEEE International Symposium on Information Theory (ISIT), 2005
external identifiers
  • wos:000234713800034
  • scopus:33749450730
ISBN
0-7803-9150-0
DOI
10.1109/ISIT.2005.1523313
language
English
LU publication?
yes
id
91ea9b90-e9f1-4594-ad97-97199d75ce43 (old id 616249)
date added to LUP
2007-11-25 15:20:59
date last changed
2017-05-21 04:42:10
@inproceedings{91ea9b90-e9f1-4594-ad97-97199d75ce43,
  abstract     = {Two conservation laws for mutual information in terms of directed informations between two synchronized sequences of random variables are derived, the first for the case of no conditioning and the second for the case of causal conditioning on a third synchronized sequence. As a byproduct of the derivation of the first conservation law, the directed information specifying the feedback flowing from the second sequence to the first sequence is identified, which leads to a simple proof that a previously known sufficient condition for equality of mutual and directed information is also a necessary condition},
  author       = {Massey, James L. and Massey, P},
  booktitle    = {2005 IEEE International Symposium on Information Theory (ISIT)},
  isbn         = {0-7803-9150-0},
  keyword      = {conservation law,directed informations,causal conditioning,synchronized sequences,random variables},
  language     = {eng},
  pages        = {157--158},
  publisher    = {IEEE--Institute of Electrical and Electronics Engineers Inc.},
  title        = {Conservation of mutual and directed information},
  url          = {http://dx.doi.org/10.1109/ISIT.2005.1523313},
  year         = {2005},
}