1
PHEFACE The emphasis throughout the book is on such basic concepts as sets, the probability measure associated with sets, sample space, random vari ables, information measure, and capacity. These concepts proceed from set theory to probability theory and then to information and coding theories. The application of the theory to such subjects as radar detection, optics, and linguistics was not undertaken. We make no pretension for "usefulness" and immediate application of information theory. From an educational standpoint, it appears, however, that the topics discussed should provide a suitable training ground for communi cation scientists. The most rewarding aspect of this undertaking has been the pleasure of learning about a new and fascinating frontier in communications. By working on this book, I came to appreciate fully many subtle points and ingenious procedures set forth in the papers of the original contributors to the literature. I trust this attempt to integrate these many contribu tions will prove of value. Despite pains taken by the author, inac curacies, original or inherited, may be found. Nevertheless, I hope the reader will find this work an existence proof of Shannon's fundamental theorem; that "information" can be transmitted with a high degree of reliability at a rate close to the channel capacity despite all forms of "noise." At any rate, there is an eternal separation between what one strives for and what one actually achieves. As Leon von Montenaeken wrote, La vie est breve, Un pen d'espoir, Un peu de reve, Et puis bonsoir. Fazlollah M. Reza Generated on 2015-09-24 06:34 GMT / http://hdl.handle.net/2027/mdp.39015003730408 Public Domain, Google-digitized / http://www.hathitrust.org/access_use#pd-google

Document4

Embed Size (px)

DESCRIPTION

reza

Citation preview

  • PHEFACE

    The emphasis throughout the book is on such basic concepts as sets,the probability measure associated with sets, sample space, random variables, information measure, and capacity. These concepts proceed fromset theory to probability theory and then to information and codingtheories. The application of the theory to such subjects as radardetection, optics, and linguistics was not undertaken. We make nopretension for "usefulness" and immediate application of informationtheory. From an educational standpoint, it appears, however, that thetopics discussed should provide a suitable training ground for communication scientists.

    The most rewarding aspect of this undertaking has been the pleasureof learning about a new and fascinating frontier in communications. Byworking on this book, I came to appreciate fully many subtle points andingenious procedures set forth in the papers of the original contributorsto the literature. I trust this attempt to integrate these many contributions will prove of value. Despite pains taken by the author, inaccuracies, original or inherited, may be found. Nevertheless, I hope thereader will find this work an existence proof of Shannon's fundamentaltheorem; that "information" can be transmitted with a high degree ofreliability at a rate close to the channel capacity despite all forms of"noise."

    At any rate, there is an eternal separation between what one strives forand what one actually achieves. As Leon von Montenaeken wrote,

    La vie est breve,Un pen d'espoir,Un peu de reve,Et puisbonsoir.

    Fazlollah M. Reza

    Gen

    erat

    ed o

    n 20

    15-0

    9-24

    06:

    34 G

    MT

    / h

    ttp:

    //hdl

    .han

    dle.

    net/

    2027

    /mdp

    .390

    1500

    3730

    408

    Publ

    ic D

    omai

    n, G

    oogl

    e-di

    gitiz

    ed /

    htt

    p://w

    ww

    .hat

    hitr

    ust.

    org/

    acce

    ss_u

    se#

    pd-g

    oogl

    e