Advanced search
Start date
Betweenand
(Reference retrieved automatically from Web of Science through information on FAPESP grant and its corresponding number as mentioned in the publication by the authors.)

On Shannon's Formula and Hartley's Rule: Beyond the Mathematical Coincidence

Full text
Author(s):
Rioul, Olivier [1] ; Magossi, Jose Carlos [2]
Total Authors: 2
Affiliation:
[1] Telecom ParisTech, Inst Mines Telecom, CNRS LTCI, F-75013 Paris - France
[2] Univ Campinas Unicamp, Sch Technol FT, BR-13484370 Sao Paulo - Brazil
Total Affiliations: 2
Document type: Journal article
Source: Entropy; v. 16, n. 9, p. 4892-4910, SEP 2014.
Web of Science Citations: 3
Abstract

In the information theory community, the following ``historical{''} statements are generally well accepted: (1) Hartley did put forth his rule twenty years before Shannon; (2) Shannon's formula as a fundamental tradeoff between transmission rate, bandwidth, and signal-to-noise ratio came out unexpected in 1948; (3) Hartley's rule is inexact while Shannon's formula is characteristic of the additive white Gaussian noise channel; (4) Hartley's rule is an imprecise relation that is not an appropriate formula for the capacity of a communication channel. We show that all these four statements are somewhat wrong. In fact, a careful calculation shows that ``Hartley's rule{''} in fact coincides with Shannon's formula. We explain this mathematical coincidence by deriving the necessary and sufficient conditions on an additive noise channel such that its capacity is given by Shannon's formula and construct a sequence of such channels that makes the link between the uniform (Hartley) and Gaussian (Shannon) channels. (AU)

FAPESP's process: 14/13835-6 - 34th International Workshop on Bayesian Inference and Maximum Entropy in Science and Engineering
Grantee:José Carlos Magossi
Support Opportunities: Research Grants - Meeting - Abroad
FAPESP's process: 13/25977-7 - Security and reliability of Information: theory and practice
Grantee:Marcelo Firer
Support Opportunities: Research Projects - Thematic Grants