Foreword by Member of the Russian Academy of Science Yu.V. Gulyaev ... 16 Preface .............................................................. 18 Mark Bykhovskiy ...................................................... 20 PART I. PIONEERS OF THE INFORMATIONAL ERA ............................ 21 Dmitry Ageev ......................................................... 22 Vladimir Bunimovich .................................................. 31 Harry Van Trees ...................................................... 36 Norbert Wiener ....................................................... 41 Andrew Viterbi ....................................................... 49 Roland Dobrushin ..................................................... 58 Andrei Kolmogorov .................................................... 66 Vladimir Kotelnikov .................................................. 75 Boris Levin .......................................................... 89 Victor Melnikov ...................................................... 97 David Middleton ..................................................... 105 Harry Nyquist ....................................................... 111 Stephan Rice ........................................................ 117 Vladimir Siforov .................................................... 127 Ruslan Stratonovich ................................................. 139 Vasiliy Tikhonov .................................................... 149 Lev Fink ............................................................ 158 Alexander Kharkevich ................................................ 168 Alexander Khinchin .................................................. 177 Richard Hamming ..................................................... 184 Claude Shannon ...................................................... 189 Agner Erlang ........................................................ 199 PART II. THE HISTORY OF COMMUNICATION STATISTICAL THEORY ............ 205 Chapter 1. Creation and evolution of the linear and nonlinear transformation random processes theory ................... 206 § 1. Prehistory ..................................................... 206 Walter Schottky ........................................... 207 § 2. Passage of random signals and noise through linear and non-linear devices ............................................. 208 § 3. Non-linear distortion analysis ................................. 210 § 4. Large excursions of a random processes ......................... 213 § 5. Tracking loss analysis methods ................................. 214 § 6. Monographs and text-books on statistical communication theory ......................................................... 215 Vladimir Pugachev ......................................... 216 § 7. Chronology of evolution the linear and nonlinear transformation random processes theory ......................... 218 References .......................................................... 219 Chapter 2. Creation and evolution of the optimal linear filtering theory ................................................... 222 § 1. Matched filters synthesis ...................................... 222 § 2. Optimal filters for separation the Gaussian random signals and noise synthesis ............................................ 224 § 3. Chronology of evolution the optimal linear filtering theory .... 227 References .......................................................... 228 Chapter 3. Creation and evolution of the optimal noise immunity theory ................................................... 229 § 1. Creation of the optimal noise immunity theory .................. 229 Arnold Siegert ............................................ 230 Philipp Woodward .......................................... 231 § 2. Development of optimal noise immunity theory of discrete signals ........................................................ 231 2.1. Incoherent reception of binary signals .................... 232 Nikolay Petrovich ......................................... 234 Nikolay Khvorostenko ...................................... 235 2.2. Incoherent reception of M-ary signals ..................... 236 § 3. Reception of discrete signals in multipath channels ............ 238 3.1. Multipath channel models .................................. 239 3.2. Diversity reception in channels with flat fading .......... 241 Daniil Klovskiy ........................................... 243 George Turin .............................................. 244 § 4. Optimal signal reception in multipath channels ................. 245 Robert Price .............................................. 246 4.1. Diversity reception with signal parameter measurements .... 247 Philipp Bello ............................................. 248 4.2.Compensation of the intersymbol interference ............... 249 Robert Lucky .............................................. 251 § 5. Signal parameters estimation theory ............................ 252 5.1. Fundamentals of the theory ................................ 252 5.2. Application of the theory for practical problems solution .................................................. 256 Lev Weinstein ............................................. 258 Saveliy Falkevich ......................................... 261 5.3. Maximum accuracy of signal parameters estimation .......... 262 § 6. Optimal reception of analogue signals .......................... 263 6.1. Gaussian theory of optimal reception ...................... 264 6.2. Markov theory of optimal reception ........................ 268 Mikhail Yarlykov .......................................... 270 Donald Snyder ............................................. 271 § 7 Chronology of evolution the optimal noise immunity theory ....... 272 7.1. Reception of discrete signals ............................. 272 7.2. Estimation of signal parameters ........................... 275 7.3. Optimal reception of analogue signals ..................... 277 References .......................................................... 278 Chapter 4. Creation and evolution of information theory ............. 284 § 1. Prehistory ..................................................... 284 § 2. Creation of information theory ................................. 287 Robert Fano ............................................... 291 § 3. Evolution of the mathematics fundamentals of information theory ......................................................... 293 Mark Pinsker .............................................. 294 Robert Gallager ........................................... 298 § 4. Elaboration of sources coding methods .......................... 300 4.1. Discrete sources coding ................................... 301 David Huffman ............................................. 304 Jakob Ziv ................................................. 306 4.2. Analogue sources coding ................................... 308 4.3. Practical application of the sources coding methods ....... 313 4.3.1. Compression of fax messages ........................ 313 4.3.2. Compression of sound signals ....................... 315 4.3.3. Compression of TV signals .......................... 317 4.3.4. Compression of telemetry signals ................... 319 4.3.5. Compression of computer files ...................... 319 § 5. Theory of coding ............................................... 319 5.1. Block codes ............................................... 320 David Slepian ............................................. 322 5.2. Cyclic codes .............................................. 324 Elvin Berlekamp ........................................... 326 5.3. Recurrent codes ........................................... 327 5.4. Error bursts correcting codes ............................. 329 5.5. Iterated codes ............................................ 329 Peter Elias ............................................... 331 5.6. Concatenated codes ........................................ 332 David Forney .............................................. 333 5.7. Turbo codes ............................................... 336 5.8. Soft decision decoding of codes ........................... 337 5.9. A bounds for error correcting codes ....................... 339 5.10. Applications of theory coding ............................ 340 § 6. Information feedback systems ................................... 341 § 7. Evaluation of information theory for communication networks with many users ................................................ 345 7.1. Communication networks with multiple access ............... 345 7.2. Broadcast channels ........................................ 346 7.3. Communication networks with signals retransmission ........ 348 7.4. The Gaussian interference channels ........................ 349 § 8. Chronology of evolution the information theory ................. 350 8.1. Fundamentals of information theory ........................ 350 8.2. Sources coding theory ..................................... 351 8.3. Channel coding theory ..................................... 353 8.4. Information feedback systems .............................. 355 8.5. Communication networks for multi-user ..................... 355 References .......................................................... 356 Epilogue ............................................................ 366 Index ............................................................... 368 List of abbreviations ............................................... 373