ThatQuiz Tesztkönyvtár Töltsd ki most ezt a tesztet
Information theory - Kvíz
Közreműködött: Haynes
  • 1. What are pseudorandom number generators in computer language libraries almost universally unsuited for?
A) Bioinformatics
B) Gambling
C) Cryptographic use
D) Seismic exploration
  • 2. What must cryptographically secure pseudorandom number generators have to work as intended?
A) Analog processing methods
B) Integrated neural clusters
C) Random seeds external to the software
D) High Shannon entropy
  • 3. How can random seeds for pseudorandom generators be obtained?
A) Through Shannon entropy
B) Via extractors
C) By using semiotic signs
D) Via digital noise
  • 4. What is the measure of sufficient randomness in extractors?
A) Free energy
B) Dynamic core hypothesis
C) Min-entropy
D) Effective information
  • 5. Min-entropy is related to Shannon entropy through which other type of entropy?
A) Algorithmic entropy
B) Conditional entropy
C) Rényi entropy
D) Thermal entropy
  • 6. Where is Rényi entropy also used?
A) In evaluating randomness in cryptographic systems
B) In seismic oil exploration
C) In minimizing free energy
D) In semiotic code control
  • 7. Does a random variable with high Shannon entropy guarantee it is satisfactory for use in an extractor?
A) Only for pseudorandom numbers
B) No
C) Only in cryptographic systems
D) Yes
  • 8. What was one early commercial application of information theory?
A) Seismic oil exploration
B) Bioinformatics
C) Black hole analysis
D) Search for extraterrestrial intelligence
  • 9. What did information theory make it possible to do in seismic exploration?
A) Minimize free energy in the brain
B) Decode dominant social messages
C) Strip off and separate unwanted noise from the desired seismic signal
D) Generate secure pseudorandom numbers
  • 10. What methods offered a major improvement of resolution and image clarity over previous analog methods in seismic work?
A) Extractors and Rényi entropy
B) Free energy principles
C) Information theory and digital signal processing
D) Cryptographically secure pseudorandom number generators
  • 11. Which semioticians considered Charles Sanders Peirce as having created a theory of information?
A) Umberto Eco and Ferruccio Rossi-Landi
B) Gerald Edelman and Giulio Tononi
C) Karl J. Friston and Andrey Kolmogorov
D) Doede Nauta and Winfried Nöth
  • 12. How did Doede Nauta define semiotic information theory?
A) The measurement of sufficient randomness in extractors
B) The minimization of free energy in a self-organized system
C) The study of the internal processes of coding, filtering, and information processing
D) The separation of unwanted noise from seismic signals
  • 13. Which semioticians used concepts like redundancy and code control to explain ideology?
A) Umberto Eco and Ferruccio Rossi-Landi
B) C.E. Shannon and R.V.L. Hartley
C) Gerald Edelman and Karl J. Friston
D) Doede Nauta and Winfried Nöth
  • 14. In semiotic explanations of ideology, how does a dominant social class emit its message?
A) Through digital signal processing of seismic signals
B) By applying the free energy principle
C) By utilizing cryptographically secure pseudorandom seeds
D) By using signs that exhibit a high degree of redundancy
  • 15. Where have quantitative information theoretic methods been applied in cognitive science?
A) To analyze the integrated process organization of neural information
B) To study black holes and bioinformatics
C) To extract random numbers for cryptography
D) To explore seismic oil deposits
  • 16. What neurological problem is linked to the analysis of neural information organization?
A) The issue of seismic noise filtering
B) The paradox of extraterrestrial intelligence
C) The binding problem in cognitive neuroscience
D) The problem of algorithmic complexity
  • 17. Whose functional clustering model and dynamic core hypothesis define an information-theoretical measure in neural processing?
A) Gerald Edelman and Giulio Tononi
B) Doede Nauta and Winfried Nöth
C) R.V.L. Hartley and C.E. Shannon
D) Umberto Eco and Ferruccio Rossi-Landi
  • 18. What is Giulio Tononi's integrated information theory (IIT) of consciousness based on?
A) Shannon entropy
B) Seismic signal processing
C) Effective information
D) Min-entropy
  • 19. What underlies the definition of measures in the context of neural information organization?
A) A reentrant process organization
B) External cryptographic random seeds
C) Analog methods of data transmission
D) A high degree of redundancy in signs
  • 20. What does a reentrant process organization refer to?
A) The generation of pseudorandom numbers using extractors
B) The synchronization of neurophysiological activity between groups of neuronal populations
C) The coding and filtering processes studied in semiotics
D) The filtering of unwanted noise from desired seismic signals
  • 21. Whose free energy principle (FEP) states that every adaptive change leads to a minimization of free energy?
A) Karl J. Friston
B) Giulio Tononi
C) Charles Sanders Peirce
D) Gerald Edelman
  • 22. What type of system does the free energy principle apply to?
A) An analog seismic receiver
B) A cryptographic random number generator
C) A self-organized system
D) A dominant social class
  • 23. Along with the free energy principle, what other hypothesis is mentioned in relation to statistical methods in the brain?
A) The dynamic core hypothesis
B) The Bayesian brain hypothesis
C) The semiotic information theory
D) The integrated information theory
  • 24. Which field, aside from cryptography and seismology, has applications in information theory?
A) Alchemy
B) Astrology
C) Search for extraterrestrial intelligence
D) Phrenology
  • 25. Which physical phenomenon is listed alongside extraterrestrial intelligence as having applications for information theory?
A) Seismic waves
B) Tectonic plates
C) Neural clusters
D) Black holes
  • 26. What life-science field is mentioned as having applications in information theory?
A) Biophysics
B) Biomechanics
C) Bioinformatics
D) Biochemistry
  • 27. What recreational activity is listed as an application of information theory?
A) Cipher creation
B) Crosswords
C) Chess
D) Gambling
  • 28. Who is listed in the history section alongside C.E. Shannon and Andrey Kolmogorov?
A) Gerald Edelman
B) R.V.L. Hartley
C) Umberto Eco
D) Doede Nauta
  • 29. Who is mentioned in the history section alongside R.V.L. Hartley and Andrey Kolmogorov?
A) Winfried Nöth
B) Ferruccio Rossi-Landi
C) C.E. Shannon
D) Giulio Tononi
  • 30. Who is listed in the history section alongside R.V.L. Hartley and C.E. Shannon?
A) Andrey Kolmogorov
B) Charles Sanders Peirce
C) Karl J. Friston
D) Winfried Nöth
  • 31. What is the historical figure H.P. Yockey associated with in the text?
A) Free energy principle
B) History of information theory
C) Dynamic core hypothesis
D) Integrated information theory
  • 32. What do physiological systems use information theory to exchange, process, and integrate as?
A) A network
B) A single organ
C) A block cipher
D) A brute force attack
  • 33. What do physiological systems generate alongside functions in health and disease?
A) Distinct physiological states
B) Symmetric keys
C) Unicity distances
D) Information theory units
  • 34. What does network cross-communication and regulation reveal within the organism?
A) How encryption keys are generated
B) Why brute force attacks succeed
C) How it occurs
D) Why it ceases permanently
  • 35. Which interactions are listed as applications of information-theoretic approaches in physiology?
A) Cryptographic interactions
B) Cardio-respiratory interactions
C) Enigma machine interactions
D) One-time pad interactions
  • 36. In what kind of environments is network physiology applied according to the text?
A) Extreme environments
B) Cryogenic laboratory environments
C) Underground bunker environments
D) Simulated virtual environments
  • 37. What was the name of Turing's information unit used in the Ultra project?
A) The shannon
B) The byte
C) The ban
D) The bit
  • 38. In which project was Turing's information unit used?
A) The Unicity project
B) The Venona project
C) The Ultra project
D) The Enigma project
  • 39. What German machine code was broken during World War II with the help of the ban?
A) One-time pad code
B) Lorenz cipher code
C) Symmetric key code
D) Enigma machine code
  • 40. What does information theory lead us to believe about keeping secrets?
A) It is extremely easy using symmetric keys
B) It is much more difficult than it might first appear
C) It is completely impossible under any circumstances
D) It requires no computational effort
  • 41. What kind of attack can break systems based on asymmetric or symmetric key algorithms?
A) An information-theoretic attack
B) A network physiology attack
C) A conditional mutual attack
D) A brute force attack
  • 42. What are symmetric key algorithms sometimes called?
A) Secret key algorithms
B) One-time pads
C) Asymmetric algorithms
D) Unicity distance algorithms
  • 43. What is an example of a commonly used method of symmetric key algorithms?
A) Transfer entropy
B) Bans
C) One-time pads
D) Block ciphers
  • 44. What must be used correctly even when applying information-theoretically secure methods?
A) Brute force
B) Transfer entropy
C) Care
D) Block ciphers
  • 45. Which project was able to crack the one-time pads of the Soviet Union?
A) The Network Physiology project
B) The Venona project
C) The Ultra project
D) The Enigma project
  • 46. In which type of data compression must the data be reconstructed exactly?
A) Lossy data compression
B) Rate-distortion theory
C) Channel coding
D) Lossless data compression
  • 47. What justifies the division of coding theory into compression and transmission?
A) Source-channel separation theorems
B) Pragmatic information
C) Rate-distortion theory
D) Channel resolvability
  • 48. What do source-channel separation theorems justify the use of as the universal currency for information?
A) Entropy
B) Bits
C) Bytes
D) Distortion functions
  • 49. What type of channel involves more than one transmitter?
A) The wiretap channel
B) The multiple-access channel
C) The relay channel
D) The broadcast channel
  • 50. What type of channel involves more than one receiver?
A) The broadcast channel
B) The multiple-access channel
C) The wiretap channel
D) The relay channel
  • 51. What type of channel involves intermediary helpers?
A) The broadcast channel
B) The relay channel
C) The multiple-access channel
D) The wiretap channel
  • 52. What should joint entropy not be confused with despite similar notation?
A) Cross-entropy
B) Kullback-Leibler divergence
C) Mutual information
D) Conditional entropy
  • 53. What type of space does the vector give values in for joint entropy?
A) Product space
B) Metric space
C) Euclidean space
D) Vector space
  • 54. What is the formula for self-information I(pi)?
A) 1 / pi
B) -log2(pi)
C) log2(pi)
D) -ln(pi)
  • 55. What is the entropy H relative to the surprisal of all possible symbols?
A) The median
B) The maximum value
C) The geometric mean
D) The weighted average
  • 56. If 1000 bits are transmitted and each is independently and equally likely to be 0 or 1, how much information has been transmitted?
A) 1000 shannons
B) No information
C) 1 shannon
D) 2000 bits
  • 57. In what year was Claude Shannon's paper 'A Mathematical Theory of Communication' published?
A) 1948
B) 1952
C) 1960
D) 1939
  • 58. In what decade was information theory established and formalized?
A) 1930s
B) 1940s
C) 1920s
D) 1950s
  • 59. In what context was information theory initially formed?
A) Molecular biology
B) Artificial intelligence
C) Telecommunication
D) Quantum computing
  • 60. What is the entropy of a coin flip when you already know the outcome after it has landed?
A) 1 bit
B) 0.5 bits
C) Zero
D) 2 bits
  • 61. What is an example of source coding or data compression mentioned in the text?
A) ZIP files
B) DSL
C) Compact discs
D) Voyager missions
  • 62. What is an example of channel coding mentioned in the text?
A) Artificial intelligence
B) DSL
C) Mobile phones
D) ZIP files
  • 63. Whose success was crucially impacted by information theory regarding deep space missions?
A) Apollo missions
B) Hubble telescope
C) Voyager missions
D) Curiosity rover
  • 64. Which invention's success was crucially impacted by information theory?
A) Radio
B) Steam engine
C) Television
D) Compact disc
  • 65. What technology's feasibility was made possible by information theory?
A) Airplanes
B) Electric guitars
C) Mobile phones
D) Automobiles
  • 66. What modern developments were impacted by information theory alongside artificial intelligence?
A) The postal service
B) The printing press
C) The telegraph network
D) The Internet
  • 67. Which computational paradigm is listed alongside artificial intelligence as an application of information theory?
A) Cloud computing
B) Distributed computing
C) Optical computing
D) Quantum computing
  • 68. Which of the following artistic applications is mentioned as a use case for information theory?
A) Sculpture casting
B) Art creation
C) Architectural drafting
D) Oil painting restoration
  • 69. What specific musical topic is analyzed using information theory according to the text?
A) Music
B) Vocal cord anatomy
C) Musical instrument design
D) Acoustic room resonance
  • 70. Which philosophical field is listed at the end of the text as an application area of information theory?
A) Aesthetics
B) Epistemology
C) Ethics
D) Metaphysics
  • 71. Which historian rated Shannon's 1948 paper as the most important development of 1948?
A) Ralph Hartley
B) James Gleick
C) Harry Nyquist
D) Vannevar Bush
  • 72. In what year did Shannon outline some of his initial ideas in a letter to Vannevar Bush?
A) 1939
B) 1928
C) 1948
D) 1940
  • 73. To whom did Shannon write a letter outlining initial ideas of information theory in 1939?
A) Ludwig Boltzmann
B) James Gleick
C) Alan Turing
D) Vannevar Bush
  • 74. Who wrote the 1924 paper 'Certain Factors Affecting Telegraph Speed'?
A) Alan Turing
B) Harry Nyquist
C) Claude Shannon
D) Ralph Hartley
  • 75. What relation was given in Harry Nyquist's 1924 paper?
A) W = K log m
B) PV = nRT
C) H = log Sn
D) E = mc2
  • 76. What unit of information was sometimes called the hartley in honor of Ralph Hartley?
A) The bit
B) The baud
C) The byte
D) The decimal digit
  • 77. Who used similar ideas in 1940 as part of the statistical analysis of breaking German Enigma ciphers?
A) Claude Shannon
B) Alan Turing
C) Ralph Hartley
D) Harry Nyquist
  • 78. Who made important contributions connecting information-theoretic entropy and thermodynamic entropy in the 1960s?
A) James Gleick
B) Vannevar Bush
C) Harry Nyquist
D) Rolf Landauer
  • 79. What logarithmic base is the bit or shannon based on?
A) Common logarithm
B) Binary logarithm
C) Decimal logarithm
D) Natural logarithm
  • 80. What logarithmic base is the nat based on?
A) Natural logarithm
B) Binary logarithm
C) Common logarithm
D) Base-two logarithm
  • 81. What logarithmic base is the decimal digit based on?
A) Base-e logarithm
B) Binary logarithm
C) Natural logarithm
D) Common logarithm
  • 82. What does the maximum value of entropy represent?
A) The most predictable state
B) The most unpredictable state
C) A deterministic sequence
D) The lowest possible information content
  • 83. What logarithmic base measures entropy in bytes per symbol?
A) Base-e
B) Base-10
C) Base-256
D) Base-2
  • 84. What type of trial has two outcomes for the binary entropy function?
A) A Markov trial
B) A Bernoulli trial
C) A logarithmic trial
D) An equiprobable trial
  • 85. What is another name for conditional entropy?
A) Mutual information
B) Marginal entropy
C) Joint entropy
D) Equivocation
  • 86. What is another name for mutual information according to the text?
A) Kullback-Leibler divergence
B) Log-likelihood ratio
C) Transinformation
D) Pointwise mutual information
  • 87. In what field is mutual information particularly important for maximizing shared information between sent and received signals?
A) Quantum mechanics
B) Thermodynamics
C) Macroeconomics
D) Communication
  • 88. Mutual information can be expressed as the average of which divergence?
A) Kullback-Leibler divergence
B) Jensen-Shannon divergence
C) Mahalanobis distance
D) Euclidean distance
  • 89. With which statistical test is mutual information closely related in the context of contingency tables?
A) Log-likelihood ratio test
B) Mann-Whitney U test
C) Shapiro-Wilk test
D) Student's t-test
  • 90. What type of mathematical function is the KL divergence classified as?
A) Semi-quasimetric
B) Linear transformation
C) Euclidean metric
D) Inner product
  • 91. In the alternative interpretation involving Alice and Bob, who knows the true probability distribution p(x)?
A) Alice
B) Bob
C) Both
D) Neither
  • 92. According to the surprise interpretation, who will be more surprised on average upon seeing the value of X?
A) Bob
B) Both will be equally surprised
C) It is impossible to determine
D) Alice
  • 93. What type of set is X assumed to be when drawing a random number in the surprise interpretation?
A) An infinite continuous set
B) A discrete set
C) A finite geometric set
D) An empty set
  • 94. Does directed information apply to statistical physics?
A) Only in macroscopic mechanics
B) No
C) Only in quantum states
D) Yes
  • 95. What does the random process Xn consist of?
A) {X1, X2, ..., X_n}
B) {Y1, Y2, ..., Y_n}
C) {X1, Y1, ..., X_n, Y_n}
D) {X0, X1, ..., X_{n-1}}
  • 96. What do the two expressions for the rate give for stationary sources?
A) An undefined value
B) The same result
C) A result of zero
D) Completely different results
  • 97. How is the noise nature of the channel considered in the text?
A) A completely controllable variable
B) An inherent fixed property
C) An unpredictable random variable that changes constantly
D) A negligible factor in modern systems
  • 98. What is the crossover probability of a binary symmetric channel denoted as?
A) p
B) e
C) i
D) Hb
  • 99. What does a binary symmetric channel do to the input bit with probability p?
A) Erases the input bit
B) Delays the input bit
C) Flips the input bit
D) Duplicates the input bit
  • 100. What feature do many channels have in practice?
A) Memory
B) Gaussian noise
C) Ternary input
D) Zero capacity
Létrehozva That Quiz — a matematika és más tantárgyak teszt létrehozásának és osztályozásának webhelye.