The Computational Theory of Intelligence: Information Entropy
Daniel Kovach1*
1Kovach Technologies, San Jose, CA, USA.
DOI: 10.4236/ijmnta.2014.34020   PDF   HTML     4,960 Downloads   6,242 Views   Citations


This paper presents an information theoretic approach to the concept of intelligence in the computational sense. We introduce a probabilistic framework from which computation alintelligence is shown to be an entropy minimizing process at the local level. Using this new scheme, we develop a simple data driven clustering example and discuss its applications.

Share and Cite:

Kovach, D. (2014) The Computational Theory of Intelligence: Information Entropy. International Journal of Modern Nonlinear Theory and Application, 3, 182-190. doi: 10.4236/ijmnta.2014.34020.

Conflicts of Interest

The authors declare no conflicts of interest.


[1] Wechsler, D. and Matarazzo, J.D. (1972) Wechsler’s Measurement and Appraisal of Adult Intelligence. Oxford UP, New York.
[2] Gardner, H. (1993) Frames of the Mind: The Theory of Multiple Intelligences. Basic, New York.
[3] Sternberg, R.J. (1982) Handbook of Human Intelligence. Cambridge UP, Cambridge Cambridgeshire.
[4] Hawkins, J. and Sandra, B. (2004) On Intelligence. Times, New York.
[5] Ihara, S. (1993) Information Theory for Continuous Systems. World Scientific, Singapore.
[6] Schroeder, D.V. (2000) An Introduction to Thermal Physics. Addison Wesley, San Francisco.
[7] Penrose, R. (2011) Cycles of Time: An Extraordinary New View of the Universe. Alfred A. Knopf, New York.
[8] Hawking, S.W. (1998) A Brief History of Time. Bantam, New York.
[9] Jones, M.T. (2008) Artificial Intelligence: A Systems Approach. Infinity Science, Hingham.
[10] Russell, S.J. and Peter, No. (2003) Artificial Intelligence: A Modern Approach. Prentice Hall/Pearson Education, Upper Saddle River.
[11] (2013) Download Python. N.p., n.d. Web. 17 August 2013.
[12] Marr, D. and Poggio, T. (1979) A Computational Theory of Human Stereo Vision. Proceedings of the Royal Society B: Biological Sciences, 204, 301-328.
[13] Meyer, D.E. and Kieras, D.E. (1997) A Computational Theory of Executive Cognitive Processes and Multiple-Task Performance: Part I. Basic Mechanisms. Psychological Review, 104, 3-65.
[14] Wissner-Gross, A. and Freer, C. (2013) Causal Entropic Forces. Physical Review Letters, 110, Article ID: 168702.
[15] (2013) Entropica. N.p., n.d. Web. 17 August 2013.

Copyright © 2022 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.