The Computational Theory of Intelligence: Information Entropy

Daniel Kovach^1*

¹Kovach Technologies, San Jose, CA, USA.

DOI: 10.4236/ijmnta.2014.34020                

Abstract

This paper presents an information theoretic approach to the concept of intelligence in the computational sense. We introduce a probabilistic framework from which computation alintelligence is shown to be an entropy minimizing process at the local level. Using this new scheme, we develop a simple data driven clustering example and discuss its applications.

Keywords

Machine Learning, Artificial Intelligence, Entropy, Computer Science, Intelligence

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Wechsler, D. and Matarazzo, J.D. (1972) Wechsler’s Measurement and Appraisal of Adult Intelligence. Oxford UP, New York.
[2]	Gardner, H. (1993) Frames of the Mind: The Theory of Multiple Intelligences. Basic, New York.
[3]	Sternberg, R.J. (1982) Handbook of Human Intelligence. Cambridge UP, Cambridge Cambridgeshire.
[4]	Hawkins, J. and Sandra, B. (2004) On Intelligence. Times, New York.
[5]	Ihara, S. (1993) Information Theory for Continuous Systems. World Scientific, Singapore.
[6]	Schroeder, D.V. (2000) An Introduction to Thermal Physics. Addison Wesley, San Francisco.
[7]	Penrose, R. (2011) Cycles of Time: An Extraordinary New View of the Universe. Alfred A. Knopf, New York.
[8]	Hawking, S.W. (1998) A Brief History of Time. Bantam, New York.
[9]	Jones, M.T. (2008) Artificial Intelligence: A Systems Approach. Infinity Science, Hingham.
[10]	Russell, S.J. and Peter, No. (2003) Artificial Intelligence: A Modern Approach. Prentice Hall/Pearson Education, Upper Saddle River.
[11]	(2013) Download Python. N.p., n.d. Web. 17 August 2013. http://www.python.org/getit
[12]	Marr, D. and Poggio, T. (1979) A Computational Theory of Human Stereo Vision. Proceedings of the Royal Society B: Biological Sciences, 204, 301-328. http://dx.doi.org/10.1098/rspb.1979.0029
[13]	Meyer, D.E. and Kieras, D.E. (1997) A Computational Theory of Executive Cognitive Processes and Multiple-Task Performance: Part I. Basic Mechanisms. Psychological Review, 104, 3-65. http://dx.doi.org/10.1098/rspb.1979.0029
[14]	Wissner-Gross, A. and Freer, C. (2013) Causal Entropic Forces. Physical Review Letters, 110, Article ID: 168702. http://dx.doi.org/10.1103/PhysRevLett.110.168702
[15]	(2013) Entropica. N.p., n.d. Web. 17 August 2013. http://www.entropica.com