Author(s)

Kazuyuki Fujii^1,2

¹International College of Arts and Sciences, Yokohama City University, Yokohama, Japan.
²Department of Mathematical Sciences, Shibaura Institute of Technology, Saitama, Japan.

The least squares method is one of the most fundamental methods in Statistics to estimate correlations among various data. On the other hand, Deep Learning is the heart of Artificial Intelligence and it is a learning method based on the least squares. In this paper we reconsider the least squares method from the view point of Deep Learning and we carry out the computation thoroughly for the gradient descent sequence in a very simple setting. Depending on the values of the learning rate, an essential parameter of Deep Learning, the least squares methods of Statistics and Deep Learning reveal an interesting difference.

Least Squares Method, Statistics, Deep Learning, Learning Rate, Linear Algebra

Fujii, K. (2018) Least Squares Method from the View Point of Deep Learning. Advances in Pure Mathematics, 8, 485-493. doi: 10.4236/apm.2018.85027.