Terra, E. and Clarke, C.L.A. (2003) Frequency Estimates for Statistical Word Similarity Measures. Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, Vol. 1, Edmonton, 27 May-1 June 2003, 165-172.
https://doi.org/10.3115/1073445.1073477

has been cited by the following article:

• TITLE: Measuring Dynamic Correlations of Words in Written Texts with an Autocorrelation Function

  AUTHORS: Hiroshi Ogura, Hiromi Amano, Masato Kondo

  KEYWORDS: Autocorrelation Function, Word Occurrence, Kohlrausch-Williams-Watts Function, Stochastic Process, Poisson Point Process

  JOURNAL NAME: Journal of Data Analysis and Information Processing, Vol.7 No.2, May 27, 2019

  ABSTRACT: In this study, we regard written texts as time series data and try to investigate dynamic correlations of word occurrences by utilizing an autocorrelation function (ACF). After defining appropriate formula for the ACF that is suitable for expressing the dynamic correlations of words, we use the formula to calculate ACFs for frequent words in 12 books. The ACFs obtained can be classified into two groups: One group of ACFs shows dynamic correlations, with these ACFs well described by a modified Kohlrausch-Williams-Watts (KWW) function; the other group of ACFs shows no correlations, with these ACFs fitted by a simple stepdown function. A word having the former ACF is called a Type-I word and a word with the latter ACF is called a Type-II word. It is also shown that the ACFs of Type-II words can be derived theoretically by assuming that the stochastic process governing word occurrence is a homogeneous Poisson point process. Based on the fitting of the ACFs by KWW and stepdown functions, we propose a measure of word importance which expresses the extent to which a word is important in a particular text. The validity of the measure is confirmed by using the Kleinburg’s burst detection algorithm.