Where Have All the Worriers Gone? Temporal Instability of the Abbreviated Penn State Worry Questionnaire Limits Reliable Screening for High Trait Worry


Participant selection is an important step in research on individual differences. If detecting an effect of a personality variable is predicated on the use of extreme groups, then mistakenly including participants who are not in the extremes may weaken the ability to see an effect. In this study, changes in trait worry were evaluated in 68 undergraduate students reporting low or high levels of worry. Participants completed the abbreviated Penn State Worry Questionnaire (PSWQ-A) three times: 1) at the beginning of the se- mester; 2) 3 - 13 weeks later; and 3) 1 hr later, following a psychophysiological assessment session. Test–retest reliability across the three administrations was high, but almost half of the sample no longer met the pre-defined criteria for classification as low or high worriers at the second administration. That is, scores were reliable, but not stable, across time. Instability of self-report worry was significantly greater for high worriers than for low worriers, and this effect was predicted by trait anxiety at the beginning of the semester. These findings suggest that the PSWQ-A is sensitive to factors other than trait worry, which may result in dilution of effects when participants are selected for extreme worry scores. This also sug- gests that screening participants weeks before the actual study should be supplemented by readministra- tion of the screening questionnaire, to identify participants who no longer meet criteria for inclusion.

Share and Cite:

Spence, T. , Blumenthal, T. & Brenes, G. (2012). Where Have All the Worriers Gone? Temporal Instability of the Abbreviated Penn State Worry Questionnaire Limits Reliable Screening for High Trait Worry. Psychology, 3, 940-946. doi: 10.4236/psych.2012.311141.

Conflicts of Interest

The authors declare no conflicts of interest.


[1] American Psychiatric Association (1987). Diagnostic and statistical manual of mental disorders (3rd ed.). Washington DC: American Psychiatric Association.
[2] American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders. (4th ed.). Washington DC: American Psychiatric Association.
[3] Borkovec, T. D. (1994). The nature, functions, and origins of worry. In G. Davey, & F. Tallis (Eds.), Worrying: Perspectives on theory, assessment and treatment (pp. 5-33). Chichester: John Wiley & Sons.
[4] Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155159. doi:10.1037/0033-2909.112.1.155
[5] Crittendon, J., & Hopko, D. R. (2006). Assessing worry in older and younger adults: Psychometric properties of an abbreviated Penn State Worry Questionnaire (PSWQ-A). Journal of Anxiety Disorders, 20, 1036-1054. doi:10.1016/j.janxdis.2005.11.006
[6] Delgado, L. C., Guerra, P., Perakakis, P., Mata, J. L., Perez, M. N., & Vila, J. (2009). Psychophysiological correlates of chronic worry: Cued versus non-cued fear reaction. International Journal of Psychophysiology, 74, 280-287. doi:10.1016/j.ijpsycho.2009.10.007
[7] Goldberg, L. R. (1978). The reliability of reliability: The generality and correlates of intra-individual consistency in responses to structured personality inventories. Applied Psychological Measurement, 2, 269291. doi:10.1177/014662167800200209
[8] Hazen, R. A., Vasey, M. W., & Schmidt, N. B. (2009). Attentional retraining: A randomized clinical trial for pathological worry. Journal of Psychiatric Research, 43, 627-633. doi:10.1016/j.jpsychires.2008.07.004
[9] Hopko, D. R., Stanley, M. A., Reas, D. L., Wetherell, J. L., Beck, J. G., Novy, D. M. et al. (2003). Assessing worry in older adults: Confirmatory factor analysis of the Penn State Worry Questionnaire and psychometric properties of an abbreviated model. Psychological Assessment, 15, 173-183. doi:10.1037/1040-3590.15.2.173
[10] Krebs, G., Hirsch, C. R., & Mathews, A. (2010). The effect of attention modification with explicit vs. minimal instructions on worry. Behavior Research and Therapy, 48, 251-256. doi:10.1016/j.brat.2009.10.009
[11] Knowles, E. S., Coker, M. C., Scott, R. A., Cook, D. A., & Neville, J. W. (1996). Measurement-induced improvement in anxiety: Mean shifts with repeated assessment. Journal of Personality and Social Psychology, 71, 352-363. doi:10.1037/0022-3514.71.2.352
[12] Mathews, A. (1990). Why worry? The cognitive function of anxiety. Behavior Research and Therapy, 28, 455-468. doi:10.1016/0005-7967(90)90132-3
[13] Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990). Development and validation of the Penn State Worry Questionnaire. Behavior Research and Therapy, 28, 487-495. doi:10.1016/0005-7967(90)90135-6
[14] Mischel, W. (1977). On the future of personality measurement. American Psychologist, 34, 246-254. doi:10.1037/0003-066X.32.4.246
[15] Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385-401. doi:10.1177/014662167700100306
[16] Ruscio, A. M., & Borkovec, T. D. (2004). Experience and appraisal of worry among high worriers with and without generalized anxiety disorder. Behavior Research and Therapy, 42, 1469-1482. doi:10.1016/j.brat.2003.10.007
[17] Schuerger, J. M., Zarrella, K. L., & Hotz, A. S. (1989). Factors that influence the temporal stability of personality by questionnaire. Journal of Personality and Social Psychology, 56, 777-783. doi:10.1037/0022-3514.56.5.777
[18] Spielberger, C. D., Gorsuch, R. L., Lushene, R., Vagg, P. R., & Jacobs, G. A. (1983). Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press.
[19] Spitzer, R. L., Kroenke, K., Williams, J. B., & Lowe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166, 1092-1097. doi:10.1001/archinte.166.10.1092
[20] Stober, J. (1998). Reliability and validity of two widely-used worry questionnaires: Self-report and self-peer convergence. Personality and Individual Differences, 24, 887-890. doi:10.1016/S0191-8869(97)00232-8
[21] Tallis, F., Eysenck, M., & Mathews, A. (1991). Elevated evidence requirements and worry. Personality and Individual Differences, 12, 21-27. doi:10.1016/0191-8869(91)90128-X
[22] Windle, C. (1954). Test-retest effect on personality questionnaires. Educational and Psychological Measurement, 14, 617-633. doi:10.1177/001316445401400404

Copyright © 2021 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.