Interpersonal Rejection Anxiety Questionnaire (IRAQ): Psychometric Properties of the Greek Version ()
1. Introduction
The unusually prolonged vulnerability state of human infancy is liable for attachment patterns to caregivers (Bowlby, 1969, 1980, 1988) . This need for significant others is sustained throughout the lifespan (Baumeister & Leary, 1995) . These early patterns for attachment progressively become attachment styles (e.g., attachment theory; Hazan & Shaver, 1987; Simpson, 1999 ), and the challenge is shifted from preserving connection to the primary caregiver to establishing and maintaining intimacy in adult interpersonal relationships (Erikson, 1968; Reker et al., 1987; Steger, Beeby, Garrett, & Kashdan, 2013) .
Interpersonal relationships and interpersonal/social anxiety
Indeed, satisfying interpersonal relationships are related with numerous positive outcomes, including positive physical health self-esteem, and a sense of well-being and life satisfaction (Diener & Seligman, 2002; Leary, 2004; Mruk, 2006; Sedikides, Oliver, & Campbell, 1994) . On the other hand, interpersonal anxiety (IA)1 limits the ability to get involved in and continue interpersonal relationships and thus to gain the potential benefits of social support and intimacy from partners enhancing positive experiences and flourishing (Ferssizidis, Kashdan, Marquart, & Steger, 2013; Safren & Heimberg, 1999) .
Interpersonal anxiety is defined as fear and avoidance of situations that may involve evaluation by others—especially significant others (Safren & Heimberg, 1999; Safren, Hollander, Hart, & Heimberg, 2001) . It is described as a fear of being scrutinized by other individuals because this could potentially result in a negative evaluation and/or rejection (Rapee & Heimberg, 1997; Rohner, 2014) . Excessive interpersonal anxiety is related to interpersonal distress and with a significant diminishing of the overall life quality (Kessler et al., 1994; Safren, Heimberg, Brown, & Holle, 1997) .
Research evidence generally indicates that individuals with IA have dysfunctional interpersonal and cognitive styles that impair their social performance and increase the rejection possibility (Clark & Wells, 1995; Kashdan & Roberts, 2004a; Rapee & Heimberg, 1997) . Specifically, during social interactions, they tend to focus extensively on making a positive impression. However, often they perceive themselves incapable of achieving this goal because anxiety disrupts their social performance (Rapee & Heimberg, 1997; Ferssizidis et al., 2013) . Making every possible effort to reduce the probability of rejection, people with IA frequently attempt to control or escape anxious thoughts and emotional states by avoiding anxiety-provoking stimuli. Therefore, during social/interpersonal interactions they adopt a “protective” behaviors like limited eye contact or conversation with others to minimize the rejection possibility (Clark & Wells, 1995) . However, this rejection prevention “strategy”, makes the socially anxious individual less available and responsive, thus less likely to pursue activities generating positive interpersonal outcomes (Ferssizidis et al., 2013; Kashdan, Ferssizidis, Farmer, Adams, & McKnight, 2013) . The impact of this unresponsiveness and/or unavailability can be even greater on certain age categories like adolescents (Beidel & Turner, 1998) .
1The term Interpersonal Anxiety is used interchangeably with the term Social Anxiety as emerged by the literature review.
By closely focusing extensively on signs of negative evaluation, high-IA individuals may neglect positive aspects during their social interactions, because this is more consistent with their negatively distorted self-views, worldviews (Rohner, 1975, 1986) or mental representations ( Baldwin, 1992; Epstein, 1994; Rohner & Khaleque, 2016). These distortions and biases impair their ability to respond to social interactions, a variable that is potentially fueling positive interpersonal outcomes such as intimacy (Davis, 1982; Kashdan & Roberts, 2004b) , or positive resonance (Fredrickson, 2013) . Perceived interpersonal rejection (see also Rohner, 2014; Rohner, 2016 ) may contribute to more generalized biased cognitive estimations. For example, individuals recalling a time when they felt accepted by others gave higher estimates of room temperature than those in the same room who perceived they were rejected (Conway, Tugade, Catalino, & Fredrickson, 2013; Zhong & Leonardelli, 2008) . Moreover, compared to their less anxious peers, high-IA individuals are more likely: 1) to rate their sexual episodes as less enjoyable and 2) to feel less emotionally connected to their sex partners (Ferssizidis et al., 2013) . Generally, high-IA individuals react to potential interpersonal evaluative situations with more self-focused attention than low-IA individuals (see Hartman, 1983; Hope, Gansler, & Heimberg, 1989; Rapee & Heimberg, 1997 ).
Given this significant effect of IA on interpersonal behavior, it is considered a negatively valenced personality variable regarding relationship outcomes. Interpersonal anxiety is found to be negatively associated with Positive Affect ( Brown, Chorpita, & Barlow, 1998; Kashdan, 2007; Naragon-Gainey, Watson, Gamez, & Simms, 2005; Watson, 2016; Watson, & Markon, 2009) and with high Negative Affect levels and while it has a moderately negative relation with curiosity and exploration ( Ferssizidis et al., 2013;
The origins of Interpersonal anxiety
Focusing on the origins of interpersonal anxiety, Sullivan (1953a, 1953b) proposed it is crucial during the human development process. He postulated that individuals attempt to diminish or eliminate interpersonal anxiety by limiting rejection by significant others or attachment figures (e.g. adult attachment; Bartholomew & Horowitz, 1991; Hazan & Shaver, 1987, 1990, 1994; Simpson & Rholes, 1999 ). During childhood the discovery that some behaviors reduce interpersonal anxiety, while others increase it is a key learning experience. Thus, children learn to modify their behavior to decrease the possibility of experiencing interpersonal anxiety (Sullivan, 1953b) by rejection from significant others.
In other words, “our interpersonal actions are designed to invite, pull, elicit, draw, entice, or evoke restricted classes of reactions from persons with whom we interact, especially from significant others” ( Kiesler , 1983: p. 198
Besides, based on the generalization of the secure attachment theory also in adult relationships (Bartholomew & Horowitz, 1991; Hazan & Shaver, 1987; Simpson, 1999) numerous studies associated parental rejection with psychological adjustment of children with effects over the entire adult life (Rohner, 1975; Rohner & Rohner, 1980; Rohner, 2004; Rohner & Britner, 2002) . For example, Giotsa and Touloumakos (2014) proposed that the quality of the parent-child relationship typically affects the quality of peer relationships. Other researchers (Festa & Ginsburg, 2011; Hummel & Gross, 2001; Morris, 2001; Rohner, 2014; Rohner & Khaleque, 2002) also confirmed that parental rejection is associated with higher levels of interpersonal anxiety during adulthood, that it would be a plausible predictor of it (Brook & Schmidt, 2008) . Perceived rejection from significant others is generally related to negative personality dispositions for children, adolescents and adults as well (Khaleque & Rohner, 2012; Pfeffer, Lipkins, Plutchik, & Mizruchi, 1988) . Note, that previous research on interpersonal anxiety suggested that women generally experience higher levels of interpersonal anxiety than men (Garber & Flynn, 2001; La Greca & Lopez, 1998; Giotsa, Kyriazos, & Mitrogiorgou, 2018) .
The Interpersonal Relationship Anxiety Questionnaire
A new interpersonal anxiety measure is the Interpersonal Relationship Anxiety Questionnaire (Rohner, 2012) . It is a unidimensional self-report instrument with nine statements describing symptoms of interpersonal anxiety and it is the focus of this work.
Previous research suggested that IRAQ had adequate internal consistency reliability, with a reported Cronbach’s alpha coefficient of .87 (Brown et al., 2014) in a US sample of women, .88 in a Chinese sample of adolescents (Li & Rohner, 2014) , .93 in two Pakistani samples of adolescents (Naz & Kausar, 2015) , .83 in a Croatian sample of school children, and .89 in a Croatian sample of adolescents (Vulic-Prtoric & Glavak-Tkalic, 2016) . Consequently, the instrument was also translated in Urdu (Naz & Kausar, 2015) , Chinese (Li & Rohner, 2014) Croatian, and Greek translation (Giotsa, 2015) and use (Giotsa, Stalikas, Kyriazos, & Zergiotis, 2018) .
The unidimensional structure of IRAQ was validated in all the above studies. Specifically, the validation study in the US was carried out in a sample of 78 women (Brown et al. 2014) , with a mean age of 20.17 years. IRAQ was used twice on this sample with an interval of 30 days and the test-retest reliability was adequate (r = 70, p < .01). The researcher used Principal Components Analysis with Varimax rotation and all nine items were taping a single factor explaining 50% of the variance. Factor loadings ranged from .56 to .87 ( Brown et al., 2014 ; quoted by Naz & Kausar, 2015 ). The Chinese version of IRAQ (Li & Rohner, 2014) was validated in a sample of 215 adolescents with a mean age of 16 years (as reproduced by Naz & Kausar, 2015 ). The Urdu version of IRAQ was validated both on a clinical and a non-clinical sample of 300 female adolescents (Naz & Kausar, 2015) . The IRAQ factor structure was estimated by EFA and a CFA separately on each sample (N = 150 each). First, an EFA with a Varimax rotation was carried out and all nine items were taping a single factor explaining 65% of the variance, factor loading from .47 to .76 (Naz & Kausar, 2015) . CFA confirmed the EFA results, loadings from .45 to .92 (Naz & Kausar, 2015) . When the mean scores of adolescents with somatoform disorders and adolescents with minor medical problems on IRAQ were compared, the two groups were found to be significantly different suggesting discriminant validity (Naz & Kausar, 2015) . The convergent validity of the scale (IRAQ) was assessed using the Personality Assessment Questionnaire (PAQ; Rohner & Khaleque, 2005b; Rohner, Saavedra, & Granum, 1978b ). Divergent validity was evaluated using the Warmth/ Affection, a sub-scale of the Parental Acceptance-Rejection Questionnaire (PARQ; Rohner & Khaleque, 2005a; Rohner, Saavedra, & Granum, 1978a ), see Naz and Kausar (2015) for details. Summing up the IRAQ validation studies, it has been validated in collectivistic and individualistic cultural contexts (Hofstede, 2001; Triandis, 1995) , and special populations like female adolescents with somatoform disorders (Naz & Kausar, 2015) .
The purpose of the current study (see also Figure 1) is: 1) to validate IRAQ structure in the Greek general population; 2) to examine if age, gender or relationship status affects the IRAQ latent factor of interpersonal anxiety; 3) to examine if age, gender or relationship status affects the measurement invariance of any single item (1-9) of IRAQ; 4) to examine internal consistency reliability and convergent validity of IRAQ.
2. Method
Participants
Inclusion criteria in the study were the following 1) gender, and 2) ongoing relationship status (in a relationship or not). The sample consisted of 148 adults with a mean age of 28.24 years (SD = 9.53). Seventy-four participants were males (50%). Seventy-four participants (50%) had a close interpersonal relationship. Among the 74 participants in a relationship 30% were dating, 15% were married and 5% were living together with their partner. The mean duration of the relationship was 73.92 months, (SD = 91.08) or 6.16 years. Most participants (70%) had a university degree, 18% finished high-school, 12% had a postgraduate degree and 1% finished junior high-school. About half of the participants (44%) were employed in the public or private sector, 26% were studying, 24% were unemployed, and 6% endorsed other choices (like freelance, retired and trainee). One hundred and forty participants had a Greek-orthodox religion and 8 participants endorsed “no religion”.
Materials
Interpersonal Relationship Anxiety Questionnaire (IRAQ)
Interpersonal anxiety was measured with the Interpersonal Relationship Anxiety Questionnaire (IRAQ) by Rohner (2012) . It comprises nine items describing possible emotional states of interpersonal anxiety (e.g., feeling upset, nervous
or afraid). Participants evaluate each item on a 4-point scale with the levels: 4 (almost always true), 3 (sometimes true), 2 (rarely true) and 1 (almost never true). The higher the total score the more interpersonal anxiety the respondent perceives. The possible score ranges from 9 (lowest interpersonal anxiety) to 36 (highest interpersonal anxiety). Scores that range from 1 to 15 suggest normal anxiety, from 16 to 20 mild anxiety, from 21 to 27 moderate anxiety and from 28 to 36 severe anxiety (see also Naz & Kausar, 2015 ).
Parental Acceptance-Rejection Questionnaire, Short form (PARQ).
In the Adult PARQ (Roher & Khaleque, 2005a) , adult participants reflect on their childhood experiences of maternal or paternal acceptance-rejection. There are two PARQ versions: mother and father versions. Statements in the two versions are identical except referencing “mother’s” behavior in the mother version versus “father’s” behavior in the father version. Individuals respond on a 4-point Likert-type scale from (4) “almost always true” to (1) “almost never true.” The 24 items are tapping into four dimensions: Warmth/Affection, Hostility/Aggression, Indifference/Neglect and, finally, the Undifferentiated Rejection (Rohner & Khaleque, 2005) . Scores of the four acceptance-rejection dimensions are summed after reverse scoring the warmth/affection factor. The overall score is a measure of perceived acceptance-rejection ranging from 24 (maximum perceived acceptance) to 96 (maximum perceived rejection). Scores at or above 150 indicate the experience of significantly more caregiver rejection than acceptance. Scores between 140 and 149 indicate that respondents experience serious rejection but not necessarily more overall rejection than acceptance. On the other hand, scores between 60 and 120 suggest parental love.
Khaleque & Rohner (2002) in a meta-analysis revealed the mean alpha coefficient, aggregated across all versions of the PARQ, at .89. Moreover, mean test-retest reliability (in a period from three weeks to seven years, Median = 15 months) was .62 (Khaleque & Rohner, 2002). Finally, factor analyses of the PARQ revealed a four-factor structure (Comunian & Gielen, 2000; Gomez & Rohner, 2011; Rohner & Chaki-Sircar, 1988; Rohner & Cournoyer, 1994; Rohner, Saavedra, & Granum, 1978a) .
Fear of Intimacy Scale (FIS)
The Fear of Intimacy Scale (FIS; Descutner & Thelen, 1991 ) is a 35-item questionnaire, designed to measure anxiety about intimate, romantic relationships. The fear of intimacy is defined as “the inhibited capacity of an individual, because of anxiety, to exchange thoughts and feelings of personal significance with another individual who is highly valued” (Descutner & Thelen, 1991: p. 219) . Statements (e.g. “There are people who think that I am not an easy person to get to know.”) are rated on a 5-point Likert scale, ranging from 1 (not at all characteristic of me) to 5 (extremely characteristic of me). The 15 items of the scale are reversed scored.
The FIS developers proposed a unidimensional factor structure (Descutner & Thelen, 1991; Sherman & Thelen, 1996) . However, a validation study in two samples, a Chinese and a US ( Ingersoll, Norvilitis, Zhang, Jia, & Tetewsky, 2008) proposed a 3-factor solution. The factors emerged were: Imagined Fear of Closeness (IFC), Imagined Openness (IO, reversed scored), and Past Fear of Closeness (PFC). This factor structure was used in the present study. Reported internal consistency reliability (Ingersoll et al., 2008) was α = .92 for the U.S. sample and α = .88 for the Chinese sample (Ingersoll, Norvilitis, Zhang, Jia, & Tetewsky, 2008) . Descutner and Thelen (1991) reported test-retest reliability of .89 over a 1-month period. In this study, internal consistency was α = .93.
Demographics
Participants completed a demographics questionnaire with questions addressing: age, gender, religion, level of education, employment status, and whether the respondent was partnered or un-partnered and finally the length of their interpersonal relationship.
Procedure
Participants were an ad hoc sample using network sampling. More specifically 40 postgraduate students recruited about 3 - 4 adults to voluntarily participate in the study. Before test-battery completion volunteers were briefed on the nature and purpose of the study by research team members and informed consent was signed, protecting anonymity and confidentiality of the responses during the data collection, analysis and storage. The option to withdraw from the study at any time was explicitly offered to volunteers. Then they completed a paper and pencil test-battery. The required completion time was approximately 15 minutes. Nor participants neither students received any rewards.
Software used
Analyses were conducted using R ( Development Core Team, 2018 ), Mplus 7 (Muthen & Muthen, 2012) and SPSS .25 (IBM, 2017) . R packages used were (a) Package “psych” (Revelle, 2018) and MVN version 5.5 (Korkmaz, Goksuluk, & Zararsiz, 2018) .
3. Results
Data Screening and distributional characteristics
One-hundred and forty-eight participants took part in the study. There were no missing values in the dataset because volunteers were cautioned to answer all questions during recruitment.
Prior to the CFA analysis, the data were evaluated for multivariate outliers. Evaluation of Mahalanobis distances (Mahalanobis, 1936; Rousseeuw and Van Zomeren, 1990) for each case of the dataset ( Kline, 2016; Pallant, 2016; Tabachnick & Fidell, 2013) showed there were nine multivariate outliers, p < .001. All outliers were included in subsequent analyses because they were not data entry errors thus, the exclusion was unsupported (see cases in Figure 2). The final dataset was N = 148.
The means, standard deviations, skew and kurtosis of each IRAQ item are shown in Table 1 (ps > .001). Most indicator means were around 2.19, corresponding to a scale point between “rarely true” and “sometimes true”.
Additionally, univariate normality was estimated with the following five tests: 1) Kolmogorov-Smirnov (Massey, 1951) with Lilliefors significance correction; 2) Shapiro-Wilk (Shapiro and Wilk 1965); 3) Shapiro-Francia (Shapiro & Francia, 1972; Royston, 1983); 4) Anderson-Darling; 5) Cramer-von Mises. The p values of all five univariate normality tests for the nine IRAQ observed variables were significant, p < .001.
Multivariate normality was evaluated with the following six tests: 1) Mardia’s multivariate skewness test (Mardia, 1970); 2) Mardia’s multivariate kurtosis test (Mardia, 1970); 3) Henze-Zirkler’s consistent test (Henze & Zirkler, 1990); 4) Doornik-Hansen omnibus test (Doornik & Hansen, 2008); 5) E-statistic and 6) Royston. The null hypothesis was rejected in all tests with p values < .0001. See the results of all normality tests in Table 1.
Confirmatory Factor Analysis (CFA)
The hypothesized model is overidentified, with 27 df. The ratio of cases to observed variables is 16:1 and the ratio of cases to estimated parameters is 8:1.
A robust maximum likelihood minimization function was used as an estimator (robust ML; see Yuan & Bentler, 2000). Goodness of fit was evaluated with the Standardized Root Mean Square Residual (SRMR), Root Mean Square Error of Approximation (RMSEA; Steiger & Lind, 1980) and its 90% confidence interval (90% CI), Comparative Fit Index (CFI; Bentler, 1990), and the Tucker-Lewis Index (TLI; Tucker & Lewis, 1973). As suggested by Hu and Bentler (1999), acceptable model fit was defined by the following criteria: RMSEA (≤.06, 90% CI ≤ .06, SRMR (≤.08), CFI (≥.95), and TLI (≥.95).
Based on theory and prior evidence the following two models were tested. MODEL 1 is the single factor model proposed in the literature (Brown et al., 2014; Li & Rohner, 2014; Naz & Kausar, 2015) . MODEL 2 is a variation of MODEL 1 with error covariances added in item 1 with item 8 and item 2 with item 3 (see also Naz & Kausar, 2015 for a similar approach). Covariances were based on the semantic similarity of the items, item 1 (afraid) is expected to have an error covariance with item 8 (nervous) and likewise item 2 (upset) with item 3 (anxious).
![]()
Table 1. Univariate descriptive statistics of IRAQ measured variables, univariate and multivariate normality tests.
Note. All univariate normality tests were significant at p < .001 level.
![]()
Figure 2. Adjusted Chi-Square Q-Q plot of robust squared mahalanobis distance.
Regarding model fit, MODEL1 had inadequate fit. MODEL 2, (a variation of MODEL 1 with error covariances added) had an adequate fit (see details in Table 2). Standardized parameter estimates from this solution are presented in Figure 3. The overall size of the factor loadings of the items were adequate (λ = .506 - .820), indicating a well-defined factor of interpersonal anxiety.
Multiple Indicators Multiple Causes modeling (MIMIC)
CFA with covariates or MIMIC modeling (c.f. Muthen, 1989; Jöreskog & Goldberger, 1975) offers an alternative technique for evaluating invariance of indicators and latent means in multiple groups, by regressing them onto covariates denoting group membership. Additionally, MIMIC models can handle small samples, even of N = 150 (Brown, 2015: pp. 273-274) .
![]()
Figure 3. A path diagram of the standardized solution for the optimal IRAQ model. Note. All freely estimated unstandardized parameters were statistically significant at p < .001 level. MLR estimator was used.
![]()
Table 2. Goodness of fit statistics and information criteria for the IRAQ Models specified in the CFA.
Note. *p < .01. Estimator = MLR; Bold indicates optimal fit. df = Degrees of freedom; CFI = Comparative Fit Index; TLI = Tucker-Lewis index; RMSEA = Root Mean Square Error of Approximation; CI = Confidence Interval; SRMR = Standardized Root Mean Square Residual.
The single factor model with error covariances was used as a baseline model because it was the optimal model in the preceding CFA. Next, the following three covariates (indicating group membership) were added to examine their effects on latent means and indicator intercepts: 1) Between age and interpersonal anxiety (1 = participants with aged ≥ 25 years, N = 62 or 42%; 0 = participants aged ≤ 24 years, N = 86 or 58%); 2) Between gender and interpersonal anxiety (1 = male participants, N = 74; 2 = female participants, N = 74) and 3) Between relationship status and interpersonal anxiety (1 = partnered participants, N = 74; 2 = un-partnered participants; N = 74). The results showed that this MIMIC model provided an acceptable fit to the data: χ2(49) = 70.32, SRMR = .051, RMSEA = .055 (90% CI = .020 - .081, TLI = .952, CFI = .939 (see the MIMIC model in Figure 4). Two potential sources of invariance were tested: the equivalence of factor means across groups (absence of population heterogeneity) and the equivalence of IRAQ indicator intercepts Q1-Q9 (measurement invariance).
![]()
Figure 4. Path diagram of the MIMIC Model tested. This is an ICM-CFA model on which the covariates of gender, age (≥25 and ≤24 years), and relationship status (partnered, un-partnered) were added. Note. All freely estimated unstandardized parameters were statistically significant at p < .001 level. MLR estimator was used.
Population heterogeneity: The effect of age on the latent factor of IRAQ (interpersonal anxiety) is negative and not statistically significant, (−.034, p = .791). The effect of gender on the latent factor of interpersonal anxiety is negative and not statistically significant (−.029, p = .824). The effect of relationship status on the latent factor of interpersonal anxiety is positive and not statistically significant (.005, p = .966).
Measurement Invariance: After examining the effect of gender, age and relationship status covariates on the latent factor of interpersonal anxiety, whether these covariates directly affected the observed endogenous indicators Q1-Q9 was examined. Results showed that the direct effect of age on IRAQ observed endogenous indicators (Q1-Q9) was not significant. Similarly, the direct effect of gender on IRAQ observed endogenous indicators (Q1-Q9) was also not significant. Finally, the direct effect of relationship status on indicators Q1-Q9 was not significant.
Internal Consistency Reliability
We evaluated the reliability and validity of IRAQ using Cronbach’s alpha coefficient (Cronbach, 1951) to assess the internal consistency of item responses. Alpha values ≥ .70 are considered adequate (Hair, Black, Babin, & Anderson, 2010) and ≥.80 satisfactory (Nunnally & Berstein, 1994). The internal reliability for all 9 items of IRAQ was α = .87. Alpha would not improve if any item was deleted with alphas ranging from (.843, item 1) to .865 (Item 7).
Convergent Validity
A correlation analysis was carried out to examine the relationship of Interpersonal Relationship Anxiety Questionnaire (IRAQ; Rohner (2012) with 1) Fear of Intimacy Scale (FIS; Descutner & Thelen, 1991 ); 2) the two versions (Mother and Father) of the Adult PARQ, Short Form (Roher & Khaleque, 2005a) . The correlations of IRAQ with FIS were significant, but low to moderate in magnitude, ranging from rs(146) = .18, p < .001 (PFC) to rs(146) = .35, p < .001 (IO). IRAQ was significantly and moderately correlated with FIS Total rs(146) = .33, p < .001. See Table 3 for details. There was significant moderate to strong correlations, between IRAQ and the Mother Version of Adult PARQ, ranging from rs(146) = .35, p < .001 (reversed Warmth/Affection) to rs(146) = .46, p < .001 (Indifference/Neglect). The correlations between IRAQ and the Father Version of Adult PARQ were also moderate to strong, ranging from rs(146) = .30, p < .001 (reversed Warmth/Affection) to rs(146) = .51, p < .001 (Hostility/ Aggression). The above interpretations of the magnitude of correlation adopted the criteria set by Cohen (1988). Table 3 presents all the results of the correlation analysis. Correlations of IRAQ are also presented graphically in Figure 5.
Description of IRAQ scores
Participants on average scored M = 19.73 (SD = 5.44). Score range is 9 - 36. One-half of the participants scored ≤ 20.00, 25% scored ≤ 16.00 and 75% scored ≤ 23.50.
4. Discussion
The focus of this work was to evaluate the psychometric properties of the Interpersonal Relationship Anxiety Questionnaire (IRAQ) by Rohner (2012) in Greek adults of the general population. Specifically, research objectives were the following: 1) To evaluate invariance for item intercepts and latent factor means using Multiple Indicators Multiple Causes modeling (MIMIC), controlling for the
![]()
Figure 5. Graphical representation of IRAQ correlation coefficients (Spearman’s rho) with FIS and Adult PARQ.
![]()
Table 3. Bivariate correlations between IRAQ and other variables.
Note. All correlation coefficients were significant at p < .001. FIS items allocation per factor: IFC = 1, 2, 4, 5, 9, 11, 12, 13, 15, 16, 20, 23, 24, 26, 28; IO = 3, 6, 7, 8, 10, 14, 17, 18, 19, 21, 22, 25, 27, 29, 30; PFC = 31, 32, 33, 34, 35.
effects of gender, age and relationship status. 2) To evaluate internal consistency reliability (α). 3) To examine the relation of IRAQ with the construct of fear of intimacy and reflections of perceived parental rejection (both by mother and father), evidencing Convergent Validity further. Instruments used to check convergent validity was the Fear of Intimacy Scale (FIS; Descutner & Thelen. 1991 ) and the Parental Acceptance-Rejection Questionnaire (Adult PARQ, short form by Roher & Khaleque, 2005a ). For the later, both the Mather and the father version were included to check reflected rejection of adult participants during their childhood, by both parents (see Rohner, 1975, 2004 ). The 3-faced construct validation method (Kyriazos, 2018a) could not be implemented because of the sample size (see also Kyriazos et al., 2018; Kyriazos 2018a, 2018b ).
The main findings suggested that: 1) the unidimensional factor structure of IRAQ is tenable in the Greek cultural context. 2) a MIMIC model was tested using the optimal IRAQ CFA model controlling for the effect of gender, age and relationship status on latent factor means and indicator intercepts and no significant effects were found. This is indicative of population heterogeneity and measurement invariance (see Muthen, 1989; Timothy Brown, 2015 and Wang & Wang, 2012 ). 3) Internal consistency reliability was adequate. 4) Significant correlations of IRAQ with fear of intimacy (Descutner & Thelen, 1991) and perceived reflected parental rejection (Rohner, 1975, 2004) suggested convergent validity. 5) Description of IRAQ scores followed.
Examining findings in more detail, data were first checked for data entry accuracy, and the distributions of the IRAQ observed variables were examined to see if the assumption of univariate and multivariate normality was violated. The CFA was performed to examine if the unidimensional structure of IRAQ is confirmable in this Greek Adult sample of the general population. A total of two alternative CFA models were examined. First, the single factor structure of IRAQ was tested with no error covariances in the nine observed variables. This model had an inadequate fit. Then, in line with other works found in the literature (e.g. Naz & Kausar, 2015 ) two error variances were added; one in item 1 (afraid) with item 8 (nervous) and a second in item 2 (upset) with item 3 (anxious). These additions are plausible on the basis of semantic similarities of the items (Brown, 2015) . Beyond semantic similarity, additional theoretical support for the covariance of these errors could be found in a proposed Negative Affect model by Mehrabian (1998) as described by Crawford & Henry, 2004 . In this model NA was conceptualized as a second-order factor with afraid and upset as two first-order factors, thus as basic components of NA, these items are expected to have correlated error variances. Taking into account the goodness of fit statistics and the factor loadings the fit of this model was adequate. Evidence of construct validity was supported further because all fit measures reached the suggested levels of significance (Hair et al., 2010) . Additionally, this single factor structure was also established in other cultural contexts, i.e. in a US women sample (Brown et al., 2014) , in a Chinese sample of adolescents (Li & Rohner, 2014), in schoolchildren from Croatia. Finally, the Urdu version of IRAQ was also found to be unidimensional, used both on a clinical and a non-clinical sample of female adolescents (Naz & Kausar, 2015) . Generally, to the best of our knowledge, the above empirical findings cannot be compared to similar results, due to a lack of empirical literature on IRAQ factor structure in the general adult population.
Regarding sample power of the model, the ratio of cases to observed variables was above the sample-to-variable acceptability threshold ranging from 5:1 - 10:1 for up to N = 300 (DeVellis, 2017; Tinsley & Tinsley, 1987) . Respectively, the ratio of sample to estimated parameters was equally satisfactory (Kline, 2016) . Hence, sample power was adequate taking into account the high-reliability coefficients of IRAQ (DeVellis, 2017; Kyriazos, 2018b; Ullman, 2013) .
Moreover, the optimal CFA model was used as a measurement model in a CFA with covariates modeling (MIMIC). The covariates of gender, age, and relationship status were tested for direct effects on the latent factor means and on indicator intercepts. The MIMIC model had an adequate fit and thus potential sources of invariance in latent means and indicator intercepts were tested (Brown, 2015) . First, by adding the covariate onto the interpersonal anxiety the equivalence of factor means was evaluated across groups (population heterogeneity). A significant direct effect of either the covariate of age, gender or relationship status on the interpersonal anxiety latent factor would equal population heterogeneity. This essentially would mean that mean interpersonal anxiety is different at different levels of the covariates (Brown, 2015; Wang & Wang, 2012) , however, no statistically significant effects were found. The direct effects of the covariates on social anxiety were not statistically significant. Thus, no population heterogeneity was found for interpersonal anxiety as measured by IRAQ. In practice, this means that the mean of the interpersonal anxiety latent factor is not different at different levels of the three covariates tested (age, sex, relationship status). Respondents’ gender, aged or being partnered/un-partnered does not influence factor means (see Brown, 2015 ) and Wang and Wang (2012) for details.
Second, by MIMIC modeling, we can also investigate if these three covariates have a direct impact on the indicators of IRAQ Q1-Q9. A significant direct effect of any of these covariates on an indicator intercept would suggest that the value of the indicator differs by the values of the covariate, if the social anxiety latent factor is held constant (i.e. Differential item functioning; Muthen, 1989; Brown, 2015 ). However, no salient direct effects were present. This suggests there is measurement invariance between the groups, i.e. the value of Q1-Q9 does not differ by the values of any of the three covariates if the social anxiety latent factor is held constant. That is, when the factor is held constant irrespectively of the respondent’s gender, age or relationship status, the intercepts of each of the nine IRAQ indicators show measurement invariance when latent factor mean does not change (Brown, 2015) .
Internal consistency reliability was significant. Finally, correlation analysis that followed showed that IRAQ is significantly correlated with fear of intimacy (Descutner & Thelen, 1991) and perceived parental rejection during childhood ( Rohner , 1975,
5. Conclusion
The basic finding and strength of the present study are that the unidimensional structure of IRAQ is first validated in the general adult population. A second prominent finding is that interpersonal anxiety mean is not different at various levels of the indicators irrespectively of the gender, age and relationship status of the respondent. The same is true for indicator intercepts if a latent factor is held constant. This excludes the possibility of measurement biased when using IRAQ (Damasio & Koller, 2015) . Reliability and validity results were also adequate.
However, the present study has certain limitations. The most obvious is the marginally acceptable sample size and the second is the absence of additional measures to test convergent and discriminant validity because Greek versions for various measures are often unavailable. However, sample power was not bad and the model had sufficient psychometric properties (model fit, factor loadings, and reliability coefficients) to counterbalance small sample size (DeVellis, 2017) . Nevertheless, results must be replicated in a larger sample. Another problem could potentially be the use of error covariances, especially in combination with the marginally acceptable sample size and no cross-validation of the results followed (Byrne, 2012; Brown, 2015 ). However, the obvious content similarity of the co-varied items offsets these shortcomings (Brown, 2015) . Future research should replicate the current study to samples including more instruments, more age groups, and different cultures. Considering all the above findings IRAQ is a valid and reliable measure of interpersonal anxiety, with reliable psychometric properties exposing measurement invariance and absence of heterogeneity for the Greek adult population.