Original Photo adapted from Hansueli Kramer / CC BY
Original Photo adapted from Hansueli Kramer / CC BY
|
|
Session Overview |
|
| |
| 8:30am - 9:30am | K3: Ambulatory Assessment: Promises and Challenges Session Chair: Tuulia M. Ortner Ulrich Ebner-Priemer (Karlsruhe Institute of Technology, Germany) |
| KO2-F-180 (Ⅵ) | |
| 9:45am - 11:15am | IS3: Recent Methodological Developments for Testing Measurement Invariance Session Chair: Carolin Strobl |
| KO2-F-180 (Ⅵ) | |
|
|
Recent methodological developments for testing measurement invariance
This symposium gives an overview over recent methodological developments for testing measurement invariance in item response theory, factor analysis, and cognitive diagnosis models.
Presentations of the Symposium Detecting violations of measurement invariance in item response theory ; carolin.strobl@uzh.chcarolin.strobl@uzh.ch
The main aim of educational and psychological testing is to provide a means for objective and fair comparisons between different test takers by establishing measurement invariance. However, in practical test development measurement, invariance is often violated by differential item functioning (DIF), which can lead to an unfair advantage or disadvantage for certain groups of test takers. A variety of statistical methods has been suggested for detecting DIF in item response theory (IRT) models, such as the Rasch model, that are increasingly used in educational and psychological testing. However, most of these methods are designed for the comparison of pre-specified focal and reference groups, such as females vs. males, whereas in reality the group of disadvantaged test takers may be formed by a complex combination of several covariates, such as females only up to a certain age. In this talk, a new framework for DIF detection based on model-based recursive partitioning is presented that can detect groups of test takers exhibiting DIF in a data-driven way. The talk outlines the statistical methodology behind the new approach as well as its practical application for binary and polytomous IRT models.
Score-based tests of measurement invariance with respect to continuous and ordinal variables ; Achim.Zeileis@uibk.ac.atAchim.Zeileis@uibk.ac.at
The issue of measurement invariance commonly arises in psychometric models and is typically assessed via likelihood ratio tests, Lagrange multiplier tests, and Wald tests, all of which require advance definition of the number of groups, group membership, and offending model parameters. We present a family of recently-proposed measurement invariance tests that are based on the scores of a fitted model (i.e., observation-wise derivatives of the log-likelihood with respect to the model parameters). This family can be used to test for measurement invariance w.r.t. a continuous auxiliary variable, without pre-specification of subgroups. Moreover, the family can be used when one wishes to test for measurement invariance w.r.t. an ordinal auxiliary variable, yielding test statistics that are sensitive to violations that are monotonically related to the ordinal variable (and less sensitive to non-monotonic violations). The tests can be viewed as generalizations of the Lagrange multiplier (or score) test and they are especially useful for identifying subgroups of individuals that violate measurement invariance (without prespecified thresholds) as well as identifying specific parameters impacted by measurement invariance violations. We illustrate how the tests can be applied in practice in factor-analytic contexts using the R packages "lavaan" for model estimation and "strucchange" for carrying out the tests and visualization of the results.
Exact versus approximate measurement invariance. Theoretical overview and empirical examples ; jancieciuch@gazeta.pljancieciuch@gazeta.pl
Measurement invariance is a necessary condition for conducting meaningful comparisons of means and relationships between variables across groups (Vandenberg & Lance, 2000). Measurement invariance implies that the parameters of a measurement model (factor loadings, intercepts) are equal across groups. One of the most frequently used procedures for measurement invariance testing is multigroup confirmatory factor analysis (MGCFA) which compares the fit indices between models with parameters constrained to be equal across groups and those with freely estimated parameters. Three levels of measurement invariance are usually distinguished: configural (the same items load on the same factors in each group), metric (factor loadings are constrained to be exactly equal across groups) and scalar (factor loadings and the intercepts are constrained to be exactly equal across groups). Establishing measurement invariance in this approach is very difficult and this method has been criticized as being unrealistic and too strict. Muthén and Asparouhov (2013) recently proposed a new approach to test for approximate rather than exact measurement invariance using Bayesian MGCFA. Approximate measurement invariance permits small differences between parameters (loadings and intercepts) otherwise constrained to be equal in the classical exact approach. In the presentation we will discuss the main differences between the exact and approximate approaches to test for measurement invariance. Furthermore, we will compare results obtained in both approaches while testing for the measurement invariance of the Portrait Value Questionnaire developed by Schwartz and colleagues (2001, 2012) to measure values. The results suggest that the approximate measurement invariance seems to be more likely than the exact approach to establish measurement invariance which enables meaningful cross-group comparisons.
Differential item functioning in cognitive diagnosis models ; m.philipp@psychologie.uzh.chm.philipp@psychologie.uzh.ch
Cognitive diagnosis models (CDMs) are a family of psychometric models for analyzing dichotomous response data. They provide detailed information about mastery or non-mastery of predefined skills, which are required to solve the tested items, and can thus reflect the strengths and weaknesses of the examinees in the form of a skills profile. In the context of educational testing, this means that the students can be given detailed feedback, which particular skills they need to practice more, rather than only being reported their overall test performance. However, for reliable interpretation and fair comparisons these models also rely on measurement invariance, which may be violated in practice by differential item functioning (DIF). Taking the simplest version of a CDM, the non-compensatory DINA model, as an example, the talk introduces the general principles of CDMs, explains what DIF means in this context and presents an overview over recent approaches for detecting DIF in CDMs.
|
| 9:45am - 11:15am | S3: Vulnerabilities and Resources at Work and in Career Development Session Chair: Grégoire Bollmann |
| KOL-G-217 (Ⅳ) | |
|
|
Vulnerabilities and resources at work and in career development
Within the Swiss National Center of Competence in Research LIVES, vulnerabilities and resources can be conceived at multiple levels. Here we bring together researchers interested to track down various forms and sources of these two concepts in the domains of career development and work. This symposium will showcase a collection of newly developed instruments investigating the multiple levels at which vulnerabilities and resources can be experienced and respectively garnered, namely within individuals, in their interpersonal relationships or the broader normative context.
Starting within individuals in career development, Rochat and Rossier explore the validity of the career decision-making difficulties scale and its relationship with various forms of self-esteem. Sgaramella and colleagues then identify future orientation and resilience as relevant resources for individuals’ career and life paths. The next two talks then proceed with vulnerabilities and resources in individuals’ interpersonal and normative context. Introducing humor at work, Hofmann and Ruch validate a short instrument of dispositions toward ridicule and laughter and present their relations with work related outcomes. Finally, Bollmann, and Mena examine people endorsement of the free market system as an institution permeating society and its implications for the self and decision-making at work. Presentations of the Symposium Validation of the Career Decision-Making Difficulties Scale (CDDQ) in a Francophone context ; shekina.rochat@unil.chshekina.rochat@unil.ch
Indecision may be understood as a normative part of the developmental process if not —to a certain extent—an adaptive attitude toward the career choice. However, encountering severe career decision-making difficulties can also threaten career paths. This study presents the validation of the French-language version of the Career Decision-Making Difficulties Questionnaire (CDDQ) among 1,750 French-speaking adolescents and young adults. The structure of the CDDQ-French form was verified through confirmatory factor analysis (CFA), and multigroup CFA were used to test the measurement equivalence across a general sample and a clinical sample. Relationship with the short form of the Career Decision-Making Self-Efficacy Scale (CDMES-SF) and the Self-Esteem Scale (SES) were also explored. Implications of these findings for the assessment and support of vulnerabilities associated with career choice are discussed.
More complex times require more attention to future orientation, resilience, and methodological choices in Life Design approach ; teresamaria.sgaramella@unipd.itteresamaria.sgaramella@unipd.it
The complex times that people are currently living in, and challenges they frequently face, raise new questions and draw the attention to dimensions such as future orientation, resilience (Soresi et al., 2015), and to their possible role in Life Design (Nota et al., 2014; Savickas, et al., 2009).
A further, more compelling, challenge comes from the increasingly larger number of marginalized and vulnerable individuals (from unemployed to people with disabilities, addiction or psychopathological problems) who experience difficulties and add relevant questions about determinants and resources available to them for a successful Life Designing (Sgaramella et al., 2015). In order to face these challenges (besides career adaptability) additional quantitative and qualitative measures have been recently introduced in research conducted in the LARIOS laboratory, such as Design My Future, Vision about the future (Soresi et al., 2012 ab) and My Future Interview (Sgaramella et al., 2014). After examining their psychometric properties, patterns of association with other relevant resources in life designing have been analyzed. Results from large groups of young and adults, and particularly those coming from individuals experiencing vulnerabilities, support the relevance of these dimensions in Life Design studies. Their usefulness in counseling, and more specifically in career counseling, is also underscored. Validation of the PhoPhiKat-9 (Short Form) in a workplace context ; j.hofmann@psychologie.uzh.chj.hofmann@psychologie.uzh.ch
Three dispositions towards ridicule and laughter have been put forward and investigated: Gelotophobia (the fear of being laughed at), gelotophilia (the joy of being laughed at), and katagelasticism (the joy of laughing at others). Within the NCCR LIVES project, gelotophobia has been postulated to be a potential vulnerability in the work place context, where the misperception of feeling laughed at and being bullied can have detrimental effects on work stress and work satisfaction. For an economic, large-scale assessment of the three dispositions, we first developed and validated a short form (PhoPhiKat-9) of the standard self-report instrument (PhoPhiKat-45) in two independent samples. Second, the PhoPhiKat-9 was validated in a representative sample of Swiss employees in a third sample, relating gelotophobia to relevant behaviors and perceptions at the work place. Results and implications are discussed.
Believing in a free market system: Implications for the self and the society ; gregoire.bollmann@unil.chgregoire.bollmann@unil.ch
We conceptualize the belief in a free market system (BFM) as people endorsement of basic assumptions about the economy. The free market system is an institution permeating western societies in which individuals freely pursue their interests, organizations maximize their profits, State doesn’t intervene, and competition rules market exchanges. In our sense-making-intuitionist framework, the belief is an amoral cognition people endorse to satisfy fundamental motives and which make them go about their life, unaware of the moral stakes of their choices. In 5 studies involving samples of executives, students and the general population (N(total) = 1374), we develop and validate a measure of BFM and then longitudinally and cross-sectionally test its predictive power on relevant outcomes for individuals and society. BFM is a one dimensional, reliable concept, and is positively associated to social dominance and meritocracy, negatively related to need-based allocations and, crucially, unrelated to moral identity. It might serve people satisfaction with their life but increases the likelihood of amoral decisions-making at work. As such, it constitutes simultaneously a resource and a vulnerability depending on the context in which it is applied.
|
| 9:45am - 11:15am | PA11: Educational Assessment 2 Session Chair: Carl-Walter Kohlmann |
| KOL-G-204 (Ⅱ) | |
|
|
Anxiety in children and adolescents: Need for school-specific contexts for the assessment of worry and emotionality 1University of Education Schwäbisch Gmünd, Germany; 2University of Bamberg, Germany; carl-walter.kohlmann@ph-gmuend.decarl-walter.kohlmann@ph-gmuend.de
The Multidimensional Anxiety Inventory (MAI) was developed to assess emotionality and worry in three school-specific situations which vary according to academic threat (AT) and social threat (ST): performing a test (AT high, ST low), presenting in front of class (AT high, ST high), and meeting in the schoolyard (AT low, ST low). Aim of the study was to analyze factor structure, psychometric properties, and validity. Analyses are based on a sample of German students (N > 7000, age 9 to 16 years). Reliability coefficients were good for all subscales. The postulated factor structure was supported by both exploratory and confirmatory factor analyses. Emotionality was similar relevant across the three contexts, whereas worry appeared to be more specific: a) performance-related worry occurred while writing a test and while presenting in front of class, b) social-related worry was related to presenting in front of class and meeting in the schoolyard. Differential associations with criterion variables (e.g., grades, well-being, gelotophobia) support the validity of the MAI. Incorporating academic as well as social situations in an anxiety questionnaire allows for a more comprehensive assessment of anxiety in children and adolescents. Applications for educational and clinical psychology will be discussed.
The Scale "Openness for Information" (SOFI) – A new assessment tool for research on information behavior 1ZPID - Leibniz Institute for Psychology Information, Germany; 2University of Trier, Germany; mayer@zpid.demayer@zpid.de
The readiness to approach processes of informational search and evaluation in a specific manner is essential for solving complex and ill-defined information problems in scholarly contexts as well as in everyday life. The paper introduces the construct “Openness for Information” (OI) as a corresponding cognitive-motivational disposition. OI is thought to be rooted in personality and to be affected by epistemic beliefs, i.e. assumptions about the nature of knowledge. Additionally, associations with other aspects of information behavior are expected. To assess OI, the Scale Openness for Information (SOFI) was applied in four studies together with other self-report measures. The 12-item scale proved to be internally consistent (Cronbachs alpha = .82 to .87) in three samples of university students (n = 112 law, n = 116 psychology, n = 101 educational sciences) and an opportunity sample of adults aged 18 to 72 years (n = 86). Scores were significantly correlated with Need for Cognitive Closure, Openness for Experiences, and Conscientiousness. Students high in OI reported more sophisticated epistemological beliefs, more active planning of information seeking, and more reliance on scientific criteria when judging the quality of information. It is concluded that the SOFI is a useful tool for studying information behavior.
Confirmatory study of the Multidimensional Scales of Perceived Self-Efficacy with middle-school children 1University of Minho, Portugal; 2Northeast Ohio Medical University, USA; ioliveira@psi.uminho.ptioliveira@psi.uminho.pt
The Social Cognitive Career Theory (SCCT) presents childhood as a foundational period for the development of self-efficacy expectations. Self-efficacy expectations constitute one’s judgments of prospective capabilities to successfully perform a task, which impacts children’s career preferences. The Multidimensional Scales of Perceived Self-Efficacy (MSPSE) is validated to Portugal and has served the assessment of career self-efficacy from seventh-grade to college. Adding to the lack of research using the MSPSE before seventh-grade, there is no evidence of factor equivalence for genders and school levels. This work examines the applicability of the MSPSE to Portuguese fifth- and sixth-grade girls and boys. The self-efficacy expectations for academic success, self-regulated learning, and leisure and extracurricular activities scales were used due to their alignment with career development in these grades. Participants were 313 Portuguese children (137 female and 176 male; 47.9% fifth and 51.8% sixth graders, M(age) = 10.80). Confirmatory factor analyses suggested a good fit of a hierarchical measurement model, including three first-order factors and a second-order factor (composite score). Multi-group results suggested factor equivalence for genders and school levels. These results support the use of the MSPSE scales with Portuguese fifth- and sixth-grade girls and boys, which might sustain further SCCT-based research in middle-school years.
Primary school students’ social and emotional school experiences across grade levels: Adaptation and validation of the Social and Emotional School Experiences Survey—Short form (SESES-S) 1University of Duisburg-Essen, Germany; 2University of Trier, Germany; 3Université du Luxembourg, Luxembourg; tanja.baudson@uni-due.detanja.baudson@uni-due.de
Students’ school-related attitudes, relationships with classmates and teachers, academic self-concept, and other social-emotional school experiences influence both students’ wellbeing and their academic development. The younger students are, the more important these “soft factors” prove in the long run. However, brief assessments that can be administered across grades are still lacking. We propose an abbreviated and enhanced 36-item adaptation of the Social and Emotional School Experiences Survey (Fragebogen zur Erfassung emotionaler und sozialer Schulerfahrungen, FEESS; Rauer & Schuck, 2003, 2004), assessing the original seven factors (academic self-concept, social integration, class climate, attitude towards school, attitude towards learning, joy of learning, and feeling accepted by the teacher) plus facets of academic self-concept (mathematical, reading, and writing) not considered in the original. Based on the German norming sample of the THINK (Baudson, Wollschläger & Preckel, 2015; N > 2,000 students from grades 1–4 from five German federal states), evidence on criterial validity (IQ, grades, other-ratings) and model fit (first-order factor models with correlated factors) of the SESES-K will be presented along with invariance test results across grades and findings from longitudinal data.
Cognitively diagnostic feedback: Mediating factors and remedial effects University of Toronto, Canada; eun.jang@utoronto.caeun.jang@utoronto.ca
Latent trait classification methods, including diagnostic classification methods (Rupp, Templin, & Henson, 2012) and latent class modeling (Magidson & Vermunt, 2002), offer opportunities to observe, classify, and profile individual learners’ strengths and areas for improvement in detail. Resulting learner profiles can be used in the form of cognitively diagnostic feedback (CDF) for immediate intervention. However, there is a paucity of empirical research that explains the mechanism of how feedback from assessment interacts with learners’ mind. Their beliefs about intelligence and orientations to learning can powerfully influence their attention to information and further learning success (Dweck & Sorich, 1999). The paper discusses the mechanism of how CDF is perceived and used by young learners with different psycho-social profiles based on research with 105 children in Grades 5 and 6, their parents, and their teachers. The study results indicated that the use of CDF is influenced not only by actual ability, but also by the beliefs about intelligence and goal orientations that students bring to their assessment situation. Learners are sensitive to the mismatch between their expected and actual outcome. CDF indicating such conflicts can stimulate learners’ cognitive engagement and prompt them to use feedback for planning learning.
|
| 9:45am - 11:15am | PA12: Clinical Assessment 3 Session Chair: Murray Dyck |
| KOL-G-209 (Ⅲ) | |
|
|
A JND Task for assessing cross-modal sensory integration ability Griffith University, Australia; m.dyck@griffith.edu.aum.dyck@griffith.edu.au
The ability to integrate information from different sensory systems is one of several integrative functions that is impaired in autism and some other disorders. However, given the very large differences between and within individuals in sensory perception and processing abilities, constructing a metric that is reliable and valid across a broad range of abilities and sensory systems is challenging. A task has been constructed that uses the just noticeable difference procedure to standardise the difficulty of perceptual discriminations within sensory modalities as the baseline for assessing the ability to make judgments of proportional differences between stimuli that make demands on different sensory processes. In initial studies, JNDs are determined for participants’ ability to discriminate changes in the size of a circle and the luminance of a circle. Subsequently, participants indicate whether the difference in the sizes of two circles (in JND units) is proportionate to the difference in the luminances of two circles (also in JND units). Within trials, participants indicate whether stimuli are the same (size/luminance/proportions) or different. Results of two small studies (n=30, n=30) assessing relationships with other measures of sensory integration ability and with intelligence are reported.
Assessing post-traumatic growth of Hong Kong Chinese patients with chronic illnesses City University of Hong Kong, Hong Kong; sshkc@cityu.edu.hksshkc@cityu.edu.hk
The study aims to examine the psychometric properties of the Chinese Post-traumatic Growth Inventory (C-PTGI). A sample of 368 chronic patients in Hong Kong was invited to complete a questionnaire which consisted of four measurement scales, C-PTGI, HADS, ATH, and Brief COPE. Similar to other findings on Hong Kong and Taiwan Chinese (Ho et al., 2004; 2013), the subscales and total scale of C-PTGI showed acceptable internal consistency reliability (Cronbach’s alpha ranging from .66 to .85), but the original five factors proposed by Tedeschi and Calhoun (1996) did not show adequate fit as indicated by various goodness-of-fit indices provided by LISREL 9.1. Therefore, competing models were specified. From the results obtained, Post Tramatic GrowthPTG can be understood as a four factor construct (Self, Spiritual, Life Orientation, and Interpersonal) in which a higher order factor (Interpersonal) is posited above the Self, Spiritual, and Life Orientation factors. The nomological network of C-PTGI was examined by analyzing its relationship with other relevant constructs (i.e. hope, coping, anxiety, depression). To summarize, the C-PTGI correlates positively with the HOPE and COPE scales but negatively with HADS. This pattern of inter-factor correlations rendered good support to the construct validity of C-PTGI for Chinese patients with chronic illnesses.
The Indonesian version of Personality Inventory for DSM-5 (PID-5): A psychometric evaluation ATMA JAYA Catholic University of Indonesia, Indonesia; magdalena.halim@atmajaya.ac.idmagdalena.halim@atmajaya.ac.id
The Personality Inventory for DSM-5 (PID-5) was initially developed to measure pathological personality trait based on dimensional model of personality disorder as proposed for DSM-5. The current study aims to adapt and validate PID-5 for use in Indonesia. The original version of PID-5 was translated in Indonesian Language following the standard of test adaptation from the International Test Commission. The sample of this study consisted of participants with ages ranging 28 to 27 years old (n= 233, 147 females, 84 males). We used Pearson product-moment correlation, Cronbach’s alpha coefficient, exploratory and also confirmatory factor analysis whie analysing data. Result showed good reliability for all domains of Indonesian PID-5. Cronbach's α coefficients ranged from .81 - .94. Next, we found negative significant correlations between some domains of PID-5 and NEO PI-R, such as Detachment and Extroversion; Disinhibition and Conscientiousness. Based on the result of EFA and CFA, the findings of this study confirmed the five factor structure as shown on the original version, although some facets were loaded on different domains compared to the original one. In summary, the Indonesian version of PID-5 is a valid and reliable test that could be used in Indonesia population.
Clinical validation of 7-item version of NIMHANS Psychiatric Morbidity Scale National Institute Of Mental Health and Neuro Sciences, India; pmahindru86@gmail.compmahindru86@gmail.com
Screening for psychiatric morbidity helps to identify disease, enable initiation of treatment, and intervene to reduce mortality and suffering from psychological problems. There are a vast amount of screening tools, as it is common in India to screen for psychological distress among the normal and the clinical population. The present scale aims to validate the shorter version of NIMHANS psychiatric morbidity scale to screen out the psychiatric conditions among normal Indian population. The present study is a part of ongoing work to develop a tool for the assessing of psychiatric distress in the normal population. The developed scale has a sensitivity and specificity of .78 and .82 respectively. The test retest reliability of .84. It has a cut off score of 3 and above as an indicator of presence of psychological distress. Its clinical validation was carried out on a sample of 100 clinical subjects. Its construct validity was assessed using General Health Questionnaire (GHQ-5). Clinical validation of tool revealed psychometric properties to screen out psychiatric conditions in a clinical group. It has implication for its use in the Indian community and mental health settings.
MMPI-2 restructured clinical scales in diagnosis and psychotherapy treatment monitoring Jagiellonian University Medical College, Poland; katarzyna.cyranka@interia.plkatarzyna.cyranka@interia.pl
This study is an analysis of group psychotherapy influence on personality functioning of patients treated for neurotic disorders and selected personality disorders (F40-F61 according to ICD-10). The study included 82 patients (61 women and 21 men) who underwent intensive short-term group psychotherapy in a day hospital. A comprehensive assessment of the patients’ personality functioning was carried out at the outset and the end of the psychotherapy utilising the MMPI-2 questionnaire (Restructured Clinical Scales). The analysis of the restructured scales revealed that the the measure most prominently elevated at the beginning of treatment and at the same time undergoing the most intensive positive change in the course of treatment was in the majority of patients the Restructured Clinical Scale Demoralization (Rcd). It was followed by the Restructured Clinical Scale Rc7 (Dysfunctional Negative Emotions), Restructured Clinical Scale Rc2 (Low Positive Emotions) and Restructured Clinical Scale Rc1 (Somatic Complaints). The results have been statistically compared to the results obtained in the basic nine Clinical Scales. The obtained data supports that the Rcd Clinical Scale Demoralisation can be significantly useful in diagnostic process and psychotherapy treatment monitoring.
|
| 9:45am - 11:15am | PA13: Personality Session Chair: Eva Schürch |
| KOL-G-221 (Ⅴ) | |
|
|
How to measure narcissism – An ongoing discussion University of Bern, Switzerland; eva.schuerch@psy.unibe.cheva.schuerch@psy.unibe.ch
Over the last decades, research on narcissism was dominated with a focus on grandiose narcissism as measured by the NPI (Raskin & Terry, 1988), however, recent discussions emphasize the broad range of manifestations of narcissism, in particular more vulnerable aspects. As a result, new questionnaires were developed to cover the full range of these aspects. One example is the Pathological Narcissism Scale (PNI, Pincus et al. 2009), a 52 item questionnaire with seven subscales covering both grandiose and vulnerable aspects. Validation studies show that narcissism as measured with the PNI differs substantially from narcissism as measured with the NPI. Moreover, a discussion concerning the composition of grandiose and vulnerable narcissism has evolved from these data. In our study we demonstrate how scores on narcissism and narcissism subtypes are associated with a broad variety of personality and clinical measures. In a sample of 1837 participants (1240 female, 597 male; mean age 26.8 years) we investigated the correlation patterns of both PNI and NPI subscales with constructs like FFM, aggression, emotions, clinical symptoms, and well-being. Results show that the assignment of subscales to grandiose and vulnerable subtypes are not unambiguous. We therefore conclude that the decision of how to measure narcissism needs further investigation.
Social Responsibility Scale (SRS-37): A psychodiagnostic measurement tool tested for reliability, validity, and its standardisation 1Oles Honchar Dnipropetrovsk National University, Ukraine; 2National Technical University of Ukraine "KPI", Ukraine; 3University of Indiana, USA; olenakovalchuk@gmail.comolenakovalchuk@gmail.com
A 37-item tool to measure social responsibility was developed from questionnaires filled out by students at the National Technical University of Ukraine “KPI” (n = 311, age 19-24). In designing this questionnaire we summarized the theoretical and empirical studies of Ukrainian and foreign authors (Savchin, 2008; Kocharyan, 2010; Dementiy, 2001; Sakharova, 2003; Salkovskis et al., 2000; Gough, McClosky, Meehl, 1957; Berkowitz, Lutterman; 1968; Rotter, 1966; Kohlberg, 1964) to outline its phenomenological field. For psychometrics testing the questionnaire, we used procedures such as factor structure reconstruction, reliability, criterion validity, construct validity and standardization. Factor analysis showed five components of social responsibility, i.e. civil consciousness, law-abiding ability, reflection of the action results, moral consciousness, and altruism. The tool was developed having adequate reliability and validity for the specification of group trends and differences and it meets all main requirements for good psychological scales that are discriminatory power, reliability, validity, and standardization (H. Coolican, 2009). The implications of the scale analysis were discussed, and its limitations were recognized.
Non-verbal personality assessment with 10 cartoon-like portrayals 1Veryday, Sweden; 2University of Gothenburg, Sweden; 3University College West, Sweden; 4University College of Skovde, Sweden; magnus.roos@cfk.gu.semagnus.roos@cfk.gu.se
This paper describes a non-verbal personality assessment that consists of 10 cartoon-like portrayals, one for each factor in the five-factor model of personality and their counterparts (i.e. open-minded, conscientious, extravert, agreeable, and neurotic; versus close-minded, impulsive, introvert, antagonistic, and emotionally stable). The assessment has been constructed in collaboration with graphic designers at an international top-ranking design and innovation agency, Veryday. Unlike existing personality assessments, this assessment is developed for interviews and combines the respondent´s perceived self and ideal self rather than only focusing on the respondent´s self-reported perceived self. The aim of the assessment is to provide insight into gaps that reside in incongruity between the respondent´s perceived self and ideal self and thereafter focusing the interview on how to bridge the gap(s). The portrayals have been validated through 156 undergraduate students at Stockholm University. The content validity was verified via tag clouds of top-of-mind words and the criterion validity was verified via the verbal assessment criterion, HP5i. The preliminary analyses are promising in terms of reshaping and adjusting established personality assessments into non-verbal tools for interview settings in therapy and user-studies. However, the assessment need to be further validated and discussed with experts in the field of psychological assessments.
Fifty scales of grey? - A common analysis of dominance self-report scales Justus-Liebig-Universität Gießen, Germany; carolin.palmer@psychol.uni-giessen.decarolin.palmer@psychol.uni-giessen.de
Dominance is proven to be an important trait for exerting influence in groups and teams (Anderson & Kilduff, 2009) and is described as a highly relevant leadership skill (Hoffman et al., 2011). In the present discussion about the relationship between dark triad personality factors (psychopathy, narcissism, and Machiavellianism) and leadership performance, dominant behaviour is considered, as well. Besides behavioural observations and peer-ratings, self-reports are applied very often to assess dominance. Clinical instruments exist as well as subclinical surveys, furthermore dominance is operationalised as a personality trait or as a motive. But do these various instruments converge in a joint construct of dominance? To test the internal structure of the dominance construct, items from differing dominance self-report scales have been subjected to common analysis (i. a. EFA and CFA). Moreover, additional personality traits, demographic variables, and external criteria have been collected (n = 300; students and professionals). Despite diverse backgrounds of scale construction, essentially two general factors could be identified for the dominance concept: social-oriented dominance and object-oriented dominance. Gender effects and differential validities for external criteria are discussed. Implications for future research are derived.
|
| 9:45am - 11:15am | PA14: Test Evaluation Session Chair: Samuel M.Y. Ho |
| KOL-E-18 (Ⅷ) | |
|
|
Emotional ratings of 160 Chinese words City University of Hong Kong, Hong Kong; munyinho@cityu.edu.hkmunyinho@cityu.edu.hk
There is currently no validated list of Chinese emotional words for research, despite the fact that Chinese is one of the most widely used languages in the world. This study will present the results of valence, threat, and arousal ratings of 160 Chinese words among 160 adolescents with ages between 12 and 17 in Hong Kong and Mainland China. Valence ratings showed that there were 25 positive (15.6%), 90 neutral (56.3%), and 45 (28.1%) negative words on the list, and their valence classifications were identical to their corresponding English words according to other studies. Twenty words (12.5%) were categorized as high arousal and 15 words (9.4%) as high threat. This study identified eight words with high threat, arousal, and negative valence. They were: annoyed, assault, beating, cancer, dying, horror, suffocate, and surgery. Bi-directional relationships of the three emotional dimensions were consistent with previous studies. In essence, a U-shape relationship was obtained between valence and arousal whereas linear relationships were obtained for other bi-dimensional relationships in the expected directions. Good split-half Inter-Class Correlations were obtained for the three emotional dimensions: valence (.98), arousal (.84), and threat (.96). The word list should be a useful tool to facilitate cross-cultural cognitive research.
Polish adaptation of Fatigue Assessment Scale Adam Mickiewicz University, Poland; joanna.urbanska@amu.edu.pljoanna.urbanska@amu.edu.pl
The purpose of the present study was to adapt the Fatigue Assesment Scale (FAS; Michielsen at al. 2004) for use in Poland, on the basis of theoretical principles of classical test theory as well as general requirements for adaptation (ERA/APA/NCME, 1999/2007). FAS was translated into Polish using direct and reverse translation. The study included 454 respondents (295 females, 159 males; ages from 24 to 85, M= 60) from different socio-economic groups. In general the Polish version of FAS demonstrated good reliability ratings (the Cronbach's alpha for the total scale was .86). Results show that psychometric properties of the Polish version are similar to the original version. Exploratory factor analysis showed that FAS is a homogeneous scale. Good psychometric properties allow for the conclusion that the Polish version of FAS is a suitable instrument for the assessment of the chronical fatigue at adults. Moreover, some intresting significant correlations between FAS and other scales (for example: Everyday-life Fatigue Questionnaire, Urbańska 2010; WHOQOL-Bref, Jaracz 2001) were obtained.
Stroop Color-Word Interference Test: Normative data for the Latin American adult population 1University of Deusto, Spain; 2Universidad del Norte, Colombia; 3Universidad Antonio Nariño, Colombia; 4Universidad Surcolombiana, Colombia; 5Universidad San Buenaventura, Colombia; 6Universidad Javeriana, Colombia; 7Universidad Autonoma de Manizales, Colombia; 8Virginia Commonwealth University, USA; 9IKERBASQUE. Basque Foundation for Science, Spain; dfriverac@deusto.esdfriverac@deusto.es
The objective of this study was to generate the first and most comprehensive demographic-adjusted norms for the Stroop Color-Word Interference Test in Latin-American adult population. The sample consisted of 4856 healthy adult participants from 10 countries in Latin-American representing the demographic distribution of the population. Inclusion criteria were to have a Mini-Mental State Examination (MMSE) score of≥23, have a Patient Health Questionnaire–9 (depression) score of≤4, and have a Barthel Index of≥90. 61.1% were women, the average age was 53.8±19.9 years (range 18-90), and the average education was 10.0±5.0 years. Participants completed the Stroop Test. In the results, pearson correlation coefficient and coefficient of determination showed significant effect between Stroop test scores and MMSE, age, and education (r-squared>0.430; p’s<.001). Multinomial logistic regression yielded main effects for age and education groups on the Stroop scores (r-square Cox & Snell>.322, p’s<.001). Consequently, correction tables were created in order to adjust the raw scores based on age and education. The percentiles tables were calculated based on the distribution of adjusted scores. This study is the first to create Stroop test norms in the Latin-American population and include appropriate adjustments for age and education. These data represent a critical advancement in the assessment in Latin-American adults.
Hopkins Verbal Learning Test–Revised: Normative data for the Latin American adult population 1University of Deusto, Spain; 2Instituto Nacional de Neurología y Neurocirugía MVS, Mexico; 3Universidad Interamericana de Puerto Rico, Puerto Rico; 4Instituto de Previsión Social, Paraguay; 5Centro Internacional de Restauración Neurológica, Cuba; 6Centro de Investigaciones Psicológicas y Neuropsicológicas, Bolivia; 7Universidad Cesar Vallejo, Peru; 8Virginia Commonwealth University, USA; 9IKERBASQUE. Basque Foundation for Science, Spain; dfriverac@deusto.esdfriverac@deusto.es
The objective of the study was to generate the first and most comprehensive demographic-adjusted norms for the Hopkins verbal learning test–Revised (HVLT-R) in Latin-American adult population. The sample consisted of 4856 healthy adult participants from 10 countries in Latin-American representing the demographic distribution of the population. Inclusion criteria were to have a Mini-Mental State Examination (MMSE) score of≥23, have a Patient Health Questionnaire–9 (depression) score of≤4, and have a Barthel Index of≥90. 2967 were women and 1889 were men, the average age was 53.8±19.9 years (range 18-90), and the average education was 10.0±5.0 years. Participants completed the HVLT-R. Pearson correlation coefficient and coefficient of determination showed significant effect between HVLT-R scores and MMSE, age, and education (r-squared -0.474 to 0.463; p’s<.001). Multinomial logistic regression yielded main effects for age and education groups on the HVLT-R scores (r-square Cox & Snell>.269, p’s<.001). Consequently, correction tables were created in order to adjust the raw scores based on age and education. The percentiles tables were calculated based on the distribution of adjusted scores. This study is the first to create HVLT-R norms in the Latin-American population and include appropriate adjustments for age and education. These data represent a critical advancement in the assessment in Latin-American adults.
|
| 11:15am - 11:45am | Coffee Break |
| Lichthof/Atrium | |
| 11:45am - 1:15pm | IS4: Cross-Cultural Assessment Session Chair: Fons van de Vijver |
| KO2-F-180 (Ⅵ) | |
|
|
Cross-cultural assessment
This symposium brings together modern developments in the area of cross-cultural assessments. The emphasis will go beyond traditional psychometric invariance testing. Papers will be presented on response styles, the use of ipsatization to address response styles, qualitative methods to assess bias, and the structure of emotions.
Presentations of the Symposium Controlling for culture-specific response bias using ipsatization and response style indicators: Family orientation in fourteen cultures and two generations ; boris.mayer@psy.unibe.chboris.mayer@psy.unibe.ch
Within-subject standardization (ipsatization) has been advocated as a possible means to control for culture-specific responding (e.g., Fisher, 2004). However, the consequences of different kinds of ipsatization procedures for the interpretation of mean differences remain unclear. The current study compared several ipsatization procedures with ANCOVA-style procedures using response style indicators for the construct of family orientation with data from 14 cultures and two generations from the Value-of-Children-(VOC)-Study (4135 dyads). Results showed that within-subject centering/standardizing across all Likert-scale items of the comprehensive VOC-questionnaire removed most of the original cross-cultural variation in family orientation and lead to a non-interpretable pattern of means in both generations. Within-subject centering/standardizing using a subset of 19 unrelated items lead to a decrease to about half of the original effect size and produced a theoretically meaningful pattern of means. A similar effect size and similar mean differences were obtained when using a measure of acquiescent responding based on the same set of items in an ANCOVA-style analysis. Additional models controlling for extremity and modesty performed worse, and combinations did not differ from the acquiescence-only model. The usefulness of different approaches to control for uniform response styles (scalar equivalence not given) in cross-cultural comparisons is discussed.
The qualitative assessment of bias: Contributions of cognitive interviewing methodology to the bias definition ; ibenitez@ugr.esibenitez@ugr.es
Defining and assessing bias have been two of the main methodological topics in the cross-cultural field. Most of the attention has been paid to the development of statistical procedures to detect several kinds of biases and the interpretation of results in quantitative terms. However, qualitative procedures can be also useful for understanding the presence of bias when comparing different cultural or linguistic groups. The aim of this study is to illustrate potential contributions of Cognitive Interviews (CI) when investigating bias. On one hand, conclusions of integrating CI findings with quantitative data from analysing item bias will be presented by enhancing the advantages for understanding bias sources. On the other hand, utility of CI for extracting information of different levels of bias (item, method, and construct) will be described. The approach will be illustrated by studying responses and response processes of Dutch and Spanish participants to “Quality of Life” items from five international studies. The qualitative perspective of bias will be discussed as well as the potentiality of qualitative procedures for investigating bias, as single or as part of mixed methods studies.
The internal structure of the guilt and shame domain across cultures ; Johnny.Fontaine@UGent.beJohnny.Fontaine@UGent.be
Cross-cultural as well as in Western scientific literature is plagued with inconsistent theory development on the nature and the role of guilt and shame. We present a large cross-cultural study that assesses these emotions on the basis of the componential emotion approach using two different methods, namely an episode and a frequency method. In total 3684 participants from 20 countries across the world rated appraisals, action tendencies, bodily reactions, expressions, and feelings in the three last episodes where they experienced a self-conscious emotion (episode method) and they also rated the frequencies of these emotional reactions in general (frequency method). Cultural stability of the internal structure was investigated by comparing classical principal component analysis with simultaneous principal component analysis. Both for the episodes and the frequencies a five-componential structure emerged stably across cultural groups. Four of the five components had the same meaning between the two methods, namely guilt, embarrassment, negative esteem of the self, and anger. The fifth component in the episode structure referred to the seriousness of the situation and the fifth factor in frequency structure could be interpreted as general distress. These cross-culturally stable internal structures allow for more consistent theorizing both in Western and in cross-cultural research.
Extreme response style in attitudinal and behavioral questions ; Fons.vandeVijver@uvt.nlFons.vandeVijver@uvt.nl
This paper investigated the cross-cultural similarities and differences of extreme response style (ERS) extracted from self-report data of attitudinal and behavioral questions. Data of a subsample of 3,255 young adults with different immigration and racial backgrounds in the third wave of the UK household survey were analyzed. For each participant, responses to items concerning general mental health and identity were used to extract one ERS index for attitudinal questions and responses of items concerning family and school activities were used to extract the ERS index for behavioral questions. The two indexes were positively correlated, indicating similar response style preference in different types of questions. The pattern of cross-cultural mean differences were similar in both indexes, with minority groups (immigrants, Asian, African, Black, Caribbean, and mixed-race in UK) showing higher extreme response style compared with the majority group (nonimmigrants and whites in UK). However, there were more cross-cultural variations in attitudinal ERS than behavioral ERS. Implications are discussed.
|
| 11:45am - 1:15pm | S4: Response Styles in Personality Assessment Session Chair: Daniel Danner |
| KOL-G-217 (Ⅳ) | |
|
|
Response styles in personality assessment
Response styles such as acquiescence or extreme responding can bias correlations, factor structures, and prevent measurement invariance of personality inventories. Based on empirical data, we will discuss to what extent response styles are relevant, how response styles can be measured and controlled, and what the determinants of response styles are. Beatrice Rammstedt will illustrate that acquiescence biases the comparability of big five measures across countries. Julian Aichholzer and Meike Morren will introduce statistical models that allow controlling for acquiescence and extreme responding. Daniel Danner will demonstrate that acquiescence is not a general, uni-dimensional response style but that in it fact also depends on the item domain (such as personality or attitude items). Finally, Clemens Lechner will present data suggesting that acquiescence is not only associated with education but also with age related decline in cognitive functioning.
Presentations of the Symposium Measurement equivalence of personality measures across educational groups – The moderating role of acquiescence ; beatrice.rammstedt@gesis.orgbeatrice.rammstedt@gesis.org
Effects of response set are often neglected in research investigating differences among groups. In contrast to individual diagnostics-which often controls for effects of social desirability for example personality assessments-investigating among group differences does not take into account effects of response styles. In this talk I will show that response style, and in particular acquiesce, have indeed strong biasing effects on personality assessments. In several different large scale population representative samples (n=888 to n=25,509) we proved that item responding is in particular in low educated groups strongly affected by acquiescence with blurring effects on the resulting factor structure. This effect could be shown to be generalizable across questionnaires, item formats, assessment modes, and numerous in particular Western countries. Implications of the findings for personality assessment are discussed.
Controlling acquiescence bias in measurement invariance tests ; julian.aichholzer@univie.ac.atjulian.aichholzer@univie.ac.at
Assessing measurement invariance (MI) is an important cornerstone in establishing equivalence of instruments and comparability of measured constructs. This study investigates how acquiescence response style (ARS) impacts the level of MI achieved (configural, metric, scalar). Data from a German representative sample (n = 3,118) were analyzed. The random intercept method is combined with multiple-group factor analysis to assess MI in a Big Five personality scale. Initial results suggest that if groups differ in ARS, neglecting that bias leads to different conclusions regarding the level of MI of the instrument. Implications and further applications are discussed.
Extreme response style and personality traits ; meike.morren@vu.nlmeike.morren@vu.nl
Since the 1950s, extreme response style (ERS) has been associated with personality traits, such as anxiety, neuroticism, extraversion, conscientiousness, defensiveness, self-esteem, and depression. Inconsistent results have been obtained, for example, some find that extraversion relates positively to ERS, others find a negative relationship, and some find no relationship. This inconsistency might result from serious methodological challenges in exploring the relationship between response styles and personality. First, ERS can be measured by a sum score, a standard deviation score or a latent variable. Second, the modeling approaches to detect and correct for ERS diverges across studies. Third, most research uses the personality assessments both for measuring personality traits and response styles which inevitably leads to confounding style with content. Fourth, the personality assessments are affected by response styles themselves and need to be corrected. We propose a latent class factor approach that detects ERS using a validated scale and corrects for the influence of ERS on the personality assessments by simultaneously estimating the Big Five and ERS. Additionally, we assess the influence of methodological issues outlined above by comparing other modeling approaches to our model. We illustrate our approach using student data (n=200) from the Netherlands.
Facets of acquiescence ; daniel.danner@gesis.orgdaniel.danner@gesis.org
The present research investigates two facets of acquiescence: agreement and acceptance. Agreement has been defined as agreeing to all items (e.g., I am reserved, I am outgoing, I am not reserved; I am not outgoing) whereas acceptance has been defined as accepting opposite but non-negated items (e.g. I am reserved, I am outgoing) but not negated items (e.g. I am not reserved, I am not outgoing). Participants (n=398, 20-82 years old) completed a survey containing 96 items of different domains (personality, attitude, and knowledge items). The data were analyzed using hierarchical structural equation models. The results indicate that, (1) there is a general agreement factor that can explain about 2% of total item variance, (2) there are also domain-specific agreement factors that can explain up to 29% of total item variance, and (3) there is no general acceptance factor but domain specific acceptance factors that can explain up to 4% of total item variance. This suggests that acquiescence is not a general, uni-dimensional response style but has different facets which have different impact on items. Implications for research and assessments are discussed.
Cognitive ability, acquiescence, and the structure of personality in a sample of older adults ; clemens.lechner@uni-jena.declemens.lechner@uni-jena.de
Acquiescence, or the tendency to respond to descriptions of conceptually distinct personality attributes with agreement/affirmation, constitutes a major challenge in the assessment of personality. The aim of this study was to shed light on cognitive ability as a potential source of individual differences in acquiescent responding. We hypothesized that respondents with lower cognitive ability exhibit stronger acquiescent response tendencies; this leads to problems in establishing the Big Five factor structure among these respondents, as opposed to respondents with higher cognitive ability. Further, we hypothesized that after controlling for acquiescence by using mean-corrected instead of raw item scores, the Big Five structure holds even at lower levels of cognitive ability. Analyses in a sample of 1,071 German adults aged 56 to 75 years using the Digit Symbol Substitution Test (DSST) as a measure of cognitive ability and the BFI-10, an abbreviated version of the Big Five Inventory, as a measure of personality, corroborated these hypotheses. This suggests that lower cognitive ability, and age-related declines in cognitive functioning more specifically, are associated with higher acquiescent responding in personality inventories; but that the problems this poses for establishing the five-factor structure can be resolved by statistically controlling for acquiescence.
|
| 11:45am - 1:15pm | PA15: Positive Traits and Positive Emotions Session Chair: Ingrid Koller |
| KOL-G-204 (Ⅱ) | |
|
|
What do you think you are measuring? A new mixed-methods procedure for assessing content validity and theory-based scaling with an example on wisdom 1Alpen-Adria-Universität Klagenfurt, Austria; 2Oregon State University, USA; ingrid.koller@aau.atingrid.koller@aau.at
The valid measurement of latent constructs is a crucial issue for psychological research. Precise definitions of constructs are a very important foundation for content-valid item generation, for examining other aspects of validity (e.g., convergent validity), and for theory-based scaling. Although this sounds trivial, many researchers pay too little attention to the precise definition of latent constructs. In the first part of this presentation, we present a new mixed-methodology approach for improving construct definitions, supporting item generation, determining the content validity of existing items, and theory-based scaling. We illustrate our approach using an analysis of the items of the Adult Self-Transcendence Inventory, a self-report measure of wisdom (ASTI, Levenson, Jennings, & Shiraishi, 2005). The results of this analysis were used as the basis of a psychometric evaluation of the ASTI in a sample of 1215 participants using multidimensional item response theory models. We found that the new procedure produced important suggestions concerning five sub-dimensions of the ASTI that were not identifiable using exploratory methods. Further research questions, possible adaptations, and some critical issues are discussed.
Validation of a self-report scale measuring wisdom resources Alpen-Adria-Universität Klagenfurt, Austria; michaela.gareiss@aau.atmichaela.gareiss@aau.at
Throughout our life, we all confront difficult life events. Internal and external resources play an important role in helping individuals to overcome, reflect on, and integrate such events. The MORE-Life-Experience-Model (Glück & Bluck, 2014) postulates that five internal resources are crucial for the successful processing of difficult life events and in the long run for the development of wisdom: Mastery, Openness, Reflectivity, Empathy, and Emotion Regulation. The aim of this study was to develop a self-report-scale measuring the MORE-resources, with a focus on content-validity. Each of the resources is a relatively complex construct, and self-report-measures of positive constructs tend to be heavily biased by self-presentation and self-perception issues. Therefore, a large set of items was generated on the basis of construct definitions, and each item was analyzed by an expert panel with respect to construct-validity as well as agreement probability. After a large number of items were removed on this basis, the revised instrument (86 items) was evaluated empirically using factor-analytic-methods (n = 522). The resulting scale (25 items) has convincing subscale reliability; first validity-analyses and support the theoretical assumptions concerning the MORE-resources. The results also emphasize the advantages of our theory-based mixed-methods procedure for item generation and evaluation.
A three-dimensional screening tool for strengths 1City University of Hong Kong, Hong Kong; 2University of Hong Kong, Hong Kong; munyinho@cityu.edu.hkmunyinho@cityu.edu.hk
Twenty-four self-developed items assessing strengths were administered to 149 service recipients of a psychiatric rehabilitation organization along with the Hospital Anxiety and Depression Scale. Minimum Average Partial (MAP) test showed that the minimum Velicer's Average Squared Correlation of .020 was obtained for a three-factor solution. Accordingly, twelve items were selected from principle component factor analysis with oblimin rotation to form the Brief Strengths Scale (BSS-12) to measure the three strengths, namely, Temperance Strength, Intellectual Strength, and Interpersonal Strength, with internal consistency coefficients ranging from .76 - .84. The Intellectual Strength and Temperance Strength had significant negative correlations with both depression and anxiety, whereas the Interpersonal Strength was significantly and negatively related to depression only. The BSS-12 was also administered to 203 university undergraduates to examine the factorial invariance of the scale in a different population. Confirmatory Factor Analysis revealed satisfactory goodness-of-fit indices (X2/df = 1.846; CFI = .905; RMSEA = .065; SRMR = .059). We concluded that the BSS-12 was a useful screening tool for strength among people with and without mental health issues. General issues in adopting psychological assessment inventories in different cultures will be discussed towards the end of the presentation.
The assessment of emotional states induced by clowns and nurses University of Zurich, Switzerland; s.auerbach@psychologie.uzh.chs.auerbach@psychologie.uzh.ch
Clowns have visited hospitals and nursing homes for quite some time. However, up until now, there has been no instrument available for the assessment of the various and unique emotional states induced in individuals by hospital clowns. The present research identified the dimensionality of emotional states induced in observers of clown interventions, and investigated the difference between clowns and nurses. In Study 1, 183 adults watched 15 videos of hospital clowns, circus clowns, and nurses, and filled in the 29 Clown Emotion List (CLEM-29; Auerbach et al., 2014). Four factors emerged from a factor analysis: amusement, transcendence, arousal, and uneasiness. Both circus and hospital clowns elicited amusement, but only hospital clowns additionally elicited transcendence (i.e., feeling privileged, appreciated). Nurses also elicited transcendent experiences without being amusing. In Study 2 with 42 patients involved in a hospital clown intervention, the incremental validity of the dimensions of the CLEM-29 over and above a general funniness judgment of clowns was investigated. Global positive feelings toward the clowns were best predicted by funniness of clown performances in general and a higher level of felt transcendence. The CLEM-29 has proven to be useful in identifying the core components of hospital clown interventions: humor and transcendence.
|
| 11:45am - 1:15pm | PA16: Applied Settings Session Chair: Sonja Krupp |
| KOL-G-209 (Ⅲ) | |
|
|
Fine motor skills and cognition - A dual task approach in assessment using the 20 Cents Test 1Forschungsgruppe Geriatrie Lübeck, Germany; 2Krankenhaus Rotes Kreuz Lübeck Geriatriezentrum, Germany; 3Universitätsklinikum Carl Gustav Carus Dresden, Germany; krupp@geriatrie-luebeck.dekrupp@geriatrie-luebeck.de Performing cognitive tasks during walking unmasks developing dementia by increasing gait variability, however, the analysis requires costly equipment. Fine motor activities are represented by larger brain areas than leg movement. This might open the way for broad use of dual tasking as psychological diagnostic tool. In 2012 we validated the 20 Cents Test as an instrument to asses fine motor function. Ergotherapists examined 205 patients (age 60-96, a third of who were cognitively declined) concerning their fine motor skills. Blinded physiotherapists measured the time needed to pick up 20 one-cent coins (European and US currency) and transport them into a box. 189 patients repeated the test with the same and another therapist. We found good validity (AUC>0.8), intra- and interrater reliability (ICC>0.9). Thus we defined standard values that we plan to use to establish a dual task procedure with a subtest of verbal fluency from the CERAD battery. The effect of simultaneous cognitive testing on the result of the 20 Cents Test will be analyzed in correlation to the presence of cognitive impairment. The data we will present could introduce it as a suitable partner for dual tasking to detect early stages of cognitive decline. The Functional Loewenstein Occupational Therapy Cognitive Assessment (FLOTCA) for integrative cognitive functional skills 1Ono Academic College, Israel; 2Lowenstein Rehabilitation Hospital, Israel; sagiv.aliza@gmail.comsagiv.aliza@gmail.com
During the past decade, the focus of rehabilitation medicine has shifted to occupational performance and participation in different life roles. The Functional Loewenstein Occupational Therapy Cognitive Assessment (FLOTCA) was developed to assess integrative higher cognitive abilities, and it was validated on a Traumatic Brain Injury (TBI) population. The FLOTCA consists of 3 tasks: navigating on a map, organizing a tool box and planning a daily schedule. In this first study, participants included 25 TBI patients, ages 18-49 and a matched group of 25 healthy individuals. Both groups were assessed with the FIM/FAM a daily functional evaluation. The FLOTCA showed high inter rater reliability (ICC= .996), internal consistency reliability between the tasks and the total score was high (α = .82). Construct validity was supported for the total score (t(48) = -5.48, d=1.52) and the separate tasks. Moderate ecological validity with the FIM/FAM (r(19) = .44, p < .05) was obtained. Furthermore, severity of injury, Glasgow Coma Scale (GCS), and Length of Unconsciousness, were significantly correlated (r=-.69 p<.01) with the FLOTCA and stronger than the correlation with the demographic variables. The results support the use of the FLOTCA for assessing cognitive functional skills and serve as the basis for planning intervention.
Evaluation of pain in athletes and normally active subjects Trakia University, Bulgaria; petkovaa@hotmail.competkovaa@hotmail.com
Regular exercise clearly associate with higher pain tolerance, but pain thresholds are affected more ambiguously. In this conection the observation that pain perception is modifiable by physical activity provides promise for the use of non-invasive methods with few side effects for patients with chronic pain conditions.The aim of this study is to test factors such as personality and demographic factors that affect the relationship between physical activity and modifications in pain perception. Psychological Questionnaires: Body Awareness Questionnaire that asks subjects to rate, on a 4 point scale, the degree to which they were currently experiencing symptoms of sympathetic arousal, State Trait Anger Scale, and State Trait Anxiety Scale. Objective methods (cold pressure test) are used only to determine the pain sensation and pain tolerance thresholds. The VAS on the other hand, represents pain as a continuum and is sensitive to change. There was a significant interaction between self reported sympathetic arousal, sex, and anxiety depending on physical activity as well. The results of investigation support this complex, multi-element method for measuring pain as a useful model for studying effects of exercise on the perception of pain and there is reason to find that it might help in the understanding of mechanisms of pain generation.
Identifying Minimal Important Change (MIC) scores for the Tinnitus Functional Index (TFI) questionnaire for different populations 1University of Nottingham, UK; 2MRC Institute of Hearing Research Clinical Section, UK; msxklf@nottingham.ac.ukmsxklf@nottingham.ac.uk
Sensitively measuring changes in questionnaire scores is essential to identifying whether outcomes are valid and clinically meaningful in a given population. Minimal Important Change (MIC) scores facilitate this interpretation. For people with tinnitus, who often present with a number of co-morbid complaints, the recommended method of evaluating the effectiveness of treatments is to use a self-report questionnaire such as the Tinnitus Functional Index (TFI). The TFI is reported to provide a responsive measure of change in tinnitus severity; however, no valid MIC score exists. The present study aims to identify MIC scores relevant to clinical (patient) or research (participant) populations, using a combination of distribution-based and anchor-based methods. TFI questionnaire data was collected from 150 patients attending NHS audiology clinics and 95 participants who volunteered for a tinnitus research study. Analysis involves integrating Standard Error of Measurement (SEM), Effect size (ES), Reliable Change Index (RC) (Distribution-based) and the global improvement scores (clinical population). In the research population, an MIC score of 22.4 was identified based on the SEM of 8.1. In the clinical population with “no change” in tinnitus, an MIC score of 26.4 was identified (SEM = 9.5). Further analyses integrating these with ES and RC will be presented.
Measurement properties of the eight subscales in the Tinnitus Functional Index (TFI) questionnaire evaluated using Rasch analysis 1University of Nottingham, UK; 2MRC Institute of Hearing Research Clinical Section, UK; msxklf@nottingham.ac.ukmsxklf@nottingham.ac.uk
The eight subscales of the Tinnitus Functional Index questionnaire (TFI: 25-item) were designed for individual use to measure intrusiveness, sense of control (SoC), cognition, sleep, auditory, relaxation, quality of life (QOL: 4-item), and emotional aspects of the functional impact of tinnitus. We evaluated the measurement properties of these individual subscales using the Rasch measurement model. 540 people with tinnitus completed the TFI (255 tinnitus patients, 285 research volunteers). Data for the eight subscales were individually fitted to the Rasch measurement model (RUMM 2030). Subscales were assessed for model fit, unidimensionality, person-separation reliability (PSI), and differential item functioning. After removing one misfitting item (QOL22), all 8 subscales showed good fit with non-significant chi-squared values (p > 0.05). They were unidimensional with high PSI estimates ranging 0.77 to 0.92. Significant difference between populations was observed in four items (Intrusiveness3, SoC5, Relaxation8, QOL21), whilst only one item (Emotional25) showed significant gender differences. These items were split to adjust for these differences, improving model fit for each subscale. We conclude the individual subscales provide reliable individual measures of different aspects of the functional impact of tinnitus. Further analyses will assess the relationship between these subscales in testlets.
|
| 11:45am - 1:15pm | PA17: Assessment Center and Coaching Session Chair: Nigel George Evans |
| KOL-G-221 (Ⅴ) | |
|
|
Assessment in coaching: Trait questionnaires offering holistic approaches NEC, UK; nigel@nigel-evans.comnigel@nigel-evans.com
The use of questionnaires in coaching applications is well established and highly valued to understand the client more holistically. However many of these tools have been based on specific theories, often with a very practical application in mind, rather than direct reference to an established and robust personality framework. As such, the psychometric properties of typical coaching tools can fall well short of that expected of trait questionnaires, raising issues of sufficient breadth and depth of assessment when working with sophisticated clients in modern business and life. This session will outline the use of a number of trait tools in coaching assessment. Given that personality is made up of individual traits, coaching clients should be able to be profiled accurately from trait personality data alone, without having to use specific type or role tools. Specific case studies are drawn from international occupational databases with groups in excess of 20,000 participants. It will be shown that there are different approaches taken when using trait profiles in effective coaching interventions. Illustrations will cover data reshaping, concept modelling, and factor integration. As this data holds high psychometric properties, it gives scientific-practitioner credibility to the assessment for subsequent development initiatives within a coaching context.
Putting theory into practice – The ongoing validation of the Swiss Armed Forces’ assessment centers Military Academy at ETH Zurich, Switzerland; nadine.eggimann@milak.ethz.chnadine.eggimann@milak.ethz.ch
The Assessment Center for prospective career officers (ACABO) has been in use as a selection tool in the Swiss Armed Forces since 1996. Students who want to become career officers must pass the ACABO before they start the Bachelor Study Course at the Military Academy in Zurich. The ACABO is a classical three-day assessment center and conforms to current quality standards (International Task Force on Assessment Center Guidelines, 2000; Swiss Assessment, 2010). Ongoing evaluation of an assessment center is crucial. While it is certainly important to evaluate construct validity as well as the criterion-related validity, care should also be taken to ensure the social validity. For instance, even successful candidates may view an organization as less attractive if they perceive this organization’s assessment center negatively (e.g., Gilliland, 1993). In the current paper, we present different study findings which illustrate the procedure of an evaluation process within an operational assessment center and the impact of this scientific examination on the further development of the respective selection instrument. Specifically, we present results regarding the validity of the ACABO (N > 300) and discuss our findings from a practical perspective.
The presentation of the draft “National Assessment Center Guideline for Turkey” National Study Group on Assessment Center Methods, Turkey; mehmet.surmeli@lcwaikiki.commehmet.surmeli@lcwaikiki.com
The idea of having national standards began with a benchmark, which was carried out among the biggest companies of Turkey, to understand the assessment center usage and the competency assessment tools. After realizing the organizational differences between assessment center operations within the context of benchmark studies (e.g. assessor trainings, assessor evaluation methods, data integration sessions, job analysis methodologies, using technological/online tools, exercise designs, competency numbers per exercise, and total competency numbers per assessment center), some of the experts representing a wide range of talents and interests from universities, business organizations, consultants, and the psychology profession came together to establish the National Assessment Center Guideline. The draft version of the National Assessment Center Guideline and the topics (e.g., vocational qualifications & certification, the preparation of the AC candidates, and the rights of the parties, etc.), which were discussed by the study group members.
Assessment Centres - A large bandwidth of practice NEC, UK; nigel@nigel-evans.comnigel@nigel-evans.com
Assessment Centres can come in all shapes and sizes, however the one thing that should be consistent is the quality of their implementation. There is increasing witness of a large degree of difference in quality of provision, yet this has been largely anecdotal in content and collection.The purpose of the paper is aimed at giving a practical ‘in the field’ spotlight on what is actually happening in Assessment Centres on a more systematic case basis. Observations of Assessment Centre implementation by the author have been collated within 10 medium to large sized consulting companies, delivering in 5 different countries. Fundamentally the findings show that there is a large bandwidth of practice – ranging from what could be classified as ‘Best’ to ‘Questionable’. Clear links are made to British Assessment Centre standards, European Test User Qualifications, and ISO 10667. Fortunately illustrations of best practice do show what is possible to achieve within an organisational context. The suggestion is made that raising the awareness of issues within Assessment Centre Implementation by practical example will raise standards in the longer term, with test and assessment professionals taking the lead.
|
| 11:45am - 1:15pm | PA18: Innovative Approaches Session Chair: Samuel Greiff |
| KOL-E-18 (Ⅷ) | |
|
|
Challenges of constructing and validating innovative assessments: The example of collaborative problem solving University of Luxembourg, Luxembourg; samuel.greiff@uni.lusamuel.greiff@uni.lu
Since the advent of computers to the field of psychological assessment, there have been tremendous changes in how psychological assessment instruments are constructed. Specifically, some psychological constructs require fast and precise tracking of reactions, which have only become reliably measurable through computer-based assessment (e.g., processing speed). In this presentation we give an overview of the construction and validation of COLBAS - a computer-based assessment tool for collaborative problem solving (ColPS). ColPS is defined as “problem solving activities that involve interactions among a group of individuals”(O`Neil et al., 2003), and its assessment requires logging and scoring of collaborative behaviors over the course of problem-solving (e.g., frequency and content of information exchange, or activities towards solving the problem). In this presentation, we propose how such behaviors can be captured and scored in ColPS assessments that simulate collaboration through computer-agents. We further discuss advantages and limitations in design, face-validity, and scalability of computer-agents as collaborators. Moreover, we report on the internal validity of COLBAS shown in the first undertaken validation study (N>450, Mage=13.5, SDage=.61, 50.2% girls) by discussing the internal structure explored in a latent confirmatory factor analysis. Finally, we outline further steps necessary to examine validity of COLBAS as ColPS assessment.
Automatic coding of short text responses via clustering in educational assessment 1Technische Universität München, Germany; 2German Institute for International Educational Research (DIPF), Germany; 3Centre for International Student Assessment (ZIB), Germany; fabian.zehner@tum.defabian.zehner@tum.de
Automatic coding of short text responses opens new doors in assessment. We implemented and integrated baseline methods of natural language processing and statistical modelling by means of software components that are available under open licenses. The accuracy of automatic text coding is demonstrated by using data collected in the Programme for International Student Assessment (PISA) 2012 in Germany. Free text responses of 10 items with 41,990 responses in total were analyzed. We further examined the effect of different methods, parameter values and sample sizes on performance of the implemented system. The system reached fair to good, and even up to excellent agreement with human codings
(Cohen's kappa: .458 ≤ κ ≤ .959). Especially items that are solved by naming specific semantic concepts appeared properly coded. The system performed equally well with sample sizes of 1661 and higher and somewhat poorer but still acceptable down to sample sizes of 249. Based on our findings, we discuss potential innovations for assessment that are enabled by automatic coding of short text responses. A latent transition analysis of the computer usage of adolescents: Longitudinal transition and testing the effect of predictors Korea University, South Korea; soyoungkim.ems@gmail.comsoyoungkim.ems@gmail.com
The present study examined the motivations of computer usage in subgroups (latent profile) and tested the effects of predictors on determining these latent profiles. Latent transition analysis was applied to the three time point data of the Korea Children and Youth Panel Survey (middle school cohorts). The results showed that there were five latent profiles for each year that could be defined based on their response patterns: game oriented group, music movie group, middle level group, SNS group, and high risk group. Female students tend to be in the mid level group compared with male students. Students with low parental control tended to be in the game oriented group, the SNS group, and high risk group. Members of the game oriented group and the mid level group have consistently shifted to the high risk group. Members of the music movie group and the SNS group rarely transformed each other. These findings will be helpful to design intervention programs for excessive computer usage.
Who is affected by FoMO (Fear of Missing Out)? – Measuring a new phenomenon in the digital era 1RFH Köln, Germany; 2HS Fresenius, Germany; christian.bosau@rfh-koeln.dechristian.bosau@rfh-koeln.de
In todays digital era people use mobile phones almost everywhere. Lately, the construct Fear of Missing Out (FoMO) is discussed as a reason for people’s mobile phone usage (JWT, 2012; Przybylski, Murayama, DeHaan & Gladwell, 2013). However, neither the measurement of this phenomenon nor its correlates to other constructs have been sufficiently discussed yet. This online-study (n=100) analyzed the relationship between the up-to-now only FoMO-scale (Przybylski et al., 2013) and the Big-5 personality inventory (Rammstedt, Kemper, Klein, Beierlein, & Kovaleva, 2012), self-esteem (Collani & Herzberg, 2003), self-monitoring (Collani & Stürmer, 2014) and affiliative tendency (Mehrabian & Ksionzkys, 1974). Furthermore, the quality of this scale by Przybylski et al. (2013) is reassessed in a CFA. Regarding convergent validity the FoMO-scale correlates with neuroticism (r=.36, p<.001), self-monitoring (other-directedness: r=.46, p<.001 & acting: r=.21, p<.05), self-esteem (r=-.41, p<.001) and sensitivity to rejection (r=.47, p<.001). Regarding discriminant validity, no correlations exist with conscientiousness, openness, and agreeableness (however: r=-.30, p<.00 with extraversion should be critically discussed). Though, a CFA-reanalysis of the FoMO-scale shows far better fit indices, if several items are removed. Likewise, the convergent validity indices improve into the expected direction. Hence, the study further improves the understanding of FoMO and its measurement.
Information search in objective personality tests: Objective assessment of perspective taking University of Salzburg, Austria; thomas.scherndl@sbg.ac.atthomas.scherndl@sbg.ac.at
Decisions are part of our daily life and the way how we make choices can tell much about us and our personality. Surprisingly, the process of making a decision has received less attention in objective personality test research than would be expected. In the present study, we investigated the usefulness of information search process data as part of an objective personality test capturing the trait ‘perspective taking’. We presented complex, multi-attribute prediction tasks to participants (n=126, 78 female, mean age = 21.4 years) and tracked their information search including search duration, number of acquired information and search direction. Additionally, we also included multi-attribute decision tasks for oneself and the scale ‘perspective taking’ of the Interpersonal Reactivity Index (IRI; Davis, 1983) to test for discriminant and convergent validity. Process data showed moderate to high internal consistency. Additionally, the questionnaire scale correlated with duration and number of information pieces inspected before a prediction task, but not with information search before decisions for oneself, thus demonstrating convergent and discriminant validity. We discuss the promise of information search as part of objective personality tests, but also mention potential pitfalls and yet unsolved problems of information search process data.
|
| 1:15pm - 2:30pm | Lunch |
| Cafeteria | |
| 1:45pm - 2:25pm | Meet the Editor - Q&A with the Editor-in-Chief of the European Journal of Psychological Assessment Session Chair: René Proyer Matthias Ziegler (Humboldt University Berlin, Germany) |
| KO2-F-180 (Ⅵ) | |
| 2:30pm - 3:30pm | K4: Computer Adaptive Assessment of Personality Session Chair: Matthias Ziegler Fritz Drasgow (University of Illinois at Urbana-Champaign, USA) |
| KO2-F-180 (Ⅵ) | |
| 3:30pm - 4:30pm | PO2: Poster Session 2 (Including Coffee Break) |
| Lichthof/Atrium | |
|
|
Construction of the Computerized Adaptive Career Aptitude Test for junior high school students 1National Taiwan Normal University, Republic of China (Taiwan); 2National Cheng Kung University, Republic of China (Taiwan); sungtc@ntnu.edu.twsungtc@ntnu.edu.tw
A qualified career test could play an important role in providing information for students’ self-understanding and career decision-making. However, there are limitations and problems within the existing career aptitude tests. This study integrates psychological testing, adaptive techniques of psychometrics, and multimedia technology to establish a Computerized Adaptive Career Aptitude Test, the CACAT - J. It consists of brand new subject matters, dimensions and test items. Not only is the test more relevant with increased prediction power, but it also provides beneficial career counseling for students and teachers. The CACAT - J consisted of eight sub-tests: Verbal, Numerical, Spatial, Logical Reasoning, Scientific Reasoning, Observation, Aesthetics, and Creativity. There were 1243 participants in the present study. Reliability for the findings in this study ranged from .69 to .83. In terms of validity, the aptitude test scores were significantly correlated with junior high school students’ basic competence tests and ranged from .28 to .67. Through this test, students were able to understand their aptitudes on different skills that would enhance their career exploration and their capacity for effective career decision-making and planning.
Psychometrical properties of Portuguese and Brazilian versions of the Parental Demandingness and Responsiveness Scale: An intercultural study 1Federal University of Santa Catarina, Brazil; 2University of Lisbon, Portugal; marucia.bardagi@gmail.commarucia.bardagi@gmail.com
This study compares the psychometric properties of the Parental Demandingness and Responsiveness Scale in adolescents from different cultural contexts. This instrument of 24 items was originally constructed in Brazil based on Baumrind's Parenting Styles Theory. Parenting styles are defined as the attitudes, practices, and emotions that characterize parent-child relationships in different situations, leading to different consequences in child’s future performance and psychological adjustment. The four styles, that reflect combined amounts of responsiveness and demandingness provided by parents, are authoritative (high demandingness and responsiveness), authoritarian (high demandingness and low responsiveness), indulgent (low demandingness and high responsiveness) and neglectful (low demandingness and responsiveness). Data from Brazil (n = 550) identified in factor analysis with varimax rotation two clear and distinguished factors, corresponding to dimensions of demandingness and responsiveness. The alpha coefficients were between 0.78 and 0.92. The Portuguese version of the instrument was administrated to sample (n = 280), and the same factor analysis show four factors corresponding to four scales. The alfa coefficients are between .81 to .95. This study encourages crosscultural projects that aim to compare adolescent's vision of family education practices and outcomes. Gender differences and differences in perceived mother's and father's parenting style are also discussed.
The development of Thinking-Experiencing Affective Events Checklist for senior high school students 1Fu Jen Catholic University, Republic of China (Taiwan); 2National Taiwan Normal University, Republic of China (Taiwan); 056384@mail.fju.edu.tw056384@mail.fju.edu.tw
This study aimed to develop the Thinking-Experiencing Affective Events Checklist for senior high school students. This checklist consisted of 10 items originated from Multiple-Event Checklist (Yang, 2014) and 2 common events for Chinese students. Participants were asked to rate how often they think and experience all this 12 events on a 7-point Likert scale. Pilot study based on 317 senior high school participants excluded 2 affective events from item analysis, and EFA showed the remained 10 events could form positive and negative factors. In formal study, 324 senior high school students finished this checklist, the Beck Self Concept Inventory for Youth, and the Beck Anxiety Inventory for Youth and found following results: (1) this checklist had acceptable internal consistent reliability and CFA validity. (2) Female participants thought and experienced affective events more frequently than the males did. Moreover, the reported frequency of thinking and experiencing were similar on positive events, while the reported frequency of thinking was greater than that of experiencing on negative events. (3) Participants’ self-concept positively correlated to thinking and experiencing frequency of positive affective events. On the other hand, Participants’ anxiety negatively correlated to experiencing frequency of positive affective events, but positively correlated to thinking and experiencing frequency of negative events.
The Situationism Scale: Validation of five new language versions and investigation of regional differences within Europe 1University of Zurich, Switzerland; 2The Ohio State University, USA; 3University of Maribor, Slovenia; 4Semmelweis University, Hungary; 5VU University, The Netherlands; 6Donders Graduate School for Cognitive Neuroscience, The Netherlands; 7Radboud University Nijmegen, The Netherlands; l.wagner@psychologie.uzh.chl.wagner@psychologie.uzh.ch
Situationism describes the belief that the environment influences one’s behavior. In the present study, we tested the validity of the recently developed Situationism Scale (Roberts et al., 2014) that measures individual differences in situationism and investigated whether young adults in Eastern and Western European countries differ in their levels of situationism. The English version of the Situationism Scale was translated into Dutch, German, Hungarian, Italian, and Slovenian. Young adults (n = 1,106) across Europe responded to one of the language versions of the scale. The survey included measures of self-control and of locus of control for examining discriminant validity and measures of situation-control strategies concerning eating and drinking behavior for examining predictive utility. Results indicated that overall: (1) the new language versions had satisfactory psychometric properties (internal consistency, factorial and discriminant validity); (2) situationism and the use of situation-control strategies for eating/drinking behavior were positively related; and (3) situationism was higher for individuals from relatively more interdependent regions (Eastern Europe), compared to individuals from relatively less interdependent regions (Western Europe). These findings suggest that individual differences in situationism can be assessed reliably and validly across European countries, and that group-based differences may be related to cultural background.
Rasch rating scale modeling of the Sociopolitical Control Scale Korea University, South Korea; soyoungkim.ems@gmail.comsoyoungkim.ems@gmail.com
The purpose of this study is to examine the psychometric properties of the Korean version of Sociopolitical Control Scale in terms of dimensionality, using response category, sample appropriateness, and reliability. The 2009 Cross Sectional Survey data was used which was surveyed by the National Youth Policy Institute. Subjects were 3350 middle school students in South Korea. Rasch analysis was applied separately on each sub-construct which were ‘Leadership competence’ and ‘Policy control’. Unidimensionality assumption was evaluated by principal component analysis. The scale was evaluated considering category characteristic curve, average measure, step difficulty, and outfit statistics, difficulty measures, item map, and separation reliability. The results showed that the Sociopolitical Control Scale is not unidimensional, so it was reasonable to apply Rasch model on each sub construct. The original number of rating scale was acceptable. The shape of Wright-map was not uniformly distributed, indicating that the level of item difficulty did not match with the level of person ability. For these reasons, it is recommended to develop more items to cover all the person location.
Psychometric properties of the Spanish version of the Anxiety Sensitivity Index for Children (ASIC) University of Malaga, Spain; godoy@uma.esgodoy@uma.es
This study examined the psychometric properties of the Spanish version of the Anxiety Sensitivity Index for Children (ASIC; Laurent, Schmidt, Catanzaro, Joiner, & Kelley, 1998), one of the few scales assessing Anxiety Sensitivity (AS) in young people. The ASIC is a 12-item scale with four-response options (e.g. 0=not true, 3=true). A sample of 1350 students 10-18 years old participated. Confirmatory factor analyses showed that two correlated factors (fears of physical arousal and fears of mental catastrophe) fit the data better than a single factor. This two-factor structure showed metric invariance in boys and girls; and in children and adolescents. Reliability is excellent for ASIC total score and both subscales (alphas = .82 - .92. Test-retest reliability was also high (intra-class correlations .62 - .75)). Correlations with STAIC ranged from .44 to .52. Correlations with anxiety symptoms (assessed by SCAS total score) ranged from .50 to .56. ASIC scores explained a unique portion of variance of panic attack/agoraphobia scores, beyond that explained by trait anxiety (STAIC) and depression (CDI). The relationships of ASIC scores with depression (CDI) were low. ASIC total and subscale scores showed a strong bifactorial structure, excellent reliability, and adequate convergent and divergent validity.
Assessment of functioning and disability: A validity study of the BECAD battery 1Universitat Jaume I, Spain; 2Hospital La Magdalena. Spain; moro@psb.uji.esmoro@psb.uji.es
The International Classification of Functioning, Disability, and Health (ICF) provides a useful theoretical framework for the rehabilitation of chronic diseases. However, the ICF is not an assessment tool. Since its publication in 2001, a number of assessment measures have been developed but until now, none has been comprehensive enough to cover all the constructs described in the Activities and Participation chapter of the ICF. The BECAD is a set of scales based on ICF for treatment planning and outcome assessment in rehabilitation facilities. Since the first structural studies published in 2013, additional validity analyses were carried on and are presented in this study. Participants were distributed in two clinical samples: severe mental disorder (mainly schizophrenia and bipolar disorder) (n= 110) and brain injury or stroke (n=50) and a group with participants without disability nor chronic diseases (n=60). Validity analyses consisted in comparison with other measures of disability and a battery of neuropsychological tests. The utility of the BECAD was proved in three subsamples that had received a cognitive remediation treatment. Besides, reliability analyses were performed (internal consistency).
Psychometric properties of the German validation of the Toronto Mindfulness Scale University of Zurich, Switzerland; d.pang@psychologie.uzh.chd.pang@psychologie.uzh.ch
In recent years there has been a growing interest in mindfulness “[…] to pay attention in a particular way – on purpose, to the present moment, nonjudgmentally” (Kabat-Zinn, 1994, p. 4). Despite several mindfulness scales, the Toronto Mindfulness Scale (Lau et al., 2006) is the only self-report measure, which assesses mindfulness as a state. The present study aims to investigate the psychometric properties and explore the factor structure of the German version of the TMS in a non-clinical sample. The scale was translated into German using a back-translation procedure. The sample consists of 203 participants ranging from 17 to 77 years (M = 35.4, SD = 14.3; 106 male, 97 female), who completed the questionnaire online. Exploratory factor analysis (EFA) with an oblique rotation (oblimin) of the 13 items was computed. The results suggested a two-factor model (curiosity and decentering), which is consistent with the initial version of the scale. Both subscales (α = .88 and .75 for curiosity and decentering respectively) and the total score (α = .87) had acceptable to good internal consistency. Findings suggest that the German version of the TMS demonstrates acceptable psychometric properties and warrant its use for assessment of state-mindfulness in future studies.
Merrymaking questionnaire, a Mediterranean conception of enjoyment: Sex-invariance approach Universidad Autónoma de Madrid, Spain; oscar.lecuona@hotmail.comoscar.lecuona@hotmail.com
Is there a specific way to enjoy life in the Mediterranean culture? Does the Mediterranean culture a different way to approach joy? Does this specific way to live life have an effect in others life skills, culture or society? To study this, we created the merrymaking questionnaire (Merry-Q) and we validated it with a Spanish sample (n=231) as a first-step analysis for a future cross-cultural comparison. Participants were 227 women and 94 men (M(age)=24.45, SD=7.441). Each gender group had a age range of around 24 years (M=25.03, SD=7.228) and 25 years (M=26.46, SD=8.23) respectively. A 6-factor structure (informal talk, shared enjoyment, table talk, festive attitude, enjoyment at work, and carpe diem) showed good fit indices and reliability (CFI=.938, TLI=.921, RMSEA=.063, SRMR=.053; Cronbach's alpha=.86, McDonald's omega=.92). We tested the invariance in the 6-factor model, and we can assume that the Merry-Q has invariant psychometrical properties between men and woman (structural invariance). This is a great opportunity to test the Merry-Q making future cross-cultural comparisons.
Associations between cognitive decline and response quality in self-rated personality questionnaires: The PsyCoLaus study 1University of Lausanne, Switzerland; 2Lausanne University Hospital, Switzerland; marc.dupuis@unil.chmarc.dupuis@unil.ch
Our purpose of this study was to examine the associations between cognitive decline and the response quality to personality questionnaires. The study sample consisted of 415 participants aged 65 or older from the PsyCoLaus study in Lausanne who completed the NEO Five-Factor Inventory (NEO-FFI), the Symptom Checklist 90–revised (SCL-90-R), and various neurocognitive tests. Based on Gendre’s functional method, two indices measuring the quality of the entire set of responses were calculated for the NEO-FFI: coherence and reliability. Multiple linear regression analyses were performed to measure how much of the variance of these indices of response quality could be explained by the results of the neurocognitive tests, controlling for sociodemographics and the SCL-90-R factors. Determination coefficients ranging from 17% to 24% were measured, indicating that response quality was explained by the models. Psychiatric symptoms explained a significant proportion of the variance (10%-17%) over and above the effects of cognitive decline. The two main findings are 1) cognitive decline leads to non-negligible decreases in coherence and reliability, and 2) psychiatric symptoms have important effects on response quality in patients over 65 years. Our findings call for further research identifying populations unable to provide sufficiently valid responses to self-rated questionnaires.
The administration of the verbal comprehension subtests of the Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V) among Malaysia Children: The analyses of the reliability and the validity of the test University of Malaya, Malaysia; aishahr@um.edu.myaishahr@um.edu.my
The Wechsler Intelligence Scale for Children (WISC), developed by David Wechsler, is an individually administered intelligence test for children between the ages of 6 and 16. The latest version of the WISC-V was introduced in mid-2014. The basic structure of WISC-V consist of the Verbal Comprehension (Similarities, Vocabulary, Information, and Comprehension), Visual Spatial (Block Design and Visual Puzzles), Fluid Reasoning (Matrix Reasoning, Figure Weights, Picture Concept, and Arithmetic), Working Memory (Digit Span, Picture Span, Letter, and Number Sequencing), and Processing Speed (Coding, Symbol Search, and Cancellation) (Pearson, 2014).This study will only focus on the Verbal Comprehension subscales. Since most of the intelligent test is developed in Western countries such as America, one must be careful when administering it in their own culture. However there is experience in administeing the WISC-IV, it was found that WISC-V is appropriate to be administered among Malaysian children. The instuctions of the subtest will be translated verbally in Malay when administering the subtests to the children. Thus, the study will test the reliability and the validity of the WISC-V and administering the test directly to the Malaysian children.
What has been done in reliability and validity generalization research? A systematic review 1ZPID - Leibniz Institute for Psychology Information, Germany; 2University of Trier, Germany; schroth@zpid.deschroth@zpid.de
Irrespective of other important factors, the continuous examination of validity and reliability is one essential ingredient to the high quality of psychological testing and assessment (see the guidelines of the International Test Commission, ITC, 2001). However, the vast number of validity studies and the intransparency of reliability data may provide an unclear picture of "true" test quality. The meta-analytical aggregation of validity and/or reliability studies provides one way to gain a substantial overview of existing data. Though researchers have been applying validity generalization (VG) since the late 1970s (Schmidt & Hunter, 1977), reliability generalization (RG) is a more recent methodological development (Vacha-Haase, 1998). Since to date, no paper has been published that summarizes studies in VG and RG research, we present a comprehensive overview of investigated instruments. Therefore we conducted a systematic literature search using PsycINFO, PSYNDEX, MEDLINE, Eric and Web of Science. All papers using meta-analytic techniques, measuring psychological aspects and published in German, English or Spanish were included. For RG this resulted in 78, for VG in 92 instruments. The results reveal differences in analyzed instruments between VG and RG, as well as a substantial lack of German-authored research in both research fields.
Validation of the German version of the Strengths Use Scale 1Medical University of Innsbruck, Austria; 2Leopold Franzens University Innsbruck, Austria; 3University of Western Australia, Australia; 4Health and Life Sciences University, Austria; alexandra.huber@i-med.ac.atalexandra.huber@i-med.ac.at
Theoretical perspectives in positive psychology have focused equally on possessing and using human strengths. However, due to the lack of appropriate psychometric scales in measuring the use of strengths, most studies simply concentrate on having them. Therefore, this study aims to determine the psychometric properties of the German version of the Strengths Use Scale in two distinct samples (n1 = 97; 63 females, 34 males; mean age 34.0±16.4; n2 = 265; 191 females, 74 males ;mean age 25.4±7.2). Factorial validity confirmed a single-factor structure with high internal consistency (study 1: exploratory, 55.5% variance explained, factor loadings from .59 to .85, Cronbachs Alpha = .94; study 2: confirmatory, 61.2% variance explained, factor loadings from .63 to .88, Cronbachs Alpha = .96). Preliminary expected relationships were found between strengths use and positive affect (r = .56), self-esteem (r = .75), vitality (r = .70), and perceived stress (r = -.67) indicating a good convergent validity. The German version of the Strengths Use Scale presents a valid and reliable representation of the original English language version, allowing an extension to new cultural settings.
The use of implicit measures to study the dissociation of cognitive and affective Theory of Mind in oppositional defiant preschoolers. Universitat Autonoma de Barcelona, Spain; nuria.delaosa@uab.catnuria.delaosa@uab.cat
Assessing preschoolers is a challenging task. The goal of the present study was to examine affective-cognitive dissociation in Theory of Mind (ToM) in a community sample of preschool children, and more specifically in a sample of preschool children diagnosed with Oppositional Defiant Disorder (ODD) by means of a computerized implicit measure. Data was collected from a sample of 538 five-year-old children, forty of who were diagnosed with DSM-IV Oppositional Defiant Disorder. Structured diagnostic interviews and dimensional measures of psychopathology, impairment, and unemotional traits were further used to establish clinical state. An implicit and intuitive measure of ToM, based on eye-gaze (YONI) was used to assess cognitive and affective ToM. Mixed analysis of variance (ANOVA) compared the mean cognitive versus affective scale scores obtained through (YONI), and the between-subjects factor ODD (present vs. absent). Partial correlations evaluated the association between YONI-scores and the other clinical measures. Results indicate that YONI is a useful measure to detect ODD children differential reaction times when performing the affective metalizing condition. Furthermore, correlation analysis indicated that distinct impaired ToM aspects correlated with different clinical indicators. These results highlight the possibility of highlighting very young children in the assessment process. This allows for getting specific information to design appropriate interventions.
Intelligence and personality traits as predictors of correctional officers’ performance in The Estonian Academy of Security Sciences 1Estonian Academy of Security Sciences, Estonia; 2University of Tartu, Estonia; aire.mill@sisekaitse.eeaire.mill@sisekaitse.ee
The nature and demands of correctional work require the tolerance of higher psychological strain and work-related stress. The main goal of this study was to examine the predictive validity of intelligence and personality traits in predicting performance of correctional officer cadets in The Estonian Academy of Security Sciences. The sample consisted of 273 cadets (74 females, 199 males), who completed two measures during admission procedure: the Personality Inventory NEO-TRI consisting of five personality domains (Emotional Stability, Extraversion, Openness, Agreeableness, Conscientiousness, and 15 subscales) and the Mental Abilities Scale VVS to measure verbal, numerical and visuo-spatial abilities, both measures are developed by Tripod. The academic success was defined by the grade point average during the studies and the success of final examination. Also, the age, gender, and grade points obtained at college were taken into account. The results demonstrated that the spatial ability and conscientiousness together with higher grade point average in college, higher age, and female gender are important predictors of academic success among correctional officer cadets. In addition, as there are broad spectrum of subjects during correctional studies (juridical as well as practical skills), the links of intelligence and personality traits with academic success tend to be more subject-specific.
Spillover processes between work and family 1University of Fribourg, Switzerland; 2Humboldt University of Berlin, Germany; sebastian.siegler@unifr.chsebastian.siegler@unifr.ch
Affective spillover from work to family is established from earlier studies, but less is known about the spillover from family to work. According to research on work-family boundary dynamics (see Allen, Cho, & Meier, 2013), the two life domains are differentially permeable, implying that the spillover effect is more pronounced in one direction than the other. We analyzed these competing spillover effects between work and family with a bivariate model. Since organizational scholars have increasingly emphasized the role of time in building theory (e.g., Shipp & Cole, 2014), we additionally examined the temporal dynamics (e.g., duration, peak of effect size) of these spillover effects. Using data from a time-sampling study with dual-earner parents (n = 56 couples) who rated their momentary affect seven times a day for seven days, we studied spillover effects by means of continuous time structural equation modeling. As expected, the affective spillover from work to family was stronger than from family to work, both for men and women. We conclude that the permeability of the two life domains differs and identify the family domain as being more susceptible in terms of affective spillover.
Internal consistency of biosignals induced by emotions over stimuli and times 1Electronics and Telecommunication Research Institute, South Korea; 2Chungnam National University, South Korea; shk1028@etri.re.krshk1028@etri.re.kr
In Human-Computer Interaction. HCI, many studies have done acquisition of biosignals for emotion recognition, but biosignals by various emotions are stable remains unknown. In this study, we examined reliability of biosignals induced by emotional stimuli (provoking happiness, sadness, anger, fear, disgust, and surprise) over 10 experimental sessions. For emotion induction during 10 sessions, we measured twelve participants’ biosignals before the presentation of stimuli as baseline and during, as they watched sixty different emotional stimuli (6 emotions * 10 sessions), which are selected by pilot study as emotional condition. The measured signals were skin conductance level (SCL), mean skin temperature (SKT), heart rate (HR), and mean photoplethysmograph (PPG). Participants rated their experienced emotions on self-report scale. Result by internal consistency showed that biosignals induced by emotional stimuli were reliable over the 10 sessions. In particular, we identified that biosignals such as SCL, HR, and PPG are very reliable. We suggest that biosignals induced by six emotions are reliable regardless various stimuli and time. This means that biosignals are the reliable and useful tool for emotion recognition. These results can be useful in developing an emotion theory, or profiling emotion-specific autonomic responses, as well as establishing the basis for emotion recognition system in HCI.
The assessment of axiological factor opens to change in values’ becoming: Cross-cultural comparison Taras Shevchenko National University of Kyiv, Ukraine; rslv2002@mail.rurslv2002@mail.ru
This study makes use of PVQ (Schwartz, 1994; 2001) to examine psychometric properties of Openness to Change (OC) factor in large student sample from Romania (n = 183) and Ukraine (n = 200). An additional purpose is to examine value differences across cultures by applying one-factor model focused on OC as salient process of values becoming. Results support for the generalizability of the one-factor model on OC values in Ukraine and Romania. Two separate models were tested in the Romanian and Ukrainian groups, respectively. Models showed a very good fit. The CFA model estimated via SEM and was analyzed for the Romanian data set χ²(14, n = 382) = 26.03, p = .026, CFI = .939, RMSEA = .069) and for the Ukraine data set χ²(13, n = 382) = 25.91, p = .017, CFI = .929, RMSEA = .07 1) separately. The associations of self-direction and stimulation item loadings within both groups were all statistically significant. The results showed a consistent relation between factor loadings for OC one-factor model. The results support the path models for both samples testing two separate models in the Romanian and Ukrainian groups, respectively. The results of the models fit statistics were largely satisfactory, CFA model showed the item loadings of self-direction and stimulation within both groups were all statistically significant.
Tests of strategy knowledge: Theoretical problems and need for further research University of Duisburg-Essen, Germany; florian.buchwald@uni-due.deflorian.buchwald@uni-due.de
Tests of strategy knowledge are used with increasing frequency in educational psychology and science education (e.g. Artelt, Beinicke, Schlagmüller, & Schneider, 2009; Artelt, Neuenhaus, Lingel, & Schneider, 2012; Lingel, Götz, Artelt, & Schneider, 2014; Scherer & Tiemann, 2012; Schlagmüller & Schneider, 2007; Schlagmüller, Visé, & Schneider, 2001; Shahat, Ohle, Treagust, & Fischer, 2013; Thillmann, 2007). However, potential problems concerning the validity, the test construction, or the scoring methods are seldom reported or investigated. The tests of strategy knowledge that are discussed consist of a short scenario description followed by a limited number of action possibilities (strategies) that are rated on a Likert Scale. The theoretical poster will sketch the typical construction process of tests of strategy knowledge, illustrate some potential problematic measurement aspects (concerning, among others, expert ratings, equivalence of strategies, scoring in case of non-serious answering, little differentiation of the answer quality between test takers, testlet effects), and give a short outlook on possible ways to study these potential problems empirically.
Professional Profile 2: A personality at work questionnaire developed using IRT 1Central Test, France; 2Université de Paris 8, France; 3People Portfolio Measurement Ltd., UK; celine.jouffray@centraltest.comceline.jouffray@centraltest.com
The personality questionnaire, Professional Profile 2, is a 112 forced-choice questionnaire that analyzes a candidate's preferences and motivations at work on 14 fundamental opposing dimensions of the human character (e.g. introversion - extraversion). The aim of this poster is to present its development. Despite the distorted construct validity and relative rather than absolute scores resulting from the classical scoring of forced-choice questionnaire, this format is appreciated in psychological assessment industry as it allows to reduce the impact of social desirability in recruitment context. To overcome these limitations, we used the Thurstonian IRT model, developed by Brown, & Maydeu-Olivares (2013) to solve the problem of ipsativity in forced-choice questionnaire. Throughout several pretests, the structure of the scale as well as the power of items were analysed. Items were retained if their R2 and factor loading were significant. Non-significant items were modified until at least one indicator was significant and the goodness of fit indicator showed a good convergence of the model. The final validation study was done with 345 American, 378 English and 849 French professionals for the English and French version, respectively.
Screening for personality disorders among Albanian and Kosovo students 1Mental Health Center Prizren, Kosovo; 2European University of Tirana, Albania; 3European Center for Vocational Education “QEAP-Heimerer”, Kosovo; naimfanaj@gmail.comnaimfanaj@gmail.com
Brief screening instruments for personality disorders (PD)s could potentially have great value in community settings. Self-reports continue to be the most widely used in the assessment of PDs, although they are prone to criticism because they grossly over-diagnose. Research on personality disorders in Kosovo and Albania is quite scarce. This is a correlational study assessing relationships between demographic characteristics (age, gender) and PD . Participants were 317 randomly selected students between 18 and 44 years old (M=24.01; SD=5.10); 154 from Kosovo and 163 from Albania;there were 188 girls and 129 boys. Participants filled out the IIP-PD-25 questionnaire (Pilkonis et al.; 1996). Results indicated that 57.1% (Albania) and 54.6% (Kosovo) of participants resulted with Personality Disorder definite score. Age (youngest) showed significant positive correlation only for the Albanian sample students (r=.192, p<.01). Mann-Whitney U test did not find statistically significant differences on the PD screen index based on gender in the both samples; also there were no differences in PD index in Albanian and Kosovo samples. Personality disorders often cause problems for others and pose a great social cost; early screening, identification and treatment represents a highly valued public health topic to be addressed.
Assessment of depression in patients with Diabetes Mellitus (DM): Impact in glycemic control, distress, adherence to treatment and complications associated with diabetes 1Universidad de Málaga, Spain; 2Instituto de Investigación Biomédica de Málaga (IBIMA), Spain; 3Hospital Regional Universitario de Málaga, Spain; 4Spanish Biomedical Research Centre in Diabetes and Associated Metabolic Disorders, Spain; anarte@uma.esanarte@uma.es
The prevalence of depression is higher in people with diabetes mellitus (DM) than without it. Depression has negative effects on the health of these patients. The objectives of this study were as follows: To study the effects of depression in patients with DM in glycemic control, complications associated with diabetes, diabetes-related emotional distress, and adherence. The sample consisted of 375 patients (DM1= 259; DM2= 116) of the Diabetes Unit, Department of Endocrinology and Nutrition, University Regional Hospital of Malaga (Spain), and the Diabetic Association “La Sierra”, Córdoba (Spain). Parametric and nonparametric tests were used. Patients with type 1 diabetes and depression had significantly higher HbA1c levels than patients without depression. On the other hand, patients with diabetes (type 1 and type 2) who suffered complications had higher depressive symptoms than those who did not suffer complications. Patients with diabetes (type 1 or 2) and depression had higher distress than patients without depression. Finally, adherence to treatment was lower in patients with diabetes and depression. These data highlight the importance of depression in DM, and show that it is necessary to conduct a program that includes the diagnosis and treatment of depression in patients with DM.
Power analysis of structural equation modeling in testing measurement invariance National Cheng Kung University, Republic of China (Taiwan); cpcheng.psy@gmail.comcpcheng.psy@gmail.com
Testing measurement invariance plays a crucial role in developing a valid and fair instrument. Typically, in a study to test measurement invariance, if we fail to find significant result, we conclude the scale is measurement invariant. However, if the power to test measurement invariance is low, it may be invalid to achieve such conclusion due to type II error. In the study, we proposed a power analysis procedure for testing measurement invariance. Based on Satorra (1999), given sample size, if values of parameters under alternative hypotheses are known, non-central parameter can be obtained and then the power of likelihood ratio test can be determined approximately. The procedure can be also applied to determine adequate sample size in a study to test measurement invariance with desired power. The above procedure is demonstrated using a large dataset consisting of 5051 junior high school students’ responses on the center for epidemiologic studies depression scale. Additonally, we re-sample several samples with different combination of sample sizes of male and female students are drawn from the above dataset so that empirical powers are estimated. Empirical powers and the powers calculated by the proposed procedure are then compared to validate the procedure.
The usability of the model of experience processing in personality organisation assessment Adam Mickiewicz University, Poland; soroko@amu.edu.plsoroko@amu.edu.pl
General model of emotional experience processing presented by Baker and co-workers refers to the manifestations of processing and encompasses (1) an event leading to the emotional arousal, (2) full emotional experience and (3) its expression together with regulatory strategies. The possible supplement of this model consists in the referral to the deeper processing mechanisms, namely structure of the emotional-relational representation and processes connected with it. Two different approaches of the intrapsychic aspects of processing are offered here: the psychoanalytic model of the referential cycles (authored by Bucci), and the narrative experience processing (Angus and colleagues). Both approaches indicate important manifestations of the emotional experience processing in patient’s speech as well as underlaying stages and mechanisms, as the activation of mental representations, articulation of emotional experience, reflection or emotional regulation. The broadened model of emotional experience processing is discussed in the context of the Kernberg’s model of personality organisation and supported by the authors’ own and other empirical studies. The regularities and disruptions of experience processing are depicted and reviewed and some practical remarks about usability of the model in borderline personality organisation diagnosis are made.
Adaptation of Troyer Level of Consciousness Inventory (TLOCI) in Poland Adam Mickiewicz University, Poland; aslysz@amu.edu.plaslysz@amu.edu.pl
The Troyer Level of Consciousness Inventory (TLOCI) (Troyer, 2008) is an introspective, subjective, self-report instrument that falls within the Higher-order thought theory (HOT). Psychometric properties of the TLOCI were analysed on a Polish sample of 158 subjects. The TLOCI was first translated into Polish, and then its psychometric properties were examined. The obtained results suggest that this version of the scale is a reliable measure of the level of consciousness although the Polish version has lower Cronbach’s alphas than the original version. The construct validity of the TLOCI was tested using a confirmatory factor analysis (CFA). The Polish version of the questionnaire consisting of 23 items and 5 subscales (Meta Self-Awareness, Reflection, Openness, and Helping Others) was prepared for future research.
The scale development of Taiwanese workplace bullying 1Fu Jen Catholic University, Republic of China (Taiwan); 2National Defense University, Republic of China (Taiwan); 3National Taiwan Normal University, Republic of China (Taiwan); yaonan1208@livemail.twyaonan1208@livemail.tw
“Workplace bullying” refers to situations where an employee is persistently exposed to negative behaviors or attitudes in the workplace, with the effect of being humiliated, intimidated, frightened, or punished. Workplace bullying behaviors always make negative organizational atmosphere and low productivity. However, there are few studies discussing the above issues. Furthermore, because of the culture differences, the definitions and perceptions of workplace bullying are not consistent in both Western and Asian organizations. According to the above descriptions, the purpose of this study is to build the Taiwanese workplace bullying scale. A series of interviews and quantitative analysis were used to find the dimensions of Taiwanese workplace bullying behaviors. Depending on the exploratory factor analysis, and item-to-response ratio, and correlation analysis, a 24-item scale was developed. It consists of the following four dimensions: personal bullying, physical bullying, interpersonal relationship bullying, and job content bullying. The Cronbach's α of the scale is .93, and subscale ranges from .76 to .90. After the confirmatory factor analysis, the results showed the above scale has stable construct validity. Also, it has appropriate convergent and discriminate validity. Finally, this study found that there is cultural differences in the concepts of workplace bullying behaviors.
Development and psychometric validation of the Resilience to Bipolar Disorder (RBD) questionnaire 1University of Deusto, Spain; 2Santiago Apostol Hospital, Spain; 3Lancaster University, England; a.echezarraga@deusto.esa.echezarraga@deusto.es
The study aims to describe the development of the Resilience to Bipolar Disorder (RBD) questionnaire and to test its preliminary psychometric properties. These properties - Cronbach's α, convergent validity and sensitivity - in a diverse sample consisting of a Bipolar Disorder (BD) sample and a sample from the general population (GP), using the RBD and the Resilience Scale-25 (RS-25; Las Hayas et al., 2014). The content of the RBD was developed after qualitative interviews with BD patients and clinicians. Based on its results, a 41-item RBD questionnaire was developed and completed by 113 participants with BD (69 women and 44 men; mean age = 45.48; SD = 10.65) and by 71 participants from the general population (55 women and 16 men; mean age = 36.46; SD = 11.11). RBD's reliability (Cronbach's α = .93) and convergent validity - with the RS-25 - (r = .65, p < .001) were supported. Both RBD (MBD = 158.34; SD = 23.28 vs. MGP =162.01; SD = 18.60; p < .01) and RS-25 (MBD = 126.75; SD = 28.56 vs MGP = 144.70; SD = 20.60; p ≤ .001) presented lower scores in resilience for BD sample than for the general population sample. RBD is a reliable and valid measure of resilience in BD. Future studies should explore further its psychometric properties.
The 20-item IPIP scale for personality assessment – Factorial structure study 1Constantine the Philospher University, Slovak Republic; 2Bratislava, Slovak Republic; tsollar@ukf.sktsollar@ukf.sk
The aim of this study is to examine/verify factorial structure of the Slovak version of 20-item short personality scale using the Big-Five Factor Markers from the International Personality Item Pool, measuring Extraversion, Agreeableness, Conscientiousness, Emotional stability, and Intellect/Imagination. Data from two samples were used and factorial invariance was tested among these subsamples. The first sample consisted of 306 high school students aged 16-19 (145 male, 161 females; M age = 17.2, SD age = 0.85), the second sample consisted of 534 adult patients aged 18-83 with various diagnoses (291 male, 243 female; M age = 56.53, SD age = 15.96). To address the objectives exploratory and confirmatory factor analysis were used. The results for both samples suggest that the scale has a five-factor structure. Factors correlate only weakly. Minor differences among the sample samples are discussed. The results show promising validity of Slovak version of 20-item IPIP scale for quick assessment of personality in various settings.
Personality typology: A multi-model and multi-questionnaire study 1Cardinal Stefan Wyszynski University, Poland; 2Universität Zürich, Switzerland; n.cybis@uksw.edu.pln.cybis@uksw.edu.pl
In recent years, researchers have adapted the concept of ego resiliency and ego control (Block & Block, 1980) to describe personality types based on Big Five personality traits (eg Asendorpf et al., 2001). A number of studies point to the repeatability of three types: resilient, undercontrolled, and overcontrolled, although some suggest the presence of four (Barbaranelli, 2002) or five types (eg Sava & Popa, 2011). We applied two-step cluster analysis (Ward’s method followed by k-means analysis) with double cross-validation procedure, as proposed by Asendorpf et al. (2001), to identify the number of personality types in four studies conducted on total of over 3,700 participants (aged 16 - 83; M = 30,8; SD = 12,6; 1961 women and 1739 men). Personality questionnaires included in the study are NEO-PI-R (Costa & McCrae, 1992; Polish adaptation: Siuta, 2006) NEO-FFI (Costa & McCrae, 1992; Polish adaptation: Zawadzki et al., 1998), and Polish adaptations of IPIP-BFM-50 (Goldberg, 1999), BFI (John & Srivastava, 1999), IPIP-45AB5C (Goldberg, 1999), FFPI (Hendricks et al., 1999), BFAS (DeYoung et al., 2007), BFQ (Caprara et al., 1993), TIPI (Gosling et al., 2003), and IPIP-HEXACO (Ashton et. al., 2006) by Strus, Cieciuch, & Rowiński (2011-2014). Obtained cluster solutions are compared in this presentation.
Applying semiparametric models to the analysis of parental child care selection University of South Carolina, USA; sherlocp@mailbox.sc.edusherlocp@mailbox.sc.edu
The psychological sciences can benefit from the application of alternative modeling strategies to help understand complex issues such as behavior, selection, and personality. One such model, the semiparametric multinomial logit model, is of particular interest because it can be used to investigate categorical outcomes as a function of smooth effects associated with continuous covariates. These models may be useful in the social sciences because they allow researchers the opportunity to delve deeper into how people’s traits and characteristics influence their behavior beyond what is typically possible with parametric models. This poster will provide the key features of semiparametric multinomial logit models to show how they may benefit psychologists and researchers. To facilitate learning, an empirical example will be presented to illustrate how this model may be used with a study of low-income families’ choices of child care quality. Continuous and categorical covariates that pertain to key factors thought to be associated with access to child care will be investigated. Modeling continuous covariates with penalized splines will provide valuable insight into the non-linear nature of these effects. Semiparametric models will be compared to their parametric counterparts and evaluated based on predictive performance.
Test of Memory Malingering (TOMM): Normative data for the Latin American adult population 1University of Deusto, Spain; 2Servicio Médico Legal, Chile; 3Universidad de Guadalajara, Mexico; 4Universidad Surcolombiana, Colombia; 5Universidad Javeriana, Colombia; 6Virginia Commonwealth University, USA; 7IKERBASQUE. Basque Foundation for Science, Spain; dfriverac@deusto.esdfriverac@deusto.es
The objective of this study was to generate the first and most comprehensive demographic-adjusted norms for the Test of Memory Malingering (TOMM) in Latin-American adult population. The sample consisted of 3376 healthy adult participants from 7 countries in Latin-American representing the demographic distribution of the population. Inclusion criteria were to have a Mini-Mental State Examination (MMSE) score of≥23, have a Patient Health Questionnaire–9 (depression) score of≤4, and have a Barthel Index of≥90. 2053 were women and 1323 were men; the average age was 55.0±19.5 years (range 18-90), and the average duration of education was 10.1±5.1 years. Participants completed the TOMM. Pearson correlation coefficient and coefficient of determination showed significant effect between TOMM scores and MMSE, age, and education (r-squared -0.257 to 0.329; p’s<.001). Multinomial logistic regression yielded main effects for age and education groups on the Test TOMM scores (r-square Cox & Snell>.141, p’s<.001). Consequently, correction tables were created in order to adjust the raw scores based on age and education. The percentiles tables were calculated based on the distribution of adjusted scores. This study is the first to create TOMM norms in the Latin-American population and include appropriate adjustments for age and education. These data represent a critical advancement in the assessment in Latin-American adults.
Nuances of flow in work and cross-cultural adaptation of the Flow State Scale at work among Spanish speakers Universidad Autónoma de Madrid, Spain; egarciasalamanca@gmail.comegarciasalamanca@gmail.com
Flow is defined as a state of optimal experience with a deep creative enjoyment, full concentration, and absorption, and it's associated to personal growth and well-being. The Flow State Scale (FSS) was developed based on Csikszentmihaly’s theory (1990). Nevertheless, recent research has highlighted the need for further understanding of flow, while also taking into account other areas of personal development. The present study aims to provide further information about the flow construct structure as well as adapt and validate the FSS to a work context in cross-cultural settings. The FSS-W was applied in two different Spanish-speaking samples of workers (N(Spain)= 246; N(Mexico)= 217). Confirmatory Factor Analysis indicates that a structure of 9 first-order factors within 2 second-order factors (Precursors of flow and Flow experience) shows a better model fit for both Mexican (NFI = .951; GFI = .960; SRMR = .072) and Spanish samples (NFI = .974; GFI = .978; SRMR = .065). Moreover, invariance tests between both samples indicate no significant differences in measurement, structural weights, and structural covariances (ΔNFI < .010). In conclusion, the present work provides additional support for a new theoretical understanding of flow according to prior discussions and offers the FSS-W as a reliable instrument to assess flow in a work context among Spanish-speaking countries.
The development of insightful Remote Association Test in Chinese version 1Hsuan Chuang University, Republic of China (Taiwan); 2National Taiwan Normal University, Republic of China (Taiwan); 3National Cheng Kung University, Republic of China (Taiwan); chcjyh@ntnu.edu.twchcjyh@ntnu.edu.tw
Creativity, a process of connecting useful, unusual, and original ideas together, is positively associated with an individual’s ability to link different concepts, namely remote association. The Remote Association Test (RAT), developed by Medinick (1962), is the most commonly used creativity measurement. Moreover, prior research on problem-solving has shown that RAT shares the same characteristics with insight problems: encounter impasse and escape fixation. However, there exists no Chinese version of such insightful measurement. The present study aims to develop a Chinese version of RAT. We created 108 items with characteristics of insight problem. For each item, three Chinese words are presented simultaneously. First two words belong to the same sematic category (e.g., “NURSE” and “DOCTOR” are both related with the concept hospital), while the third word (e.g., “ENGINEER”) is far from that concept. An individual needs to come up with one word which is semantically related to the three presented words (in this case, the answer is “OCCUPATION.”). We recruited 184 college students and analyzed their responses for item difficulty and discrimination. Sixty items were selected to be formal testing items. The results suggest that our Chinese version of RAT has good reliability and validity.
The Portugese versions of the Postpartum Depression Screening Scale- reliability, validity, and screening accuracy at the twelfth month postpartum 1Universitity of Coimbra, Portugal; 2The Catholic University of Portugal, Portugal; apereira@gmail.comapereira@gmail.com
Although perinatal depression includes episodes occurring from pregnancy to the twelfth month postpartum, the Portuguese versions of the Postpartum Depression Screening Scale (PDSS) were only validated to use in pregnancy and until the third month. The aim of this study was to analyse the PDSS psychometric and operative properties at the twelfth month postpartum. Participants were 272 women (mean age=30.52±4.014 years) in the twelfth month post-partum. All women completed PDSS and were interviewed using the Diagnostic Interview for Genetic Studies. Receiver Operating Characteristic (ROC) analysis was applied (using MedCalc) to determine cut-off points and associated conditional probabilities adjusted to the prevalence. PDSS-35, PDSS-21 and PDSS-7 Cronbach alphas were .94, .90 and .78, respectively. The PDSS scores highly and significantly correlated with the Beck Depression Inventory-II (Beck et al., 1996) total score (r=.75; r=.75; r=.76). For major depression (prevalence 2.6%), PDSS-35 cut-off point>60, resulted in sensitivity 100%, specificity 87.45%, positive predictive value (PPV) 17.54% and negative predictive value (NPV) 100%; PDSS-21>35: sensitivity 100%, specificity 87.83%, PPV 17.99% and NPV 100%; PDSS-7>9: sensitivity 100%, specificity 71.86%, PPV 8.66% and NPV 100%. At the twelfth month postpartum all the PDSS versions revealed excellent reliability and concurrent validity and adequate screening ability.
Quality criteria of psychological reports: Development and initial assessment of a checklist University of Zurich, Switzerland; andreas_hausherr@access.uzh.chandreas_hausherr@access.uzh.ch
Writing psychological reports is one of the core competencies of professionals working in practice, it is also an important aspect in the education of future professionals in the field of assessment. Based on numerous sources (i.e. guidelines provided by professional societies or authors of text books data collection and ongoing analysis) we derived a list of 136 quality criteria (divided into 11 content areas) for a psychological report. The list focuses on all aspects of reports starting from the title page to the appendix and also includes criteria on how results from assessments should be reported or more formal aspects such as the correct use of tense in all parts of the report. We provide an overview on the checklist and report initial findings of the application of the checklist in a sample of > 80 reports written by students and > 30 reports written by practitioners . Analyses of the frequency of typical mistakes in all parts of the report, but also comparisons between students and practitioners will be reported. We expect that the checklist can be used for practical purposes to ensure the quality of reports written in practice (as a kind of reference), but also in educational settings in courses on the topic.
Assessment and diagnosis of depression in Spanish primary care services. The psychometric properties of the PHQ-9 using the SCID-I in the PsicAP Project. 1University of Valencia, Spain; 2University of Madrid, Spain; 3Spanish Council of Psychologists, Spain; roger.munoz@uv.esroger.munoz@uv.es
There is a strong demand on Spanish Primary Care (PC) services due to emotional disorders (ED), such as anxiety and mood disorders, which are poorly detected and barely attended with adequate treatment. The PHQ-9 is the module of the Patient Health Questionnaire (PHQ) used to diagnose depression based on the DSM-IV criteria for major depressive disorder (MDD). The SCID-I is a structured diagnostic interview based on DSM-IV criteria. Our aim was to study the validity of the PHQ-9 to detect depression, using the SCID-I as a reference standard. 178 patients completed the PHQ-9 and trained psychologists applied the SCID-I to them. Statistical analyses were performed to find out the psychometric properties of the PHQ-9, such as sensitivity, specificity, predictive values, and likelihood ratios. The screening test characteristics using a cut-off of 10 were: sensitivity = .95 and specificity = .67; the diagnostic test characteristics were better, with a sensitivity of .88, and specificity of .80. The PHQ-9 correctly identified the presence of MDD but found a considerable amount of false positives with a cut-off of 10. In turn, the PHQ-9 as a diagnostic tool, showed better psychometric properties. The PHQ-9 is a useful instrument to be used in Spanish PC services to detect depression.
Valid measures for assessing the efficacy of a psychoeducational intervention for first episode psychosis: What and when to assess? 1Clinic Hospital, Valencia, Spain; 2University Hospital of Álava (Santiago Apóstol), Spain; 3CIBERSAM, Spain; esterlorente@hotmail.comesterlorente@hotmail.com
Valid results from psychoeducational interventions in psychosis could be either improvement of functioning and/or symptoms (both positive and negative) and/or prevention of relapses. In this single-blind randomized clinical trial we included 32 patients with first episode psychosis, who were randomly assigned to either a control group with pharmacotherapy and regular sessions with their psychiatrist (treatment as usual) (n = 18) or an intervention group with integrated care including treatment as usual plus a 16 sessions of psychoeducational intervention (n= 14). Patients were evaluated with a battery of tests assessing clinical (Positive and Negative Syndrome Scale), and functional measures (Global Assessment of Functioning Scale, Functioning Assessment Short Test) at baseline and post-treatment. We found no significant differences in positive or negative symptoms, or in functioning between patients who received psychoeducational intervention and those who didn't. We conclude that short term clinical and functional measures could be not sensitive for assessing the efficacy of an individual psychoeducational intervention in first episode psychosis. Medium-long term outcomes, including data on relapse prevention would probably be more appropriated measures.
Assessing orientations to happiness in self- and peer-ratings: Testing relations with coping strategies and perceived work stress 1University of Applied Sciences of Special Needs Education, Switzerland; 2University of Zurich, Switzerland; annette.krauss@hfh.channette.krauss@hfh.ch
In his Authentic Happiness-theory, Seligman (2002) proposes three basic orientations to happiness; a life of pleasure (via hedonism), engagement (via flow-related experiences), and meaning (via eudaimonia). There is broad literature supporting their positive relation with numerous indicators of positive psychological functioning. The main aim of this study was testing (a) the overlap of self- and peer-rated orientations to happiness; (b) their relationship with self- and peer-rated coping strategies with stress; and (c) their relations with self-rated work stress. Using samples of self- (n=373; M=38.8, SD=10.8; 225 female and 148 male) and peer-ratings (n=101; M=39.8, SD=11.2; 62 female and 34 male) we found good convergence between the homologous scales; from r=.33-.48. Furthermore, positive associations between self- and peer-rated orientations to happiness and adaptive coping strategies with stress were found (e.g., r=.32-.37 for the self ratings and coefficients between r=.19-.22 for the peer-ratings). The three orientations explained 21% of the variance of the adaptive coping strategies with stress. In addition, self-rated life of pleasure was related negatively to self-rated work stress (r=-.24). The results indicate that the orientations to happiness are of importance in dealing with and experiencing of work stress.
A joint factor analysis of 17 playfulness instruments as a starting point for the development of a new measure? Some problems and considerations University of Zurich, Switzerland; nicole.jehle@uzh.chnicole.jehle@uzh.ch
There is no agreement about the definition of adult playfulness and different operationalizations that exist in literature. Additionally, there is a discussion about the dimensionality of this personality trait. The main aim of this study was testing the structure of adult playfulness using a joint factor analysis of 17 questionnaires and to explore the usefulness of this solution for the development of a new questionnaire. The initial set of 321 items was screened for redundancies and this led to a reduced set of 160 items. These were given to a sample of 237 adults (M = 41.0, SD = 12.9). We conducted a hierarchical factor analysis (as described in Goldberg, 2006) and found best fit of the data for a five-factor solution; i.e., Humorousness; Cheerful-Uninhibitedness; Expressiveness; Intellectuality-Creativity; and Other-directed. When testing the overlap of this solution with the big five personality traits (assessed with the Inventory of Minimal Redundant Scales; Ostendorf, 1990), we found strong overlap of two of the factors (i.e., Cheerfulness–Uninhibitedness and Expressiveness) with mainly extraversion, but also emotional stability. Hence, deriving a new structural model of adult playfulness from this analysis seems problematic, and other strategies seem more preferable.
Testing the relationship between the sense of humour and loneliness of older people in Romania National University of Political Studies and Public Administration, Romania; loredana.ivan@comunicare.roloredana.ivan@comunicare.ro
Previous research has found relevant differences between older and young people in the way the use humor in daily life activities. While several studies found that older people enjoy humor more than younger ones (Greengross, 2013), other studies found that older people laugh more rarely and less easily (Ruch, Proyer, & Weber, 2009) and the show less appreciation for everyday humor (Proyer, Ruch, & Müller, 2009). In the current study we investigate the relationship between the sense of humor and perceived social and emotional loneliness, using a sample (n = 86) of people over 65 years, from Bucharest, Romania. First, we validate the Multidimensional Sense of Humor Scale (Thorson & Powell, 1991) and the Social and Emotional Loneliness Scale for Adults (diTomaso, Brannen, & Best, 2004) on elders (65 years and above) in Romania and then we analyse the relationship between the two concepts on the target group. The results show that self-rated sense of humor, particularly the use of humor in social interactions could be negative related with the feelings of social loneliness. We discuss the results by taking into account the role of humor as a mechanism of coping in social interactions.
Validating a scale to measure career distress in young adults: A Rasch analysis Griffith University, Australia; p.creed@griffith.edu.aup.creed@griffith.edu.au
Career distress reflects negative feelings towards the career decision-making process, including anxiety, depression, avoidance, and procrastination (Larson et al., 1994). Numerous abbreviated versions (8-14 items) of the 21-item Subjective Career Distress and Obstacles Scale (Larson et al., 1994) have been used to assess career distress in young adults, but these brief versions have not been evaluated. We assessed the 12 highest loading items from the factor analysis reported by the scale developers, which were the items that met the “practical significance” criterion (i.e., factor loadings > + .50; Black et al., 1992). We used RUMM 2030 (Andrich et al., 2010) to conduct a Rasch analysis and assess model and item fit, response format, differential item functioning (DIF), and person separation (using 232 young adults: 158 female, 74 males; mean age 20.5 years). One item had significant misfit and was removed. The remaining 11 showed good person separation, little disordering of the thresholds, and no evidence of DIF. Residual analysis supported unidimensionality. Finally, the 11-item scale was associated negatively with positive affect (r = -.37) and positively with negative affect (r = .46), further supporting validity. The results support using these 11 items as a brief measure of subjective career distress.
The subjective quality of environmental conditions in different life domains and satisfaction with these domains: Assessment and malleability University of Zurich, Switzerland; f.gander@psychologie.uzh.chf.gander@psychologie.uzh.ch
Previous studies have confirmed the effectiveness of Internet-based positive psychology interventions for increasing well-being. However most of these studies do not consider different life domains and also do not distinguish between the satisfaction with and the perceived quality of environmental conditions in these domains. We aim at testing the effects of a well-established intervention on the satisfaction with four different life domains (i.e., work, leisure, social life, and health), and a score for general satisfaction; and examining whether the perceived quality of the environmental conditions in these domains is also affected (a sample item is “regardless of your satisfaction with work, how would you rate the environmental conditions at work?”). We randomly assigned 264 participants to an intervention condition (i.e., “Three good things”), or a placebo control condition. Participants conducted the assigned exercise for seven consecutive days. We assessed the satisfaction with, and the perceived quality of the conditions in different domains before the intervention, and after one, three, and six months. Results showed that the intervention lead to an increase in the overall satisfaction and the satisfaction with work, whereas the discrepancy between the satisfaction and perceived quality of conditions decreased. Potential implications and applications are discussed.
The construction and validation of an elementary and secondary Teacher Professional Development Inventory 1New Taipei Municipal Taishan Senior High School, Republic of China (Taiwan); 2Fu Fen Catholic University, Republic of China (Taiwan); ccyang@mail.fju.edu.twccyang@mail.fju.edu.tw
The professional development of teacher is an essential issue for education. This study aim to develop and validate a Teacher Professional Development Scale (TPDS) to help schools understand teachers’ professional development better. Based on school knowledge management framework (Zhao, 2010), our TPDS measures four factors. These factores are the are motivation for professional development, professional enhancement, application of professional development, and enthusiasm for and attitude toward education. 466 teachers from public senior high school and elementary in Taiwan were surveyed in this study. We conducted reliability and validity of TPDS by both exploratory and confirmatory factor analysis, cronbach’s alpha test, and correlations. External validity also examined in this study. The chi-square of model is significant that indicated TPDS reliability is stable (chi-square (129) = 492.46, p < .01, NFI = .87, CFI = .90, PCFI = .76, RMR = .07, RMSEA = .08) Cronbach’s alpha of four dimensions are from .73 to .87. TPDS is significantly positive to self-directed learning scale (SPDS). These result show the internal and external validity both are good. TPDS can provide basic and essential information of teacher professional development involvement. Finally, managerial implications and suggestions for future research are discussed.
The development of State-Mood-Trait Affective Questionnaire 1Fu Jen Catholic University, Republic of China (Taiwan); 2National Taiwan Normal University, Republic of China (Taiwan); 056384@mail.fju.edu.tw056384@mail.fju.edu.tw
This study aimed to develop state, mood, and trait affective questionnaire based on 3 affective categories and verify its reliability and validity. The original 17 items were selected from Chinese Emotion-Describing Words Database. Cluster analysis using items valence, arousal, continuance, dominance, frequency rating found 4 clusters: happiness(5 items), sadness-disappointment(4 items), fear-anger(5 items), and surprise-shyness(2 items), however surprise-shyness category was deleted due to low internal-consistence on item analysis of pilot study. Participants were asked to report their affective intensity of items based on now, two weeks, and everyday spans respectively which corresponded to affective state, mood, and trait measurements. 118 undergraduates participated in the research, and finished the State-Mood-Trait Affective Questionnaire, the scale of major depression disorder , State-Trait Anxiety Inventory-Trait, Rosenberg’s Self-Esteem Scale, PhoPhiKat and Humor Style Questionnair. The results revealed that: (1) 3 affective categories had acceptable Cronbach's Alpha (.69~.88), (2) Confirmatory factor analysis satisfied single construct model for every subscale, (3) everyday span affective intensity were greater than now or two-weeks span, (4) happiness intensity positively correlated with self-esteem, while sadness-disappointment, fear-anger scores negatively correlated to self-esteem, and finally, (5) state, mood and trait could successfully predicated PhoPhiKat and HSQ.
|
| 4:30pm - 6:00pm | IS5: On the Validity of Objective Personality Tests: What Do They Measure? Session Chair: Tuulia M. Ortner |
| KO2-F-180 (Ⅵ) | |
|
|
On the validity of objective personality tests: What do they measure?
Behavior-based measures, also called Objective Personality Tests (OPTs), have a long history in Psychology. During the last decade, their use and development was notably boosted in different fields of psychology as in social psychology, differential psychology, psychological assessment and, a number of applied fields. OPTs aim to capture behavior in highly standardized miniature situations; they lack transparency, and do not require introspection. Therefore, they are supposed to avoid two well-known weaknesses of self-reports: limited self-knowledge and impression management. Nevertheless, do current concepts of OPTs fulfil psychometric properties and standards in a way that allow for their application beyond their use in research? Within this symposium we aim to present a mixture of established and new developments and aim for further insight in OPTs psychometric properties with special regard to their validity and discuss how they can contribute to the advancement of personality research and assessment.
Presentations of the Symposium Economic games as objective personality measures – Stability, reliability, and validity ; maltese@uni-landau.demaltese@uni-landau.de
Study 1 (n=615) tested stability, reliability, and validity of behavioral reactions in economic games as indicators of altruistic and fairness dispositions. We assessed financial decisions in three independent rounds of a dictator-game and an ultimatum-game. Additionally, we assessed decisions in one round of a mixed-game. In this situation, participants were observers of a dictator-situation and decided what amount to invest in order to punish Person A and/or to compensate Person B, depending of Person A’s allocation to Person B. Six weeks later, behavioral reactions were assessed again. In addition, self-report measures of personality dispositions were administered. Latent-State-Trait Models revealed high relative stability of behavioral reactions and high reliability of the economic games. In Study 2, (n=518) a longitudinal design with three measurement occasions across 6 months, behavioral reactions in a dictator game and an ultimatum game were repeatedly measured together with self-reported personality dispositions. Importantly, this design informs about the relationship between changes in behavioral reactions and personality measures over time. Results and implications will be discussed.
An objective task-based personality test for assessing risk propensity: Analyzing feedback and convergent validity of the PTR ; victor.rubio@uam.esvictor.rubio@uam.es
Risk propensity referes to the individual tendency to choose highly rewarded alternatives even if they have a lower probability of occurrence (or even high probability of loses). Traditionally, the assessment of such construct has flipped from self-reports devoted to assess related constructs, such as sensation seeking or impulsivity, to a more or less domain-specific self-reports about concrete risk taking behaviors. Last decade has shown the development of several objective task-based personality tests (OPTs) with promising results, such as the BART (Lejuez et al., 2002), the GDT (Brand et al., 2005), the RT (Rubio el at, 2010) or the PTR (Aguado et al., 2011). Nevertheless, there are still certain aspects to explore. On the one hand, the role of task performance feedback in risk propensity assessment; one of the most reputed OPT (BDT) usually gives feedback on performance while other (RT) gives no feedback at all. The present contribution is aimed to show the effect of a controlled feedback on task performance. Ordinarily, OPTs have failed in showing convergent validity with domain-specific risk-taking self-reports. In this case, convergent validity of the PTR with the general personality dimensions supposedly related to risk-taking behavior is presented.
Is it a "test"? Psychometric criteria of the Balloon Analogue Risk Task ; tuulia.ortner@sbg.ac.attuulia.ortner@sbg.ac.at
The Balloon Analogue Risk Task (BART) represents a OPT of the new generation and has been widely and successfully used as a research tool for the assessment of risk taking for more than a decade. Literature reported scores tht revealed to be positively associated with self-reported risk-related behaviors such as smoking, gambling, drug and alcohol consumption, and risky sexual behaviors. Although the BART has been established as a research tool, but has not been used a measure for single case assessment or in clinical consulting so far. The following contribution further analyzes psychometric properties of the BART with special regard to its convergent and discriminant correlations with OPTs, rating scales and IATs, its criterion validity, and its temporal stability based on data of 370 participants who completed on the BART on three measurement occasions with 1-2 weeks between trials. Data shows that the BART assement is more stable than occasion specific aspect of the construct. Furthermore, data endorse that analyzes of construct validity based on simple MTMM approaches remains a crucial aspect in evaluation of OPTs.
Neuroimaging implicit and explicit assessment ; belinda.pletzer@sbg.ac.atbelinda.pletzer@sbg.ac.at
Dual-process theories have often been explained the fact that implicit (via IATs) or behavioral (via OPTs) measures of personality are not or only weakly correlated with scores achieved on explicit rating scales. However, only few neuroimaging studies have tested whether these modes are represented by separate neuronal systems. A functional imaging study assessed differences in brain activations in a group of 60 healthy adult participants. We chose two OPTs, the Balloon Analogue Risk Task (BART) and the Game of Dice Task (GDT), whereby the BART has been suggested to measure risk taking more spontaneously, and the GDT has been suggested to measure risk taking more reflectively. In the BART, risky decisions yielded significantly stronger activations than safe decisions in the bilateral caudate, as well as the bilateral Insula. In the GDT, risky decisions also yielded significantly stronger activations than safe decisions in the bilateral caudate and Insula, but additionally in the ACC and the left dorsolateral prefrontal cortex and inferior parietal cortex, regions previously associated with cognitive control and number processing. Thus, implicit processing was associated with subcortical activations, while more explicit processing activated similar areas, but was additionally associated with activation in cortical, particularly prefrontal regions.
|
| 4:30pm - 6:00pm | PA19: Measurement 2 Session Chair: Frank M. Goldhammer |
| KOL-G-217 (Ⅳ) | |
|
|
Assessing test-taking engagement using response times 1DIPF - German Institute for International Educational Research, Germany; 2IPN - Leibniz-Institut für die Pädagogik der Naturwissenschaften und Mathematik, Germany; 3ZIB - Centre for International Student Assessment, Germany; goldhammer@dipf.degoldhammer@dipf.de
A problem of low-stake assessments is low test-taking engagement threatening the validity of test score interpretations. Therefore, we addressed the question of how indicators of test-taking engagement can be defined and validated in the context of the OECD Programme for the International Assessment of Adult Competencies (PIAAC). The approach was to identify disengaged response behavior by means of response time thresholds (cf. Lee & Jia, 2014). Constant thresholds were considered as well as item-specific thresholds based on the visual inspection of (bimodal) response time distributions (VI method) and the proportion correct conditioning on response time (P+>0% method). Results based on 152514 participants from 22 countries showed that the VI method could only be applied to a portion of items. Overall, the validity checks comparing the proportion correct of engaged and disengaged response behavior revealed that the P+>0% method performed slightly better than the other methods. Finally, we computed the proportion of disengaged responses across items and countries by domain. Overall this proportion was quite low. The results also revealed that there was an increase from part 1 to part 2 of the assessment in disengaged response behavior suggesting a drop in test-taking motivation during the course of test-taking.
Examining test items for Differential Distractor Functioning (DDF) across different groups University of Crete, Greece; tsaousis@uoc.grtsaousis@uoc.gr
The aim of this study was to examine the effectiveness of the alternative false responses on multiple-choice items in cognitive based test. Particularly, using Item Response Theory (e.g. Differential Distractor Analysis) as a methodological framework, we were interested in examining whether the distractors, or incorrect option choices, used in each item increase the probability for DIF effects across different groups. Data were sampled from approximately 600 students from the Greek Military Academies (i.e., Air Force, Army and Navy Academy), and who completed the Army Numerical Reasoning Test. To examine for possible DDF effects we used the odds ratio approach, whereby the DDF effect of each distractor is obtained using a generalization of the Mantel-Haenszel common odds ratio estimator adapted to each distractor. The results from the analysis revealed that there some items that exhibit DDF across different groups. Results also suggested that items showing DDF were more likely to be located in the second half of the test rather than the first half. The findings from this study allow us to determine the items needed further observation, and designate DDF analysis as a useful tool that could be used to understand better why a particular item exhibits DIF across groups.
Controlling time-related individual differences in test-taking behavior by presenting time information Educational Research and Educational Information (DIPF), Germany; hacker@dipf.dehacker@dipf.de
Generally speaking, in ability or competence assessments, test takers answer the questions in a self-paced way. This can make test takers differ considerably in the amount of time spent to complete a task. Such (construct-irrelevant) individual differences in test-taking behavior can produce differences in test performance although test takers may be equally able or skilled. Thus, time-related test-taking behavior can influence the measurement and affect comparability of ability scores. Previous findings on this measurement problem relating to the so-called ‘speed-accuracy-tradeoff’ originate from speed test studies. The present study aims to address the research questions with regard to power tests and to develop appropriate measurement approaches. For this study, reading competence tests were administered in a control condition with no influence on the timing behavior and several experimental conditions differing in how the timing behavior was influenced. The impact of the conditions on individual differences in timing behavior, performance, as well as the tests reliability and validity were assessed. Additional covariates were assessed to further explore performance differences within experimental conditions. The random sample consists of 1065 german students (521 female, 544 male; M = 20.51 years). First results show, i.e., that presenting time information can reduce rapid guessing behavior and decrease the number of missing responses.
Gender differences in general knowledge tests: Caused by unbalanced interest domains? Bergische Universität Wuppertal, Germany; engelberg@uni-wuppertal.deengelberg@uni-wuppertal.de
Robust gender differences in standardized psychological tests of general knowledge, favoring men, have been repeatedly reported in test manuals and the pertinent literature. For example, the norm sample of the frequently used German general knowledge test I-S-T 2000 R evidenced an effect size of d = 0.30. In the present study, gender differences in interests as well as an inbalanced representation of interest domains between men and women in knowledge tests were both investigated as potential causes for these findings. Based on the results from an assessment of both male and female interests (n =507), a knowledge test consisting of 121 items that tap exclusively on female interest domains was created. A total of 202 participants completed both this new test and the I-S-T knowledge test. Subsequent factor analyses yielded a 2-factor solution with opposing gender differences. The I-S-T indicators showed substantial loadings on the factor with male advantage only. The results support the hypothesis that gender differences in knowledge tests are not based on gender differences in true general knowledge but may – at least partially – be attributed to an unbalanced item selection from predominantly male interest domains.
Are student evaluations of teaching really reliable? A Bayesian meta-analysis ETH Zurich, Switzerland; sherin.bopp@gess.ethz.chsherin.bopp@gess.ethz.ch
Student evaluation of teaching (SET) has become a fixed part of most university quality assurance systems in order to assess teaching performance. Numerous primary studies to different topics of SET reflect the strong development in research on SET especially in the last 30 years. In face of this huge literature it is still not possible to integrate results of primary studies to conclusive overall statements, even in comprehensive reviews. Therefore, for the first time in research on SET, more sophisticated Bayesian meta-analysis techniques have been used here to establish general quantitative statements about SET in order to address the complex problems of data analysis (e.g., multilevel data, different teaching dimensions). Of major concern in research on SET are the key concepts of test theory (e.g., reliability, validity). In a first step the reliability of SET has been investigated with 218 primary studies. We address the following questions: Which kind of reliability concepts were used in the studies? Are SET scores on the average actually sufficient reliable as Marsh (1984) has claimed? How much do SET results vary across and within studies? What are the determinants of reliability of SET? Inital results and conclusions will be presented.
|
| 4:30pm - 6:00pm | PA20: Intelligence Session Chair: Klaus D. Kubinger |
| KOL-G-204 (Ⅱ) | |
|
|
Practical assertion of paper-and-pencil adaptive testing: 30 years of experience with the intelligence test-battery Adaptive Intelligence Diagnosticum (AID) University of Vienna, Austria; klaus.kubinger@univie.ac.atklaus.kubinger@univie.ac.at
Adaptive testing has stood the test in practice over fourty years – when computerized tailored testing applies (see for a current review Kubinger, 2015, in print). However, in the case of especially young children, they may not be tested with a computer but individually under a psychologist’s supervision, and in these cases the use of some branched testing design may be the method of choice. Thereby the items are clustered in advance according to some intended cluster averages of item difficulty parameters. After each administered cluster of items, the optimally informative next item cluster is presented to the testee. As a consequence, there is no online ability parameter estimation needed after each administered item (cluster), but all ability parameter estimations can be done in advance. However, this approach is not too well-known. Here the respective conceptualization of the Adaptive Intelligence Diagnosticum (AID) is given. Apart from practitioners’ 30 years lasting approval, this branched adaptive testing test-battery has proven to have a shorter administration time, accompanied by a much higher accuracy of measurement (reliability). Lastly, there hardly ever occur achievement motivational problems in testees, either due to a lot of too easy items or due to a lot of too difficult items.
External validation and reliability of The Indonesian Wechsler Adult Intelligence Scale – Fourth Edition (WAIS-IV-IDN) 1ATMA JAYA Catholic University of Indonesia, Indonesia; 2Radboud University Nijmegen, The Netherlands; 3Academic Centre of Epileptology Kempenhaeghe, The Netherlands; 4Radboud University Medical Center, The Netherlands; magdalena.halim@atmajaya.ac.idmagdalena.halim@atmajaya.ac.id
The internal structure of the standardized Indonesian version of the Wechsler Adult Intelligence Scale – Fourth Edition (WAIS-IV-IDN) supports the expected internal structure of four first order factors and the full scale score as second order. In addition we evaluated the external validation and the scale’s reproducibility over time. For validation, we correlated WAIS-IV-IDN with the Raven’s Standard Progressive Matrices (SPM), Cattell’s Culture Fair Intelligence Test (CFIT), and The Modified Mini Mental State Examination (3MS). Furthermore, to investigate the scale’s reproducibility over time, we measured the test-retest reliability. There were 125 participants for the validation with SPM and CFIT, 90 participants for the validation with 3MS, and 77 participants for test-retest reliability. The Pearson product-moment correlation was used for analyzing data. We found positive and significant correlation coefficients between the WAIS-IV-IDN with all other tests (SPM, CFIT, and 3MS). The correlation coefficients ranged from .26 - .66. The result of test-retest reliability on all sub tests, indexes and Full IQ of WAIS-IV-IDN ranged from .47 - .92. In summary, the WAIS-IV-IDN is considered to be acceptable for using in Indonesia although there are still few limitations on test retest coefficients. Discussion of these findings would be explained further.
Speedy assessment of speeded reasoning with the intelligence screening “mini-q” 1University of Duisburg-Essen, Germany; 2University of Trier, Germany; tanja.baudson@uni-due.detanja.baudson@uni-due.de
Economic and nevertheless valid assessment of cognitive ability is useful under time constraints, especially in large research projects where this resource is limited. The intelligence screening "mini-q" allows to assess speeded reasoning in three (adults) to five minutes (children). Based on Baddeley's Test of Verbal Reasoning (1968), the mini-q does not only include verbal, but also visuospatial aspects. We will present evidence for the reliability and validity of the paper-and-pencil version 478 adults, (e.g., correlations with other IQ and speed tests, and comparisons between gifted and average-ability participants.) Findings on the suitability of the mini-q for children and adolescents will be presented as well. One question that arose with respect to the material (where geometrical figures show human characteristics such as "preferring" or "refusing" other geometrical figures) was whether social abilities influence mini-q results substantially. Using an online version of the test, relationships with diverse measures of inter- and intrapersonal abilities will therefore be examined to further clarify what the mini-q measures.
The interplay of working memory, processing speed, and attention with intelligence in children University of Cyprus, Cyprus; spanoud@ucy.ac.cyspanoud@ucy.ac.cy
The distinction between fluid (gf) and crystallized (gc) intelligence is important because it helps us to explain how intellectual ability develops and interacts with fundamental cognitive processes like memory and attention. The present study examined the relations of fluid and crystallized intelligence with three cognitive processes, namely speed of processing, attention, and working memory (WM) in 158 7- to 18-year-old children and adolescents (mean age in years=12.68, SD=3.16). Multiple measures of each of these cognitive processes were obtained. Structural equation modeling was performed to investigate: i) the relations between intelligence and its main correlates, and ii) whether developmental changes in each of the above three cognitive processes lead directly to developmental increases in intelligence. The results suggested that only WM predicted fluid and crystallized intelligence when controlling for the other two cognitive processes. The data indicate that WM is the main cognitive function underlying fluid and crystallized intelligence in children and adolescents. Also, our findings suggested that age-related changes in WM pave the way for developmental changes in intelligence. The discussion focuses on the construct validity of tests for the measurement of gc, gf and working memory and the interpretation of WM as a predictive variable of intelligence in children and adolescents.
|
| 4:30pm - 6:00pm | PA21: Clinical Assessment 4 Session Chair: Sandra Beatrice Sebre |
| KOL-G-209 (Ⅲ) | |
|
|
Convergent validity of the Latvian versions of the Edinburgh Postnatal Depression Scale and Gotland Male Depression Scale University of Latvia, Latvia; sebre@lu.lvsebre@lu.lv
The Latvian translations of the Edinburgh Postnatal Depression Scale (EPDS; Cox et al., 1987) and the Gotland Male Depression Scale (GMDS; Zierau et al., 2002), which also includes anger as a symptom of masked depression, were used in a longitudinal study examining the bidirectional effects of perinatal depression of mothers and fathers in relation to perceived social support and their infants’ temperament. This presentation will focus upon the internal consistency and convergent validity of the Latvian versions of the two depression measures. The sample included women (n=258), who were recruited during the third trimester of pregnancy, and their partners (n=258), both of whom completed both depression questionnaires prior to and following the birth of their child, and also at three and six months postpartum. Results show good internal consistency and moderate to strong correlations between the two depression measures both for mothers and for fathers. Mothers reported higher rates of depression on both measures at all three points of measurement. Variations exist in regard to associations of the EPDS and the Distress and Depression subscales of the GMDS acccording to gender. Implications of these findings will be discussed.
Exploring the association between depression and neurasthenia in a population representative epidemiological study of Chinese adults in Guangzhou, China 1University of Macau, China; 2Johns Hopkins Bloomberg School of Public Health, USA; 3Sun Yat-sen University, China; 4Sun Yat-sen Center for Migrant Health Policy, China; 5Harvard Medical School, USA; kchang@umac.mokchang@umac.mo
Neurasthenia, a diagnosis less favored in Western psychiatric nosology, is more accepted in China due to an emphasis on physical manifestation of distress. The goal of this study is to explore the extent to which depression and neurasthenia represent the same or different underlying dimensions of psychiatric distress in China. 765 Chinese adults’ data were obtained using stratified random sampling utilizing spatial epidemiological methods with home based face-to-face interviews conducted in Guangzhou, China. The Patient Health Questionnaire (Authors: Spitzer R.L., Williams J.B. and Kroenke K.) and the Composite International Diagnostic Inventory measured depression and neurasthenia respectively. The prevalence of depression and neurasthenia was 5.3% and 15.4%. People with one disorder were nearly 6 times more likely to have the other disorder (OR=5.75, [CI=2.98,11.08], p<.001) and women were more likely to have comorbid depression and neurasthenia disorders. Poor health and poor sleep quality was reported across disorders, but those with depression reported poorest sleep. Seeking counseling was most frequent for those with neurasthenia (4.0%, compared to 0% with depression) and those with comorbid disorders (21%), (p<0.001). Participants reported low treatment seeking, with higher prevalence for neurasthenia relative to depression. Neurasthenia is a useful diagnostic category for exploring psychological distress among Chinese populations.
People recovered from bipolar disorder have higher resilience (measured with the Resilience to Bipolar Disorder (RBD) questionnaire) 1University of Deusto, Spain; 2Santiago Apostol Hospital, Spain; 3Lancaster University, England; a.echezarraga@deusto.esa.echezarraga@deusto.es
Resilience enables people to develop mental health in the face of adversity. The study aims to develop a new Bipolar Disorder (BD) specific resilience measure, to test its psychometric properties in BD sample, and to examine its relationships with mental-health-related variables in BD and general population samples. 113 participants diagnosed of BD (mean age = 45.48; SD = 10.65; 69 women, 44 men) completed the developed 41-item Resilience to Bipolar Disorder (RBD) questionnaire, obtaining satisfactory Cronbach α = .93, and correlating positively with the Resilience Scale-25 (RS-25) (r = .65, p < .001). The RBD correlated positively with quality of life, well-being and personal recovery, and negatively with functional impairment and symptoms. Additionally, when divided BD sample into “Active” and “Recovered” subsamples, recovered subsample showed higher scores in mental health indicators (higher quality of life, well-being, and personal recovery; and lower functional impairment and symptomatology) than both, general population sample and active subsample. Reliability and convergent validity was supported for the RBD questionnaire. Consistent with previous research, resilience is associated with recovery-related indicators, and recovered patients indicated higher scores in resilience and mental-health-related variables than people who have not gone through those difficulties, or have their disease yet activated.
Development and preliminary psychometric analysis of the measure to screen premenstrual dysphoric disorder in Pakistan 1University of Luzern, Switzerland; 2University of Karachi, Pakistan; 3Aga Khan University Hospital, Pakistan; Muhammad.Rizwan@unilu.chMuhammad.Rizwan@unilu.ch
According to DSM-V the premenstrual dysphoric disorder occurs in about 1.8% women without functional impairment and 1.3% with functional impairment. Premenstrual dysphoric disorder has been observed in females in the United States, Europe, India, and Asia. The primary objective of this study was to develop a measure to screen the premenstrual dysphoric disorder in a community sample of females from Pakistan. We have developed a 26 items questionnaire on the basis of symptoms mentioned in the diagnostic criteria of premenstrual dysphoric disorder in DSM-V. The measure was administered together with Depression Anxiety Stress Scale (DASS-21) on 286 female college students in Karachi, Pakistan. The age range of participants was 16-25 years. Analysis of results indicated that, the internal consistency of 26 items measures, as estimated by coefficient of Cronbach’s alpha is .87 and advocating good reliability of the measure. To analyze construct validity we calculated correlation coefficient of the measure with depression (r=.56), anxiety (r=.54) and stress (r=.54) subscales of DASS-21. Findings indicated adequate construct validity. The measure would be useful for researchers and clinicians to screen the DSM-V based premenstrual dysphoric disorder for Pakistani community females.
A psychometric investigation of the Georgian version of Cognitive Distortion Scale Tbilisi State University, Georgia; marikapanjikidze@gmail.commarikapanjikidze@gmail.com
The cognitive behavioral therapy refers to one of the most effective therapeutic approaches in which identifying and modifying cognitive distortions plays the central role, but measurements evaluating specific cognitive errors are still sparse. The present study investigates the psychometric properties of the Georgian version of Cognitive Distortion Scale (G-CDS) (Covin, Dozois, 2011). 500 individuals across two studies (M of age = 33.39, SD = 14.82) completed the CDS. The confirmatory factory analyses showed the best model fit with nine factors solutions compare with the one or two factors solutions. Examining the relations of G-CDS with the primary psychiatric symptom dimensions (The Hopkins Symptom Checklist, HSCL-90) showed the coherent correlations. A multivariate analysis of variance revealed a significant main effect for group with high indices on global psychiatric severity index scoring significantly higher on most of the cognitive errors than the group of individuals with low severity indices. The Georgian version of the Cognitive Distortion Scale because of respectable clinical and research potential may certainly be used for practical as well as for research purposes.
|
| 4:30pm - 6:00pm | PA22: Subjective Well-Being Session Chair: Marco Weber |
| KOL-G-221 (Ⅴ) | |
|
|
Assessment of young people’s satisfaction in five different life domains: Adaptation and initial validation of the German version of the Multidimensional Students’ Life Satisfaction Scale University of Kassel, Germany; marco.weber@uni-kassel.demarco.weber@uni-kassel.de
The Multidimensional Students’ Life Satisfaction Scale (MSLSS; Huebner, 1994) is a self-report inventory assessing young people’s satisfaction in five different life domains (i.e., satisfaction with family life, friendships, school experiences, self, and living environment). The present paper describes the adaptation (incl. the translation-back translation procedure), and initial validation of the German adaptation of this measure. About 400 participants (aged between 10 and 17 years) completed the German version of the MSLSS, and additional measures/items assessing information on different validation criteria (e.g., family climate, number of best friends, school experiences, living location, etc.). The five scales yielded satisfying reliabilities, and they showed small to medium age effects and small gender effects. Results on validity emerged as promising; for example, an oblique five-factor solution was found to represent the data well. Furthermore, a supporting and warm parenting style contributed mostly to participants’ satisfaction with the family life, and the location where the participants lived (e.g., urban vs. rural areas) was predictive of participants’ satisfaction with the living environment. Overall, the MSLSS demonstrated satisfying psychometric properties and promising initial evidence for its validity. Future studies are needed to provide further information on reliability and validity of the German version of the MSLSS.
Rasch analysis of the Satisfaction with Life Scale: Findings from South Africa and Italy 1North-West University, South Africa; 2University of Milano, Italy; lusilda.schutte@nwu.ac.zalusilda.schutte@nwu.ac.za
The widely used Satisfaction with Life Scale (Diener et al., 1985) measures respondents’ subjective global satisfaction with their lives on a cognitive-judgemental level and consists of five 7-point Likert-type items, with anchor labels ranging from 1 (strongly disagree) to 7 (strongly agree). The sample (n=1192; South Africa= 676, Italy= 516 ) contained participants who completed the English and Italian versions of the scale, respectively. The data were analysed with Winsteps 3.81 and RUMM2030 using the Rasch rating scale model. Although the category thresholds were increasing monotonically, category 1 showed misfit to the Rasch model and the categories indicative of lower levels of satisfaction with life were the most likely to be endorsed on small regions of the latent trait. The effect of collapsing categories was explored. Item 5 (“If I could live my life over, I would change almost nothing”) did not fit the Rasch model well. Differential item functioning was detected for age group for some collapsed category combinations, but none for country, gender or education level. Theoretical implications for understanding satisfaction with life and recommendations for future use of the scale are suggested.
The incremental validity of low-arousal affect in predicting well-being 1University of Rijeka, Croatia; 2Università degli Studi di Milano, Italy; 3North-West University, South Africa; ibrdar@ffri.hribrdar@ffri.hr
According to the hedonic perspective, happiness is defined as subjective well-being, which refers to cognitive and affective evaluations of one's life. The vast majority of researchers use PANAS scales to measure the affective component of subjective well-being. These scales were constructed to assess high-arousal affects. Whereas some cultures favour high-arousal positive states, others value low-arousal positive states. Similar differences have been found between younger and older people. The aim of the present study is to examine the incremental validity of low-arousal affects in predicting well-being. 642 participants (mean age 44.3) from three countries completed the PANAS with additional eight low-arousal items, the Satisfaction with Life Scale, the Basic Psychological Needs Scale (the shortened nine-item version) and the Depression scale (DASS). The results from hierarchical multiple regression analyses show that low-arousal affect explain an additional 11% of the variance in life satisfaction and depression, and 6% in basic psychological needs over and above what could be predicted by PANAS. These findings indicate the importance of including low-arousal affect in assessing affective well-being.
Assessing happiness with the Authentic Happiness Inventory: Evaluation of its psychometric properties, initial validation, and its use in intervention studies University of Zurich, Switzerland; s.wellenzohn@psychologie.uzh.chs.wellenzohn@psychologie.uzh.ch
The Authentic Happiness Inventory (AHI; Seligman et al., 2005) is a widely used instrument for the assessment of happiness. It was developed especially for the use in intervention studies, and is supposed to be particularly sensitive for detecting subtle changes in happiness and differentiating among high expressions of happiness. However, these assumptions have not been tested in detail so far. We examined the psychometric properties of the German version of the AHI, and compared its usefulness in intervention studies to the well-established Satisfaction with Life Scale (SWLS; Diener et al., 1985) in three studies. Data from three samples (n = 3,789/259/184) show factorial validity and high internal consistency. In a sample of 319 adults, we find high test-retest correlations (e.g., r = .75 for six months). Further data show that the AHI is sensitive to detect changes in well-being over six months in a placebo-controlled intervention study (using two well-established positive psychology interventions; sample sizes across the three groups vary between 127 and 137. Overall, the findings are encouraging and provide support for the notion that the AHI is a useful self-report instrument for the assessment of happiness.
|
| 6:30pm - 10:00pm | Conference Dinner |
Hide Presentations
Table View
