Original Photo adapted from Hansueli Kramer / CC BY
Original Photo adapted from Hansueli Kramer / CC BY
|
|
Session Overview |
|
| |
| 9:00am - 12:30pm | W2: Introduction to Item Response Theory with R Organizer: Matthew Zeigenfuse (University of Zurich, Switzerland) |
| KOL-G-209 (Ⅲ) | |
| 1:00pm - 4:30pm | W4: Introduction to Modern Multitrait Multimethod Analysis - How to Examine the Convergent and Discriminant Validity of Psychological Measures Organizer: Fridtjof W. Nußbeck (University of Bielefeld, Germany) |
| KOL-G-209 (Ⅲ) | |
|
| |
| 9:45am - 11:15am | PA2: Organizational Assessment 1 Session Chair: Bengt Jansson |
| KOL-G-209 (Ⅲ) | |
|
|
Prediction of job performance, based on leaders' ratings, with a personality test: A correlational approach University of Gothenburg, Sweden; psybenja@gmail.compsybenja@gmail.com
Predictive criterion validity was examined in this study based on leaders' ratings of job performance. Employees were recruited with the personality test JobmatchTalent (JMT). A number of 258 recruited individuals was included in the analysis, and the ratings were performed by 95 leaders. The ratings were based on three dimensions (criteria): (1) productivity and motivation, (2) quality and structure of performed work, and (3) interpersonal skills. Nine main scales of JMT were used as predictors of the criteria (i.e. Work Structure, Personnel Drive, Decision characteristics, Activity, Drive, Acting, Tolerance, Social interest, and Communication). The predictive validity was based on pairwise correlations between criteria and predictors. By use of conceptual similarity, the 27 possible correlations were categorized as convergent (expected) or divergent (non-expected). A clear support was found for the assumed relationships. The average convergent correlation was .37 (N = 258). For a subgroup of recruited managers (n = 120), the corresponding value was .46. Convergent values differed significantly from divergent values. The predictive validity of the JMT was rated as good. The values found were compared to an extensive international meta-analysis, in which a correlation of just less than .40 was considered to be a very high value.
Predicting job performance of financial representatives based on Harrison Assessment Talent Management System (HATS) Blurton Family Development Center, China; kcraigen@blurton-fdc.comkcraigen@blurton-fdc.com
The goal of this research was to empirically evaluate the predictive utility of Harrison Assessment Talent Management System (HATS) for use as a selection instrument within organizational settings. This was done by investigating the strength of the relationship between the job fit percentages generated by HATS, and the performance ratings (i.e., number of life insurance policies sold within the first 6 months of employment) of 238 employees (201 men and 37 women) working for a large American insurance company. The resulting correlation between HATS prediction scores and performance ratings yielded significant findings, r (236) = .599, p> .0001, indicating HATS is a useful instrument for predicting employee performance. Further ancillary analysis revealed 7 of the 156 predictor variables significantly correlated with performance ratings. As such, it is highly probable that many traits measured in the workplace (and by HATS) are best conceptualized as sharing a curvilinear relationship with performance. Moreover, the strength of the correlation coefficient between employee performance ratings and HATS prediction scores, in addition to its innovative methodology makes it a strong and rather unique instrument among the psychological tests currently available for use in organizational settings.
Predictive validity of an asynchronous video interview assessing leadership competences in a real teamwork situation University of Salzburg, Austria; anne-kathrin.schock@sbg.ac.atanne-kathrin.schock@sbg.ac.at
Interviews are the most commonly used assessment tool in personnel selection. Nevertheless their application often lacks procedural standards and systematic scoring, which in turn can reduce fairness, comparability, and transparency. We sought to investigate the predictive validity of a new and promising tool in regard to standardisation: asynchronous video interviewing. Asynchronicity implies that candidates and interviewers do not need to be present at the same place and time, as recording and scoring form independent steps. To validate an interview for the assessment of leadership competences, a sample of 120 students completed the interview and held presentations in teams of 10 persons. Afterwards, students were asked to name and rank the team members according to their leadership potential during teamwork. First analyses of the interview revealed that the number of practical competences relevant to leadership success in small newly formed groups specified by participants was significantly associated with the frequency of assigned leadership. Further results regarding the interviews’ predictive validity will be discussed.
Measurement invariance and differential item functioning investigation of FVAT-S across gender and age groups in Turkish sample Assessment Systems; erens@assessment.com.trerens@assessment.com.tr
The main purpose of the study was to investigate the measurement invariance of FVAT-S (FVAT-Short Form) across gender and age groups. FVAT-S is an ability test, which is widely-used in employee election procedures in Turkey. The sample that was used consisted of 2464 applicants (1273 females and 1191 males). The measurement invariance test was performed with Multiple Group Confirmatory Factor Analysis (MG-CFA). To decide the invariance, the change in the Comparative Fit Index (ΔCFI) was considered and additionally RMSEA, SRMR, and TLI were reviewed. At the first stage, FVAT-S showed configural and metric invariance across gender groups and then, partial scalar invariance was attained with the modifications. In terms of age groups (aged between 20-25 and 26-32), FVAT-S showed, and metric, and scalar invariance. Items which disrupting the scalar invariance across gender groups were tested against Differential Item Functioning. All items which decrease the invariance included gender-based DIF. These results showed that FVAT-S is a useful tool to compare age groups; however amounts of error may be changed between age groups. The DIF-included items in FVAT-S are needed to be reviewed to achieve full scalar invariance in gender groups.
Test order effects in high stakes assessment: An experiment using objective personality tests and cognitive ability tests in personnel selection 1Schuhfried GmbH, Austria; 2University of Vienna, Austria; 3Educational Testing Service, USA; schuenemann@schuhfried.atschuenemann@schuhfried.at
For various reasons, varying test orders within test batteries is a common practice. Different test orders are used for organizational reasons, to avoid cheating, or to prevent a decrease in motivation if test-takers realize that others are performing faster. However, this practice is not well explored or proven to be without consequences for test results and therefore might decrease fairness and comparability in assessment processes. An experiment is presented that aims to extend a study from Khorramdel and Frebort (2011) by examining the influence of test order effects in personnel selection. The data comes from 70 applicants for a management trainee program of an Austrian railway company who had to take part in a computerized assessment of their professional potential as part of the selection process. Objective personality tests and cognitive ability tests were administered within a computer test battery and the administration order was systematically varied. The results are compared to the findings of Khorramdel and Frebort (2011) and are discussed with respect to subjects’ differences in cognitive ability and educational level, achievement motivation, and resilience.
|
| 11:45am - 1:15pm | PA6: Assessment in Children and Adolescents Session Chair: David Gallardo-Pujol |
| KOL-G-209 (Ⅲ) | |
|
|
Using formative tools: The validation of the Juvenile Victimization Questionnaire Universitat de Barcelona, Spain; david.gallardo@ub.edudavid.gallardo@ub.edu
The assessment of children and youth exposure to violence requires comprehensive instruments able to measure negative experiences in order to identify polyvictimization and understand its outcomes. The Juvenile Victimization Questionnaire (JVQ; Finkelhor, Hamby, Ormrod, & Turner, 2005) is a comprehensive assessment tool including five general areas of child and adolescent victimization, in its original version. The JVQ is a formative instrument, where the score of the module is just the sum or the count of the events of each type in its items. Formative instruments need a different validation methodology in comparison with reflective instruments. The purpose of this study is to present a validation of the JVQ. We collected a sample of 1105 adolescents (ranging from 12 to 17 years, mean age was 14.52); of those 590 were male, and 515 were female. We conducted a Principal Component Analysis in order to explore how items cluster together. Different solutions were explored, but one-component and nine-components solutions appear to be more in accordance with victimological theory, explaining between 9% and 39% of variance respectively. These aggregations of items are radically different to those suggested by Finkelhor et al. (2005). Either solution may shed light to explanatory processes in victimization and its relationships with later psychopathology.
Explorations in prescholers resilience measurements Tel Aviv University, Israel; mosheil1@post.tau.ac.ilmosheil1@post.tau.ac.il
There is a growing awareness that is focused on resilience interventions among preschoolers. However, assessment of preschoolers' resilience, a mandatory step in developing and evaluation the utility of such programs, is complicated. This is due to the common use of either the parents or the kindergarten teaches as source of assessment, rather than direct measurement of the preschooler themselves. The proposed presentation will report on the development and implementation of two ways to directly assess preschooler resilience. One way is related to picture completion while the other way is related to semi-active story listening. These tools were administered and evaluated twice: one group consisted of 135 preschoolers, ages 4-5, 69% Arabs and 31% Jews, 70 boys and 65 girls, and their parents and kindergarten teachers. The second group consisted of 253 preschoolers, learning in four Jewish and four Arabs kindergartens; and their parents and teachers. Results of measurements conducted among preschoolers (Jews and Arabs) and its relationships to measurement conducted among their parents and teachers will be presented. The study findings support the notion that such a direct assessment of preschoolers' resilience is possible. Implications for personality assessment, program development and projects' evaluation will be discussed.
Investigation of a structural model between desirable parental attitudes, adolescents’ self-esteem, vocational identity, and self-regulated learning Korea University, South Korea; redredlee@naver.comredredlee@naver.com
The objective of study is to verify the relationship between parental attitudes and self-regulated learning deeply through the structural model set self-esteem and vocational identity as mediation variables. The first and third wave of panel data from Korean Children and Youth Panel Survey (KCYPS) 2010 was used to find the relationship, and variables were Perceived Parental Attitudes by adolescents (Huh, 1999), Self-regulated Learning (Yang, 2000), Self-esteem (Rosenberg, 1965), and Vocational Identity (Holland, 1980). Participants were 2,259 students (1140 Males, 1119 Females) in 7th grade in 2010. Normal distribution of the data were proved by estimates of skewness and kurtosis. Model fits of the research model were satisfied. Parental attitudes have a positive impact on self-regulated learning through self-esteem and career-identity, so mediation effects on both related variables have verified. The result of the difference test between mediation effects which mediate self-esteem and vocational identity was not significant. That is, mediation effects of both were similar for the impacts of parental attitudes on self-regulated learning. The relationship between parental attitudes and self-regulated learning, double mediation effect was significant with self-esteem and vocational identity. The implication of this study is to present necessary grounds for school policy settlements by identifying impacts on self-regulated learning in adolescents.
Measuring multidimensional parental self-efficacy of mothers and fathers of children aged 1.5 and 3 years University of Turku, Finland; niina.junttila@utu.finiina.junttila@utu.fi
Mothers' and fathers' parental self-efficacy (PSE) develops during the first years of parenthood. Later PSE has an important role in linking distinct parental, child, and situational factors. Cross-sectional links between parents' loneliness, depression, and PSE has been found, yet no longitudinal research on the early mechanisms of PSE exists.The first aim of this study was to validate a measurement scale (based on Parenting Tasks Index by Coleman & Karraker 2003) in order to evaluate Finnish mothers' (n=765) and fathers' (n=668) PSE. Second, we aimed to study whether parents' psychosocial ill-being (social/emotional loneliness, social phobia, and depression) and marital satisfaction during pregnancy and/or during toddlerhood predicts their PSE at child aged 1,5-years. Analyses were conducted using structural equation modeling. Based on validity analyses a five-factor model (Presence, Emotional support, Routines, Playing, and Teaching) of mothers' and fathers' PSE was confirmed. Evaluating psychosocial factors as a predictors for the PSE factors, we found that parents' ill-being predicted several factors of their PSE. That is, parents' psychosocial ill-being during pregnancy and toddlerhood predicted lower levels of their PSE factors at child aged 1,5- and 3 years. Overall, 25 to 34 percent of PSE was explained by prior (22/18 months) psychosocial ill-being.
Skin conductance and sinus arrhythmia as a complement of psychological assessments during parent-infant interactions 1Universidade Europeia | Laureate International Universities, Portugal; 2Universidade de Trás-os-Montes e Alto Douro, Portugal; catarinatojalrebelo@gmail.comcatarinatojalrebelo@gmail.com
The impact of the quality of early interactions on infant developmental outcomes is well reported in the literature. It is well established that parental behaviors, such as sensitivity and responsivity, are crucial for the quality of the interaction. Understanding the physiological mechanisms beneath adequate/inadequate parental behaviors during these interactions may be crucial for psychological assessment and early intervention. We intend to examine the underlying physiological mechanisms associated with the quality of parental behaviors during dyadic interaction at 6 weeks and 6 months of age. A sample of 37 parents and infants participated in this study. Parental skin conductance (SC) and respiratory sinus arrhythmia (RSA) were monitored during a face-to-face (FTF) still-face (ST) procedure (FTF1 - SF – FTF2). Interactions were recorded according to the Global Rating Scales9 protocol. During FTF1, parental non-intrusive behavior is associated with lower RSA (r=-.433, p=.039). Parental non-remote behavior is associated with higher SC during the SF episode (r=.364, p=.048). Lower excited engagement is associated with higher SC (r=-.367, p=.046) during FTF2. The physiological reactions during early interaction may be an important complementary tool for the psychological assessment of parental behaviors.
|
| 4:30pm - 6:00pm | PA9: Humor and Playfulness Session Chair: René Proyer |
| KOL-G-209 (Ⅲ) | |
|
|
Assessing four facets of adult playfulness: The OLIW University of Zurich, Switzerland; r.proyer@psychologie.uzh.chr.proyer@psychologie.uzh.ch
Based on a series of studies a new facet model of adult playfulness has been derived; it is argued that playfulness consists of (a) an other-directed; (b) a lighthearted; (c) an intellectual; and (d) a whimsical component (OLIW). The proposed structure was supported in exploratory and confirmatory factor analyses using several samples between n= 238 and n= 814. Correlations with other playfulness instruments and measures of broader personality traits were in the expected direction. Self- and peer-ratings of homologous scales were in the expected range (all ≥ .35; n = 120, ongoing data collection). The four scales were also positively related with averaged ratings of daily playful activities (over 14 days) of 364 adults; coefficients were between .33 and .35. Overall, the data are encouraging and may break the ground for a stronger consideration of research in playfulness as a personality trait in adults.
Do others know my sense of humor? The self-peer convergence of comic and humor styles University of Zurich, Switzerland; s.heintz@psychologie.uzh.chs.heintz@psychologie.uzh.ch
Besides aiming to measure a general “sense of humor”, specific tests have been developed to measure eight comic styles (sensu Schmidt-Hidding) and four humor styles (representing everyday functions of humor). The former comprises the eight comic styles of fun, humor, nonsense, wit, irony, satire, sarcasm, and cynicism. The latter measures two presumably adaptive humor styles (affiliative and self-enhancing) and two presumably maladaptive ones (aggressive and self-defeating). The present study investigates the self-peer convergence of these 12 styles in multitrait-multimethod analyses (i.e., 12 traits × 2 methods), employing one to two peer raters per participant. The findings revealed a good convergent validity for all comic and humor styles, except for the self-defeating humor style (< .30). Discriminant validity was high with two exceptions: Self-reported satire and sarcasm were also strongly related to peer-rated cynicism. Thus, the self-defeating humor style did show a low self-peer convergence, and the peers could hardly distinguish between the three rather criticizing comic styles of satire, sarcasm, and cynicism. Implications of these findings will be discussed.
Psychometric properties of the Slovak version of BENCOR (preliminary findings) 1Catholic University Ruzomberok, Slovakia; 2University of Zurich, Switzerland; robert.durka@ku.skrobert.durka@ku.sk
The BENCOR (Ruch, 2012) is a 12-item self-report instrument for measuring benevolent and corrective humor. Benevolent humor describes a humorous outlook on life that entails the realistic observations of human weaknesses (and the imperfection of the world), but also their benevolent and forgiving humorous treatment. In contrast, corrective humor involves moral based ridicule; i.e., the use of mockery to fight badness and mediocrity. The English version of the scale was translated to Slovak language according to standard procedures including an independent back translation. Altogether 194 Slovak university students filled out a paper-and-pencil version of the questionnaire. Principal component analysis with direct oblimin rotation identified two factors that explained 45.84 % of the variance. The benevolent humor items had loadings ranging between .46 and .73, the corrective humor items had loadings ranging between .52 and .78 on the defining factors. The two scale were internally consistent (Cronbach`s α = .70/.77). Two items has somewhat lower item total correlations and were reworded. The scale with the refined items was administered to another sample of university students together with some validation criteria. The results and further applications will be discussed.
Personality characteristics of witty students: Histrionic self-presentation style and (active) katagelasticism 1Ss. Cyril and Methodius University, Macedonia; 2Universität der Bundeswehr München, Germany; filip.sulejmanov@gmail.comfilip.sulejmanov@gmail.com
The objectives of this study were three fold. First, evaluation of the psychometric properties of the Macedonian version of the As-If-Scale (Renner et. al., 2008), next, comparison of the self-assessed wittiness with the ratings of peers, and finally, prediction of peer-rated wittiness by histrionic self- presentation style and (active) katagelasticism (Renner & Heydasch 2010, Ruch & Proyer 2009). MAP test and the parallel analysis led to an estimate of 1 component to retain for the Macedonian version of the As-If-Scale (103 participants; M = 18.51 years, SD = 1.01; 67 female, 36 male). To address the remaining objectives, a sample of 83 subjects (M = 17.70 years, SD = .49; 30 male, 53 female) from a high school in Macedonia was used. Students in each class rated all other students from their class how witty they are on a 4-point scale. There was only low positive correlation between self-assessed wittiness and peer-ratings of wittiness (r = .25, p < .05). Two hierarchical regression analyses revealed that gender (male), low (active) katagelasticism, and high histrionic self-presentation were all predictors of peer-rated wittiness scores. The discussion is mainly focused on the strengths and weaknesses of different methodologies used to assess who is humorous in the classroom.
|
|
| |
| 9:45am - 11:15am | PA12: Clinical Assessment 3 Session Chair: Murray Dyck |
| KOL-G-209 (Ⅲ) | |
|
|
A JND Task for assessing cross-modal sensory integration ability Griffith University, Australia; m.dyck@griffith.edu.aum.dyck@griffith.edu.au
The ability to integrate information from different sensory systems is one of several integrative functions that is impaired in autism and some other disorders. However, given the very large differences between and within individuals in sensory perception and processing abilities, constructing a metric that is reliable and valid across a broad range of abilities and sensory systems is challenging. A task has been constructed that uses the just noticeable difference procedure to standardise the difficulty of perceptual discriminations within sensory modalities as the baseline for assessing the ability to make judgments of proportional differences between stimuli that make demands on different sensory processes. In initial studies, JNDs are determined for participants’ ability to discriminate changes in the size of a circle and the luminance of a circle. Subsequently, participants indicate whether the difference in the sizes of two circles (in JND units) is proportionate to the difference in the luminances of two circles (also in JND units). Within trials, participants indicate whether stimuli are the same (size/luminance/proportions) or different. Results of two small studies (n=30, n=30) assessing relationships with other measures of sensory integration ability and with intelligence are reported.
Assessing post-traumatic growth of Hong Kong Chinese patients with chronic illnesses City University of Hong Kong, Hong Kong; sshkc@cityu.edu.hksshkc@cityu.edu.hk
The study aims to examine the psychometric properties of the Chinese Post-traumatic Growth Inventory (C-PTGI). A sample of 368 chronic patients in Hong Kong was invited to complete a questionnaire which consisted of four measurement scales, C-PTGI, HADS, ATH, and Brief COPE. Similar to other findings on Hong Kong and Taiwan Chinese (Ho et al., 2004; 2013), the subscales and total scale of C-PTGI showed acceptable internal consistency reliability (Cronbach’s alpha ranging from .66 to .85), but the original five factors proposed by Tedeschi and Calhoun (1996) did not show adequate fit as indicated by various goodness-of-fit indices provided by LISREL 9.1. Therefore, competing models were specified. From the results obtained, Post Tramatic GrowthPTG can be understood as a four factor construct (Self, Spiritual, Life Orientation, and Interpersonal) in which a higher order factor (Interpersonal) is posited above the Self, Spiritual, and Life Orientation factors. The nomological network of C-PTGI was examined by analyzing its relationship with other relevant constructs (i.e. hope, coping, anxiety, depression). To summarize, the C-PTGI correlates positively with the HOPE and COPE scales but negatively with HADS. This pattern of inter-factor correlations rendered good support to the construct validity of C-PTGI for Chinese patients with chronic illnesses.
The Indonesian version of Personality Inventory for DSM-5 (PID-5): A psychometric evaluation ATMA JAYA Catholic University of Indonesia, Indonesia; magdalena.halim@atmajaya.ac.idmagdalena.halim@atmajaya.ac.id
The Personality Inventory for DSM-5 (PID-5) was initially developed to measure pathological personality trait based on dimensional model of personality disorder as proposed for DSM-5. The current study aims to adapt and validate PID-5 for use in Indonesia. The original version of PID-5 was translated in Indonesian Language following the standard of test adaptation from the International Test Commission. The sample of this study consisted of participants with ages ranging 28 to 27 years old (n= 233, 147 females, 84 males). We used Pearson product-moment correlation, Cronbach’s alpha coefficient, exploratory and also confirmatory factor analysis whie analysing data. Result showed good reliability for all domains of Indonesian PID-5. Cronbach's α coefficients ranged from .81 - .94. Next, we found negative significant correlations between some domains of PID-5 and NEO PI-R, such as Detachment and Extroversion; Disinhibition and Conscientiousness. Based on the result of EFA and CFA, the findings of this study confirmed the five factor structure as shown on the original version, although some facets were loaded on different domains compared to the original one. In summary, the Indonesian version of PID-5 is a valid and reliable test that could be used in Indonesia population.
Clinical validation of 7-item version of NIMHANS Psychiatric Morbidity Scale National Institute Of Mental Health and Neuro Sciences, India; pmahindru86@gmail.compmahindru86@gmail.com
Screening for psychiatric morbidity helps to identify disease, enable initiation of treatment, and intervene to reduce mortality and suffering from psychological problems. There are a vast amount of screening tools, as it is common in India to screen for psychological distress among the normal and the clinical population. The present scale aims to validate the shorter version of NIMHANS psychiatric morbidity scale to screen out the psychiatric conditions among normal Indian population. The present study is a part of ongoing work to develop a tool for the assessing of psychiatric distress in the normal population. The developed scale has a sensitivity and specificity of .78 and .82 respectively. The test retest reliability of .84. It has a cut off score of 3 and above as an indicator of presence of psychological distress. Its clinical validation was carried out on a sample of 100 clinical subjects. Its construct validity was assessed using General Health Questionnaire (GHQ-5). Clinical validation of tool revealed psychometric properties to screen out psychiatric conditions in a clinical group. It has implication for its use in the Indian community and mental health settings.
MMPI-2 restructured clinical scales in diagnosis and psychotherapy treatment monitoring Jagiellonian University Medical College, Poland; katarzyna.cyranka@interia.plkatarzyna.cyranka@interia.pl
This study is an analysis of group psychotherapy influence on personality functioning of patients treated for neurotic disorders and selected personality disorders (F40-F61 according to ICD-10). The study included 82 patients (61 women and 21 men) who underwent intensive short-term group psychotherapy in a day hospital. A comprehensive assessment of the patients’ personality functioning was carried out at the outset and the end of the psychotherapy utilising the MMPI-2 questionnaire (Restructured Clinical Scales). The analysis of the restructured scales revealed that the the measure most prominently elevated at the beginning of treatment and at the same time undergoing the most intensive positive change in the course of treatment was in the majority of patients the Restructured Clinical Scale Demoralization (Rcd). It was followed by the Restructured Clinical Scale Rc7 (Dysfunctional Negative Emotions), Restructured Clinical Scale Rc2 (Low Positive Emotions) and Restructured Clinical Scale Rc1 (Somatic Complaints). The results have been statistically compared to the results obtained in the basic nine Clinical Scales. The obtained data supports that the Rcd Clinical Scale Demoralisation can be significantly useful in diagnostic process and psychotherapy treatment monitoring.
|
| 11:45am - 1:15pm | PA16: Applied Settings Session Chair: Sonja Krupp |
| KOL-G-209 (Ⅲ) | |
|
|
Fine motor skills and cognition - A dual task approach in assessment using the 20 Cents Test 1Forschungsgruppe Geriatrie Lübeck, Germany; 2Krankenhaus Rotes Kreuz Lübeck Geriatriezentrum, Germany; 3Universitätsklinikum Carl Gustav Carus Dresden, Germany; krupp@geriatrie-luebeck.dekrupp@geriatrie-luebeck.de Performing cognitive tasks during walking unmasks developing dementia by increasing gait variability, however, the analysis requires costly equipment. Fine motor activities are represented by larger brain areas than leg movement. This might open the way for broad use of dual tasking as psychological diagnostic tool. In 2012 we validated the 20 Cents Test as an instrument to asses fine motor function. Ergotherapists examined 205 patients (age 60-96, a third of who were cognitively declined) concerning their fine motor skills. Blinded physiotherapists measured the time needed to pick up 20 one-cent coins (European and US currency) and transport them into a box. 189 patients repeated the test with the same and another therapist. We found good validity (AUC>0.8), intra- and interrater reliability (ICC>0.9). Thus we defined standard values that we plan to use to establish a dual task procedure with a subtest of verbal fluency from the CERAD battery. The effect of simultaneous cognitive testing on the result of the 20 Cents Test will be analyzed in correlation to the presence of cognitive impairment. The data we will present could introduce it as a suitable partner for dual tasking to detect early stages of cognitive decline. The Functional Loewenstein Occupational Therapy Cognitive Assessment (FLOTCA) for integrative cognitive functional skills 1Ono Academic College, Israel; 2Lowenstein Rehabilitation Hospital, Israel; sagiv.aliza@gmail.comsagiv.aliza@gmail.com
During the past decade, the focus of rehabilitation medicine has shifted to occupational performance and participation in different life roles. The Functional Loewenstein Occupational Therapy Cognitive Assessment (FLOTCA) was developed to assess integrative higher cognitive abilities, and it was validated on a Traumatic Brain Injury (TBI) population. The FLOTCA consists of 3 tasks: navigating on a map, organizing a tool box and planning a daily schedule. In this first study, participants included 25 TBI patients, ages 18-49 and a matched group of 25 healthy individuals. Both groups were assessed with the FIM/FAM a daily functional evaluation. The FLOTCA showed high inter rater reliability (ICC= .996), internal consistency reliability between the tasks and the total score was high (α = .82). Construct validity was supported for the total score (t(48) = -5.48, d=1.52) and the separate tasks. Moderate ecological validity with the FIM/FAM (r(19) = .44, p < .05) was obtained. Furthermore, severity of injury, Glasgow Coma Scale (GCS), and Length of Unconsciousness, were significantly correlated (r=-.69 p<.01) with the FLOTCA and stronger than the correlation with the demographic variables. The results support the use of the FLOTCA for assessing cognitive functional skills and serve as the basis for planning intervention.
Evaluation of pain in athletes and normally active subjects Trakia University, Bulgaria; petkovaa@hotmail.competkovaa@hotmail.com
Regular exercise clearly associate with higher pain tolerance, but pain thresholds are affected more ambiguously. In this conection the observation that pain perception is modifiable by physical activity provides promise for the use of non-invasive methods with few side effects for patients with chronic pain conditions.The aim of this study is to test factors such as personality and demographic factors that affect the relationship between physical activity and modifications in pain perception. Psychological Questionnaires: Body Awareness Questionnaire that asks subjects to rate, on a 4 point scale, the degree to which they were currently experiencing symptoms of sympathetic arousal, State Trait Anger Scale, and State Trait Anxiety Scale. Objective methods (cold pressure test) are used only to determine the pain sensation and pain tolerance thresholds. The VAS on the other hand, represents pain as a continuum and is sensitive to change. There was a significant interaction between self reported sympathetic arousal, sex, and anxiety depending on physical activity as well. The results of investigation support this complex, multi-element method for measuring pain as a useful model for studying effects of exercise on the perception of pain and there is reason to find that it might help in the understanding of mechanisms of pain generation.
Identifying Minimal Important Change (MIC) scores for the Tinnitus Functional Index (TFI) questionnaire for different populations 1University of Nottingham, UK; 2MRC Institute of Hearing Research Clinical Section, UK; msxklf@nottingham.ac.ukmsxklf@nottingham.ac.uk
Sensitively measuring changes in questionnaire scores is essential to identifying whether outcomes are valid and clinically meaningful in a given population. Minimal Important Change (MIC) scores facilitate this interpretation. For people with tinnitus, who often present with a number of co-morbid complaints, the recommended method of evaluating the effectiveness of treatments is to use a self-report questionnaire such as the Tinnitus Functional Index (TFI). The TFI is reported to provide a responsive measure of change in tinnitus severity; however, no valid MIC score exists. The present study aims to identify MIC scores relevant to clinical (patient) or research (participant) populations, using a combination of distribution-based and anchor-based methods. TFI questionnaire data was collected from 150 patients attending NHS audiology clinics and 95 participants who volunteered for a tinnitus research study. Analysis involves integrating Standard Error of Measurement (SEM), Effect size (ES), Reliable Change Index (RC) (Distribution-based) and the global improvement scores (clinical population). In the research population, an MIC score of 22.4 was identified based on the SEM of 8.1. In the clinical population with “no change” in tinnitus, an MIC score of 26.4 was identified (SEM = 9.5). Further analyses integrating these with ES and RC will be presented.
Measurement properties of the eight subscales in the Tinnitus Functional Index (TFI) questionnaire evaluated using Rasch analysis 1University of Nottingham, UK; 2MRC Institute of Hearing Research Clinical Section, UK; msxklf@nottingham.ac.ukmsxklf@nottingham.ac.uk
The eight subscales of the Tinnitus Functional Index questionnaire (TFI: 25-item) were designed for individual use to measure intrusiveness, sense of control (SoC), cognition, sleep, auditory, relaxation, quality of life (QOL: 4-item), and emotional aspects of the functional impact of tinnitus. We evaluated the measurement properties of these individual subscales using the Rasch measurement model. 540 people with tinnitus completed the TFI (255 tinnitus patients, 285 research volunteers). Data for the eight subscales were individually fitted to the Rasch measurement model (RUMM 2030). Subscales were assessed for model fit, unidimensionality, person-separation reliability (PSI), and differential item functioning. After removing one misfitting item (QOL22), all 8 subscales showed good fit with non-significant chi-squared values (p > 0.05). They were unidimensional with high PSI estimates ranging 0.77 to 0.92. Significant difference between populations was observed in four items (Intrusiveness3, SoC5, Relaxation8, QOL21), whilst only one item (Emotional25) showed significant gender differences. These items were split to adjust for these differences, improving model fit for each subscale. We conclude the individual subscales provide reliable individual measures of different aspects of the functional impact of tinnitus. Further analyses will assess the relationship between these subscales in testlets.
|
| 4:30pm - 6:00pm | PA21: Clinical Assessment 4 Session Chair: Sandra Beatrice Sebre |
| KOL-G-209 (Ⅲ) | |
|
|
Convergent validity of the Latvian versions of the Edinburgh Postnatal Depression Scale and Gotland Male Depression Scale University of Latvia, Latvia; sebre@lu.lvsebre@lu.lv
The Latvian translations of the Edinburgh Postnatal Depression Scale (EPDS; Cox et al., 1987) and the Gotland Male Depression Scale (GMDS; Zierau et al., 2002), which also includes anger as a symptom of masked depression, were used in a longitudinal study examining the bidirectional effects of perinatal depression of mothers and fathers in relation to perceived social support and their infants’ temperament. This presentation will focus upon the internal consistency and convergent validity of the Latvian versions of the two depression measures. The sample included women (n=258), who were recruited during the third trimester of pregnancy, and their partners (n=258), both of whom completed both depression questionnaires prior to and following the birth of their child, and also at three and six months postpartum. Results show good internal consistency and moderate to strong correlations between the two depression measures both for mothers and for fathers. Mothers reported higher rates of depression on both measures at all three points of measurement. Variations exist in regard to associations of the EPDS and the Distress and Depression subscales of the GMDS acccording to gender. Implications of these findings will be discussed.
Exploring the association between depression and neurasthenia in a population representative epidemiological study of Chinese adults in Guangzhou, China 1University of Macau, China; 2Johns Hopkins Bloomberg School of Public Health, USA; 3Sun Yat-sen University, China; 4Sun Yat-sen Center for Migrant Health Policy, China; 5Harvard Medical School, USA; kchang@umac.mokchang@umac.mo
Neurasthenia, a diagnosis less favored in Western psychiatric nosology, is more accepted in China due to an emphasis on physical manifestation of distress. The goal of this study is to explore the extent to which depression and neurasthenia represent the same or different underlying dimensions of psychiatric distress in China. 765 Chinese adults’ data were obtained using stratified random sampling utilizing spatial epidemiological methods with home based face-to-face interviews conducted in Guangzhou, China. The Patient Health Questionnaire (Authors: Spitzer R.L., Williams J.B. and Kroenke K.) and the Composite International Diagnostic Inventory measured depression and neurasthenia respectively. The prevalence of depression and neurasthenia was 5.3% and 15.4%. People with one disorder were nearly 6 times more likely to have the other disorder (OR=5.75, [CI=2.98,11.08], p<.001) and women were more likely to have comorbid depression and neurasthenia disorders. Poor health and poor sleep quality was reported across disorders, but those with depression reported poorest sleep. Seeking counseling was most frequent for those with neurasthenia (4.0%, compared to 0% with depression) and those with comorbid disorders (21%), (p<0.001). Participants reported low treatment seeking, with higher prevalence for neurasthenia relative to depression. Neurasthenia is a useful diagnostic category for exploring psychological distress among Chinese populations.
People recovered from bipolar disorder have higher resilience (measured with the Resilience to Bipolar Disorder (RBD) questionnaire) 1University of Deusto, Spain; 2Santiago Apostol Hospital, Spain; 3Lancaster University, England; a.echezarraga@deusto.esa.echezarraga@deusto.es
Resilience enables people to develop mental health in the face of adversity. The study aims to develop a new Bipolar Disorder (BD) specific resilience measure, to test its psychometric properties in BD sample, and to examine its relationships with mental-health-related variables in BD and general population samples. 113 participants diagnosed of BD (mean age = 45.48; SD = 10.65; 69 women, 44 men) completed the developed 41-item Resilience to Bipolar Disorder (RBD) questionnaire, obtaining satisfactory Cronbach α = .93, and correlating positively with the Resilience Scale-25 (RS-25) (r = .65, p < .001). The RBD correlated positively with quality of life, well-being and personal recovery, and negatively with functional impairment and symptoms. Additionally, when divided BD sample into “Active” and “Recovered” subsamples, recovered subsample showed higher scores in mental health indicators (higher quality of life, well-being, and personal recovery; and lower functional impairment and symptomatology) than both, general population sample and active subsample. Reliability and convergent validity was supported for the RBD questionnaire. Consistent with previous research, resilience is associated with recovery-related indicators, and recovered patients indicated higher scores in resilience and mental-health-related variables than people who have not gone through those difficulties, or have their disease yet activated.
Development and preliminary psychometric analysis of the measure to screen premenstrual dysphoric disorder in Pakistan 1University of Luzern, Switzerland; 2University of Karachi, Pakistan; 3Aga Khan University Hospital, Pakistan; Muhammad.Rizwan@unilu.chMuhammad.Rizwan@unilu.ch
According to DSM-V the premenstrual dysphoric disorder occurs in about 1.8% women without functional impairment and 1.3% with functional impairment. Premenstrual dysphoric disorder has been observed in females in the United States, Europe, India, and Asia. The primary objective of this study was to develop a measure to screen the premenstrual dysphoric disorder in a community sample of females from Pakistan. We have developed a 26 items questionnaire on the basis of symptoms mentioned in the diagnostic criteria of premenstrual dysphoric disorder in DSM-V. The measure was administered together with Depression Anxiety Stress Scale (DASS-21) on 286 female college students in Karachi, Pakistan. The age range of participants was 16-25 years. Analysis of results indicated that, the internal consistency of 26 items measures, as estimated by coefficient of Cronbach’s alpha is .87 and advocating good reliability of the measure. To analyze construct validity we calculated correlation coefficient of the measure with depression (r=.56), anxiety (r=.54) and stress (r=.54) subscales of DASS-21. Findings indicated adequate construct validity. The measure would be useful for researchers and clinicians to screen the DSM-V based premenstrual dysphoric disorder for Pakistani community females.
A psychometric investigation of the Georgian version of Cognitive Distortion Scale Tbilisi State University, Georgia; marikapanjikidze@gmail.commarikapanjikidze@gmail.com
The cognitive behavioral therapy refers to one of the most effective therapeutic approaches in which identifying and modifying cognitive distortions plays the central role, but measurements evaluating specific cognitive errors are still sparse. The present study investigates the psychometric properties of the Georgian version of Cognitive Distortion Scale (G-CDS) (Covin, Dozois, 2011). 500 individuals across two studies (M of age = 33.39, SD = 14.82) completed the CDS. The confirmatory factory analyses showed the best model fit with nine factors solutions compare with the one or two factors solutions. Examining the relations of G-CDS with the primary psychiatric symptom dimensions (The Hopkins Symptom Checklist, HSCL-90) showed the coherent correlations. A multivariate analysis of variance revealed a significant main effect for group with high indices on global psychiatric severity index scoring significantly higher on most of the cognitive errors than the group of individuals with low severity indices. The Georgian version of the Cognitive Distortion Scale because of respectable clinical and research potential may certainly be used for practical as well as for research purposes.
|
|
| |
| 10:15am - 11:45am | PA25: Organizational and Counselling Settings Session Chair: Claudia Harzer |
| KOL-G-209 (Ⅲ) | |
|
|
Work and Meaning Inventory (WAMI): Progress report on the German adaptation of the WAMI University of Kassel, Germany; c.harzer@uni-kassel.dec.harzer@uni-kassel.de
The Work and Meaning Inventory (WAMI; Steger, Dik, & Duffy, 2012) is a 10-item self-rating questionnaire measuring meaning at work. Three subscales assess the degree to which work is perceived as being meaningful (positive meaning, PM), contributing to meaning in life (meaning making, MM), and serving others (greater good, GG). The German version was developed in a translation-back translation procedure. Initial data analysis (n = 252 adults) indicated satisfactory reliability and construct validity. However, inconsistencies in factor structure (i.e., PM and MM converged into one factor) required further investigation. In collaboration with Steger eight new items were included in order to improve the discrimination of PM and MM. Exploratory factor analysis of the 18 items utilizing data from a new sample (n = 367 adults) indicated a three-factor solution (i.e., Scree-test, parallel analysis). In order to develop a parsimonious measure, the best three to four items (main loadings > .45, cross-loadings < .20; full representation of intended content of scales) were selected. Fit indices in confirmatory factor analysis indicated a satisfactory fit. Currently, further data are being collected to examine replicability of the factorial structure, but also reliability and construct validity. Latest results on descriptive statistics, reliability, and validity will be presented and discussed.
Assessing the likelihood of Counterproductive Work Behaviour (CWB) - An organisational and international driven test design 1Central Test, France; 2NEC, UK; nigel@nigel-evans.comnigel@nigel-evans.com
Accurately measuring employee integrity, commonly referred to as Counterproductive Work Behaviour (CWB), is a growing concern for organizations. Case reviews and high profile media exposés show the pervasive damage companies experience worldwide as a result of employee CWB, as well as the lack of recognised overt assessments available. Globally, the measurement of obstructive work behaviours remains an underdeveloped area of testing, which contrasts to its demand. The paper outlines the development of an assessment aimed at measuring individuals’ likelihood of engaging in CWB. The design draws upon research suggesting that attitudes and subjective norms are strong predictors of intentions of engaging in CWB. As such, the assessment is designed to measure people’s attitudes and dispositions towards instances of CWBs to predict their likelihood of engaging in CWB. Six broad dimensions measured by the assessment were derived from an extensive organisational field survey conducted in three languages (English, French, and Spanish) with 109 companies from 35 different countries. The behavioural content was then referenced to ISO 26000, which details the internationally recognised standards for organisational social responsibility. Preliminary findings from statistical analyses will be discussed to show the test’s efficiency in predicting CWB as well as its international application.
Evaluation of a new instrument for assessing civic-economic competence in commercial apprenticeship 1University of Zurich, Switzerland; 2University of Konstanz, Germany; esther.kaufmann@ife.uzh.chesther.kaufmann@ife.uzh.ch
Civic-economical competence is defined as the ability to understand private, economical and economic-political problems, to judge suggested solutions for complex problems, and to develop solutions for less-complex problems. To date there has been no two-dimensional instrument for assessing civic economic competence in commercial apprenticeship developed; although based on theoretical reasons such an instrument is urgently needed for an international comparison. Additionally, there is a gender gap in economic competence, which needs to be checked for an international comparison. Hence, in our study we evaluate a newly developed two-dimensional online tool for the German-speaking commercial apprenticeship in Switzerland and Germany and check it for any gender gap. Based on our pilot studies (Germany: n = 260, Switzerland: n = 250), our developed and adapted online instrument is checked by a sample comprising 874 German commercial apprenticeship students. Our item-analysis (IRT, DIF), the modeling of the postulated two-dimension civic-economic competency and the gender gap check will be presented. The results show the usefulness of the instrument to assess civic-economical competence in commercial apprenticeship. Our presentation will also be focused on the methodological challenges faced while developing an online instrument, analyzing its psychometric properties and checking the gender gap.
Career Anchors Self-Assessment – In-depth analysis of a German version measuring 9 Career Anchors Zurich University of Applied Sciences, Switzerland; marc.schreiber@zhaw.chmarc.schreiber@zhaw.ch
The career anchors developed by Schein (1975; Schein & van Maanen, 2013) have been continuously refined, and consist of 3 components of the career-self-concept: self-perceived talent and abilities; self-perceived motives and needs; and self-perceived attitudes and values. Schein defines eight career anchors (i.e Technical/functional competence; General managerial competence; Autonomy/independence; Security/stability; Entrepreneurial creativity; Service/dedication to a cause; Pure challenge and Lifestyle) and posits that individuals’ career choices in the past and in the future are affected by the predominant career anchor of a person. In line with today’s call for qualitative and quantitative approaches in career counseling (e.g. Savickas, 2012) career anchors can and should be assessed by a questionnaire supplemented by a qualitative interview. Danziger, Rachman-Moore, and Valency (2008) recommend splitting Entrepreneurial creativity into Entrepreneurship and Creativity. Following this suggestion we will present results of a German version measuring 9 career anchors. In-depth analysis of the factor structure and the differential item functioning (DIF) were conducted with a online sample of 3000 persons. Practical implications for career counselling will be discussed. Practical implications will rely on the use of norm versus raw data and on the combination of qualitative and quantitative approaches in career counselling.
|
Hide Presentations
Table View
