Search results

The preponderance of studies that rely on self-report for both independent (e.g. stressors) and dependent (e.g. well-being) variables is often deplored, as it creates problems of common method variance, which may lead to inflated, or even spurious, correlations and predictions. It is sometimes suggested that alternative measures should yield more “objective” information on the phenomena under investigation. We discuss this issue with regard to: (a) observational measures of working conditions; (b) physiological measures of strain; and (c) event-based “self-observation” on a micro-level. We argue that these methods are not necessarily “objective.” Like self-report, they are influenced by a plethora of factors; and measurement artifacts can easily be produced. All this can make their interpretation quite difficult, and the conclusion that lack of convergence with self-report automatically invalidates self-report is not necessarily warranted. Especially with regard to physiological measures, one has to keep in mind that they refer to a different response level that follows its own laws and is only loosely coupled with psychological responses. Therefore, replacement is not a promising way to get more reliable estimates of stressor-strain relationships. We argue instead that each method contains both substantive and error variance, and that a combination of various methods seems more auspicious. After discussing advantages and pitfalls of observational, physiological, and self-observational measures, respectively, we report empirical examples from our own research on each of these methods, which are meant to illustrate both the advantages and the problems associated with them. They strengthen the overall conclusion that there is no “substitute” for self-report (which often is necessary to be able to interpret data from other methods, most notably physiological ones). They also illustrate that collecting such data is quite cumbersome, and that a number of conditions have to be carefully considered before using them, and we report some problems we encountered in this research. Altogether, we conclude that self-report measures, if carefully constructed, are better than their reputation, but that the optimal way is to complement them with other measures.

There has been a long-standing concern and controversy in the consumer behavior and related literature about the accuracy of consumers’ self-reports of their mental processes. While some researchers have found such reports to be susceptible to a number of inaccuracies, others have found them to be reasonably accurate. This study contributes to the debate by comparing consumers’ self-reports of their information acquisition processes in decision making with process-tracing measures of the same processes, and doing so within the context of research design recommendations suggested by Ericsson and Simon (1980, 1984, 1993) for collecting valid retrospective self-reports. Data for the study were collected in a decision-making experiment in which a custom-made computer software was used to administer two decision tasks and to unobtrusively measure subjects’ information acquisition patterns (process-tracing measures). Self-report measures were collected by means of a questionnaire administered after subjects completed both tasks. Descriptive discriminant analysis (with self-report measures as dependent and scores on process-tracing measures as independent variables) shows that subjects were able to accurately report their information acquisition patterns. For both decision tasks, the majority of subjects who were classified by the discriminant functions as using a particular information acquisition strategy actually reported using such a strategy. Implications of the findings are outlined and discussed.

This paper aims to assess predictive and convergent validity of a trait measure of conflict handling styles (DUTCH) with two alternative methods of measuring such styles: a vignette measure of behavioral choices (CB-Pref) and behavior in a role-played conflict. In addition, this paper investigates self-enhancement in responses to the two self-report measures.

In Studies 1 (N = 117), 2 (N = 116) and 4 (N = 68), participants completed the DUTCH and CB-Pref. In Study 3 (N = 56 dyads), participants completed the DUTCH and a role-played conflict. In Study 4, participants also responded to the measures as either a typical person or an ideal person would.

The DUTCH predicted four of five styles individuals chose across nine vignettes of the CB-Pref. In Study 4, the DUTCH predicted three of the five. In Study 3, only the DUTCH’s forcing style predicted actual behavior. In Study 4, participants rated themselves as more constructive and less destructive than typical, but less constructive than ideal. Participants in general were somewhat self-enhancing on both self-report measures, but individual differences in social desirability were generally unrelated to self-report responses.

This work takes a multi-method approach to assessing the validity of a self-report conflict style measure, allowing for the assessment of the measure’s predictive and convergent validity when predicting self-reported style tendencies to style selected in vignettes and behavior in a role-played conflict.

The longitudinal impact of media multitasking on the development of executive function has been understudied, as most of the existing studies are cross-sectional. This longitudinal study addresses this research gap and uses multiple measures, i.e. behavioral and self-reported, to explore the impact of media multitasking on the executive function of Chinese adolescents.

This study followed 99 Chinese adolescents (M_age = 14.41, SD = 1.10; 42 boys and 57 girls) for one year using both behavioral (2-back, Stroop Color and Number-letter tasks) and self-reported (questionnaire) measures. The adolescents were categorized as either heavy/high media multitaskers (HMMs; 19 boys and 29 girls) or light/low media multitaskers (LMMs; 23 boys and 28 girls). They were tested at baseline, 6 months later and 12 months later.

The results indicated that the accuracy scores for all cognitive tasks differed with age, but the switch-cost in the shifting task and the self-reported measures of executive function did not. And there were consistent differences between the HMMs and LMMs in the self-reported measures and 2-back accuracy. However, the interaction effect was found only in shifting ability, indicating a decline in the LMMs' self-reported problematic shifting behavior in daily life.

This study used behavioral and self-reported measures to confirm the longitudinal impact of media multitasking on executive function. The impact of media multitasking on executive function is more apparent in daily-life behavior than in cognitive task performance.

The purpose of this paper is to assess the feasibility and comparability of daily self‐report and objective measures of work performance in complex office tasks, and factors affecting the correlation between these measures.

Medical bill auditors provided daily information for 12 weeks through interactive voice response (IVR) on their speed, concentration and accuracy at work, compared to their best job performance.

The paper found that 124 of 142 recruited subjects (87 percent) completed > 50 percent of daily IVR reports. Concentration, speed and accuracy were highly inter‐correlated (R=0.75), and right‐skewed (mean speed=7.7, SD=1.5). Mean adjusted daily productivity rate (MAP) was 34 bills/hour (range 4.7 to 111, SD12.6, 61 percent within‐person variation). Subject‐specific speed – MAP correlation varied from R=−0.20 to +0.75 (mean, 0.28). Health status, years on job, age, IVR completion rate, site, month of study, or total hours worked were not associated with these variations.

This paper provides an unprecedented level of detail in the comparison of self‐reported and objective daily measures of work performance, demonstrates the feasibility of data collection and analysis, and identified significant inconsistencies among workers in the correlation between the two types of measures. Results demonstrated that daily self‐reports cannot be used as a direct surrogate for objective performance measures.

This article provides a review and conceptual comparison between self‐report and performance‐based measures of emotional intelligence. Analyses of reliability, psychometric properties, and various forms of validity lead to the conclusion that self‐report techniques measure a dispositional construct, that may have some predictive validity, but which is highly correlated with personality and independent of intelligence. Although seemingly more valid, performance‐based measures have certain limitations, especially when scored with reference to consensual norms, which leads to problems of skew and restriction of range. Scaling procedures may partially ameliorate these scoring weaknesses. Alternative approaches to scoring, such as expert judgement, also suffer problems since the nature of the requisite expertise is unclear. Use of experimental paradigms for studying individual differences in information‐processing may, however, inform expertise. Other difficulties for performance‐based measures include limited predictive and operational validity, restricting practical utility in organizational settings. Further research appears necessary before tests of E1 are suitable for making real‐life decisions about individuals.

To replicate and extend research on psychopathy and intrinsic interpersonal preferences under the broader umbrella of affiliation, intimacy and antagonism, this paper aims to examine motivational correlates of psychopathy in a nonclinical sample (N = 125).

We used a multimethod design, including self-reports, a behavioral task and a physiological assessment of motive dispositions (automatic affective reactions to stimuli of interpersonal transactions measured with facial electromyography).

Results showed that self-reported psychopathy was negatively associated with self-reported intimacy motive. In the same vein, via the social discounting task, this paper found a negative association between psychopathy and a tendency to share hypothetical monetary amounts with very close others. Finally, regarding fEMG findings, multilevel analyses revealed that although individuals with low levels of psychopathy reacted more positively to affiliative stimuli, individuals with high levels of psychopathy reacted equally positively to both affiliative and antagonistic stimuli, and these results were robust across psychopathy measures. Results remained mostly unchanged on the subscale level.

These findings highlight the contribution of multimethod assessments in capturing nuances of motivation. Implicit physiological measures might be particularly sensitive in capturing motive dispositions in relation to psychopathy. Identifying mechanisms that foster positive connections between psychopathic traits and nonprosocial tendencies may be theoretically and clinically informative, with implications for forensic and penal practices.

Official criminal justice statistics (e.g. arrest rates) underestimate the frequency of crime because not all crime gets reported to authorities, a phenomenon known as the “dark figure of crime.” The present study aims to examine the dark figure of violence committed by discharged psychiatric patients.

Multiple reporting modalities permitted a direct comparison between patients whose violence was officially detected to those whose violence was self-reported but not officially detected, along with differences in the nature of violent acts.

Only 5% of violent individuals were officially detected, 26% of violent individuals were both officially detected and self-reported their violent behavior, while 68% of violent individuals self-reported their violent behavior and were not officially detected. The type of violent acts did not vary as a function of whether they were officially detected or self-reported. However, differences were observed for the location of violence, the relationship to the victim and whether an injury resulted. Older individuals, those with prior arrests and those with higher psychopathy scores are some of the factors associated with an increased likelihood of officially detected violence.

The data were collected from three sites in the USA. Generalizing the specific findings to other locations and countries ought to be done cautiously.

Studies ought to include multiple methods to measure violence. Self-report seems to be especially important to the extent one is concerned with measuring actual violence rather than violence that gets detected by legal authorities.

This study highlights an important limitation of relying exclusively on official criminal justice statistics when studying violence or recidivism in the community.

Using data from the Survey of Income and Program Participation (SIPP) matched to administrative records, we examine mortality risk and participation in the Disability Insurance (DI) and Supplemental Security Income (SSI) disability programs from a long-term perspective. Over a period of 14 years, we analyze the effect of self-reported health and disability on the probability of death and disability program entry among individuals aged 18–48 in 1984. We also assess DI and SSI programs from a life-cycle perspective. Self-reported poor health and severe disability at baseline are strongly correlated with death over the 14-year follow-up period. These variables also are strong predictors of disability program participation over the follow-up period among non-participants at baseline or before, with increasing marginal probabilities in the out-years. Our cross-sectional models are consistent with recent studies that find that the work-prevented measure is useful in modeling DI entry. However, once self-reported health and functional limitations are accounted for, the longitudinal entry models provide conflicting DI results for the work-prevented measure, suggesting that, contrary to claims based on cross-sectional or short-time horizon application models, the work-prevented measure is an unreliable indicator of severity. The risk of SSI and DI participation is significantly greater for individuals who die, suggesting that future mortality captures the effect of case severity and deterioration of health during the follow-up period. From a life-cycle perspective, a substantially greater proportion of individuals participate in SSI or DI at some point in their lives compared to typical cross-sectional estimates of participation, especially among minorities, people with less than a high school education, and those with early onset of poor health and/or disabilities. Cross-sectional estimates for the Social Security area population indicate SSI and DI participation rates of no more than 5% combined in 2000. In contrast, for individuals aged 43–48 in 1984, we observe a cumulative lifetime SSI and/or DI participation rate of 14%. The corresponding figure is 32% for individuals in that age group who did not graduate from high school, suggesting the need for human capital investments and/or improved work incentives.

This services marketing research provides a theoretical framework for experiential and relationship marketing and extends the theory of transcendent customer experience (TCE). Specifically, this paper aims to identify how the drivers (emotional intelligence [EI]), outcomes (customer loyalty, willingness to pay and word of mouth [WOM] intentions) and influences (openness to experience) of TCE are integrated. The research contributes to the theoretical debate regarding ability-based and self-reported EI measures by examining their influence on TCE.

Students and general consumers provided data through structured online surveys in three survey-based experiments. Linear and multiple regressions, mediation analyses and simple effects tests were used for data analysis.

Findings suggest that self-reported and ability-based measures of EI influence TCE differently. Participants who had high self-reported EI evaluated positive service encounters as more transcendent than they evaluated negative service encounters. Participants who had high ability-based EI evaluated positive service encounters as less transcendent than they evaluated negative service encounters. TCE experiences evoked higher loyalty, willingness to pay (WTP) and WOM recommendations. Furthermore, dispositional factors were significant in forming TCE: participants who were highly open to experience and had high ability-based EI interpreted their service encounter as less transcendent than did participants who were more closed to experience and had low ability-based EI.

TCE, a relatively new concept, offers theoretical advancement in context and constructs. The student-provided data gave high internal validity; the general consumer-provided data gave external validity. Ideally, a future field study in an actual consumption setting should replicate the findings. A self-reported questionnaire used to measure constructs may have introduced common method variance that biased the results.

By understanding that EI affects perceptions of transcendence in positive/negative service encounters, marketers can better implement consumer-oriented marketing strategies that will enhance TCE, customer loyalty, WTP and WOM.

Despite considerable research in experiential and relationship marketing, room remains for theoretical and practical enhancement in the under-researched concept of TCE. This research is the first attempt to extend TCE theory to marketing by identifying the drivers, outcomes and moderators of TCE in service encounters. The research also provides theoretical advancement in EI research. The results contradict previous research claiming that ability-based and self-reported measures are equally valid. Instead, using the two EI scales interchangeably leads to potentially different outcomes.