Search results

Examine the extent of integration in delivering value from design and construction (DC) activities for total asset management (TAM) and operations post-completion. DC and operations and management (OM) are both addressed. The problem owners are those in roles and organisations responsible for integrating DC with OM. The purpose of this paper is to show the extent of integration between actors along the project lifecycle. Relationally integrated value networks (RIVANS) provide the conceptual lens for the analysis.

A mixed method approach was used. A questionnaire survey and semi-structured interviews were employed.

There is a lack of engagement between DC and OM. The trend is moving counter to integration. BIM is not found to be a technical solution.

The mixed method helps extend the RIVANS perspective. Further research to understand and support integration is needed, especially qualitative research to provide greater granular understanding.

The identified trend away from integration poses management challenges in delivery and for sustainability in use. Supply chains engage specialists, yet internal and inter-organisational collaboration require management attention to value creation. This includes the DC-OM interface. Both sides can benefit from increased engagement.

Infrastructure and property provision will continue to fall short of user and environmental functionality without improved integration.

A contribution to the project and asset management interface is made, showing low integration, disengaged asset management. BIM is unable to plug the gaps. The RIVANS analytical lens provides a perspective for improvement.

In order to determine the usefulness of multi‐source rating in different types of organizations, this study explored differences among organization types in four areas: leniency, interrater agreement, relationships between these ratings and effectiveness, and the relationship between agreement and effectiveness. Used self, subordinate, peer, and supervisor ratings for 1,080 target managers in six types of organizations: education, military, government, manufacturing, finance, and health. Interrater agreement was measured in three ways: an index of variance, a point‐difference categorization method, and categories of self‐other agreement. Results indicated that a leniency bias was present in educational institutions, after controlling for demographic characteristics. Interrater agreement was lowest in government agencies and highest in education and manufacturing organizations. In private sector organizations, more poor‐performing managers tended to over‐estimate their performance relative to the perceptions of others. Interrater agreement was positively related to effectiveness especially in education and finance organizations. Results suggest that multi‐source feedback may work differently in different types of organizations, and such differences may need to be taken into account by researchers, practitioners, and feedback recipients.

Due to the paucity of research on web-based job applicant screening (i.e. cybervetting), the purpose of the current study was to examine the psychometric properties of cybervetting, including an examination of the impact of adding structure to the rating process.

Using a mixed-factorial design, 122 supervisors conducted cybervetting evaluations of applicant personality, cognitive ability, written communication skills, professionalism, and overall suitability. Cross-method agreement (i.e. the degree of similarity between cybervetting ratings and other assessment methods), as well as interrater reliability and agreement were examined, and unstructured versus structured cybervetting rating formats were compared.

Cybervetting assessments demonstrated high interrater reliability and interrater agreement, but only limited evidence of cross-method agreement was provided. In addition, adding structure to the cybervetting process did not enhance the psychometric properties of this assessment technique.

This study highlighted that whereas cybervetting raters demonstrated a high degree of consensus in cybervetting-based attributions, there may be concerns regarding assessment accuracy, as cybervetting-based ratings generally differed from applicant test scores and self-assessment ratings. Thus, employers should use caution when utilizing this pre-employment screening technique.

Whereas previous research has suggested that cybervetting ratings demonstrate convergence with other traditional assessments (albeit with relatively small effects), these correlational links do not provide information regarding cross-method agreement or method interchangeability. Thus, this study bridges a crucial gap in the literature by examining cross-method agreement for a variety of job-relevant constructs, as well as empirically testing the impact of adding structure to the cybervetting rating process.

The purpose of this paper is to discuss a self‐assessment scheme and processes that are developed for and applied to a R&D organization based on ISO 9004:2000. The presented self‐assessment has been performed during internal audits based on quality management system in Electronics and Telecommunications Research Institute (ETRI) in Korea.

In order to enhance the reliability of the self‐assessment, the preliminary works such as training, workshop, case study and pre‐assessment rating are performed in advance before self‐assessment. Furthermore, this paper evaluates the reliability of self‐assessment results using Cohen's Kappa coefficient and the observed agreement index.

The results of this paper present that an organization's performance maturity level evolves sustainably through self‐assessment scheme and processes.

These results and lessons learned will be very useful to the organization that intends to enhance the performance of its R&D projects and processes and improve its processes continuously.

ISO 9004:2000 presents the guidelines of self‐assessment for the organization that intend to continually improve its performance considering the effectiveness and efficiency of a quality management system. According to ISO 9004, the range and depth of self‐assessment should be planned in relation to the organization's objectives and priorities. This paper discusses a self‐assessment scheme and processes that are developed for and applied to a R&D organization based on ISO 9004:2000.

The purpose of this research paper was to establish a replicable method of gathering and analyzing data using course syllabi to enable instruction librarians to strategically embed information literacy instruction within a disciplinary curriculum.

A set of syllabi from the School of Business was evaluated for information literacy learning outcomes and library use requirements using a set of rubric-based content analysis questions. The questions were normed prior to coding to ensure reliability, and interrater reliability was established using two measures: the per cent agreement method and Krippendorff’s alpha.

The results revealed strategic opportunities for scalable, curriculum-integrated instruction in the School of Business: a group of 28 courses that could be targeted for in-depth instruction, and eight courses whose outcomes could be met through more tailored instruction focused on information access skills.

The reported research study provides a method for evaluating holistic information literacy outcomes in course syllabi, an improvement on prior syllabus analysis projects. Additionally, the reliability of the data means that the study design may be replicated in a variety of institutional contexts.

The aim is to determine whether staff ratings of service user attachment style are associated with service user misconduct during inpatient treatment in a medium secure mental health unit; also, to gauge whether staff can evaluate attachment style reliably.

Retrospective case note analysis on 55 inpatient treatment episodes were supplemented with staff ratings of service user attachment style. Records of untoward incidents were centrally retrieved. Kappa statistics were used to analyse levels of staff agreement regarding service user attachment style.

Attachment style was associated with hostile episodes, treatment non‐compliance and service user aggression. Post hoc analysis on a subset of data yielded poor overall agreement in ratings of attachment style (Kappa=0.2). Further analysis revealed a sex‐based asymmetry with high consistency in ratings of female service users (Kappa=0.79) and very low inter‐rater reliability for male service users (Kappa=−0.05). It is important to note that the staff included in the interrater reliability analysis were female.

The sample was small, the observation period was short and staff conducting the ratings had no special training in the rating tool.

Attachment style per se played a significant part in the success and/or failure of service user treatment (when measured by misconduct). However, the validity of staffs' ratings of attachment style may interact systematically with the sex of staff and service users. These findings have important implications for the application of the concept of attachment in clinical settings.

Mental health professionals place central importance on the establishment of therapeutic relationships between clinicians and service users. Service user attachment style is assumed to play a role in mediating the success, or failure, of relationships with clinicians.

This study makes a novel contribution to the application of attachment theory to secure mental health care, it also demonstrates that gender is an important factor in staff appraisals of service users' approach to treatment.

Do similar job titles refer to the same work activities, as assumed often, but hardly empirically tested? The purpose of this paper is to analyze the similarity of 160 occupations within and across eight European countries using interrater agreement statistics (rWG).

Using a multilingual web survey, experts and jobholders in the eight countries rated the frequency of ten tasks per occupation they had knowledge of (n=4,197 ratings). Three hypotheses are investigated: first, interrater agreements of occupations are similar regardless the country; second, interrater agreements of occupations are similar within countries; and third, experts and jobholders are similar in their ratings.

Half of the occupations reveal no agreement across ratings, one-third shows a weak/moderate agreement and one in ten shows a strong agreement. H1 is rejected for task frequency but not for task importance. Within-country similarity of occupations is larger than across-country similarity. H2 is supported for two countries and rejected for two other countries. H3 is not supported. Jobholders demonstrate higher agreement than experts.

An empirical testing of occupation-specific tasks for a wide range of occupations across Europe seems a viable approach.

The paper contributes to the challenges related to labor market mobility across borders.

Work tasks for a wide range of occupations and countries, using job-specific work activities in combination with web surveys and the internet for recruitment of jobholders, have not been used before.

The overall goal of science is to build a valid and reliable body of knowledge about the functioning of the world and how applying that knowledge can change it. As personnel and human resources management researchers, we aim to contribute to the respective bodies of knowledge to provide both employers and employees with a workable foundation to help with those problems they are confronted with. However, what research on research has consistently demonstrated is that the scientific endeavor possesses existential issues including a substantial lack of (a) solid theory, (b) replicability, (c) reproducibility, (d) proper and generalizable samples, (e) sufficient quality control (i.e., peer review), (f) robust and trustworthy statistical results, (g) availability of research, and (h) sufficient practical implications. In this chapter, we first sing a song of sorrow regarding the current state of the social sciences in general and personnel and human resources management specifically. Then, we investigate potential grievances that might have led to it (i.e., questionable research practices, misplaced incentives), only to end with a verse of hope by outlining an avenue for betterment (i.e., open science and policy changes at multiple levels).

The use of social networking web sites (SNWs), like Facebook and MySpace, has become extremely popular, particularly with today's emerging workforce. Employers, aware of this phenomenon, have begun to use the personal information available on SNWs to make hiring decisions. The purpose of this paper is to examine the feasibility of using applicant personal information currently available on SNWs to improve employment selection decisions.

A total of 378 judge ratings (63 raters×6 subjects) are evaluated to determine if raters can reliably and accurately determine the big‐five personality traits, intelligence, and performance based only on information available on SNWs. Interrater reliability is assessed to determine rater consistency, followed by an assessment of rater accuracy.

Based solely on viewing social networking profiles, judges are consistent in their ratings across subjects and typically able to accurately distinguish high from low performers. In addition, raters who are more intelligent and emotionally stable outperformed their counterparts.

Human resource (HR) professionals are currently evaluating social networking information prior to hiring applicants. Since SNWs contain substantial personal information which could be argued to cause adverse impact, academic studies are needed to determine whether SNWs can be reliable and valid predictors of important organizational criteria.

This paper is the first, as far as the authors are concerned, to address the use of SNWs in employment selection, despite their current utilization by HR practitioners.

The cultural dimensions of the Hofstede and Global Leadership and Organizational Behavior Effectiveness (GLOBE) studies are often used to capture cultural differences and operationalize them in academic research, corporate business, and teaching. The purpose of this paper is to investigate if this context is appropriate for the Indian information technology (IT) offshore services industry; that is, if Indian culture can be measured with group-referenced items, averaged, and explained by discrete dimensions.

The authors devised items based on the GLOBE study, and conducted empirical research with 291 employees of two services sourcing providers in Pune and Bangalore, India. The authors then scrutinized the data set on item and dimension level using statistical methods, such as interrater agreement, t-test, arithmetic mean, and standard deviation.

An interpretation of the analysis posits that cultural assumptions based on dimensions and means are problematic in the context of the Indian IT offshore services industry. The two digit exact values of the GLOBE study (and similarly the ordinal scale by Hofstede) suggest a level of accuracy and absoluteness which could not be replicated in the empirical research. Therefore, one authors should be very careful referring to Indian national culture when conducting intercultural awareness programs and coaching international teams who are engaging with India.

The GLOBE study omits to report basic statistics of questionnaire development. Through this replication study in India, the authors provide empirical evidence that the construct validity of cultural dimensions and the concept of national/group averages may be flawed.