Search results

The purpose of this paper is to explore the clinical perspective of the practicality, utility and face-validity of the dynamic support database (DSD) Red, Amber, Green (RAG) rating support tool within adult learning disabilities services in a North West NHS Foundation Trust. The aim of the current project is to evaluate the practicality, utility and face-validity of the DSD RAG rating support tool, as reported by clinicians who have been employing it.

A mixed-methods design was utilised by asking clinicians to complete a questionnaire in relation to the DSD Support Tool. Questionnaires were distributed across three community learning disability teams within the North West. A total of 50 clinicians completed the questionnaire which included rated responses for quantitative analysis and free-text comments for qualitative analysis.

Positive ratings given by clinicians suggested good practicality, utility and face-validity in relation to the tool. Analysis of the free-text comments suggested that the tool supported clinical judgement in a standardised way and helped discussions with commissioners. Feedback also provided insights into how the DSD support tool could be improved.

Further investigation would be required to yield higher numbers of participation across NHS Trusts to add reliability to the present findings.

The DSD support tool has been used within the NHS Foundation Trust for the last 12 months however the practicality, utility and face-validity of the tool had not been explored from the clinician perspective.

The purpose of this study was to develop and psychometrically evaluate a tool to measure nurses’ knowledge of, attitude toward and practice regarding the elder abuse phenomenon.

This study is methodological research that was conducted in two stages. In the first stage, the available tools related to knowledge, attitude and practice regarding elder abuse were identified through an extensive review of theoretical principles, previous research and related articles. The initial items were extracted and categorized. In the second stage, the psychometric properties of the tool were examined by assessing face validity, content validity, construct validity, internal consistency and stability. Four hundred nurses working in the hospitals of Shahid Beheshti University of Medical Sciences were selected to determine the validity of the structure.

The initial tool consisted of 114 items extracted, 34 of which were removed according to the experts’ opinions. The face validity of the 80-item questionnaire was then examined. The number of the items was reduced to 74 after measuring the face validity. After the qualitative measurement of the content validity, three items were eliminated. After measuring the content validity using a quantitative approach, 8 other items were removed and 63 items remained. According to the content validity index, 1 more item was removed, reducing the number to 62. The construct validity approved three dimensions of knowledge, attitude and practice. Cronbach's alpha coefficient was calculated to be 0.84. The stability was also confirmed through test–retest with a value of 0.85 for the whole scale.

The tool developed for assessing nurses’ knowledge, attitude and practice regarding elder abuse has acceptable dependability and credibility. Given the advantages of this tool, including the simplicity and fluency of sentences, and the comprehensive evaluation of nurses’ knowledge, attitude and practice regarding elder abuse, it is recommended to use this tool in relevant future studies.

This paper aims to assess the face validity to inform content validity of the Quality of Life – Aged Care Consumers (QOL-ACC), a new measure for quality assessment and economic evaluation in aged care.

Semi-structured interviews were conducted with older adults (66–100 years) receiving aged care services at home (n = 31) and in residential care (n = 28). Participants provided feedback on draft items to take forward to the next stage of psychometric assessment. Items were removed according to several decision criteria: ambiguity, sensitive wording, not easy to answer and/or least preferred by participants.

The initial candidate set was reduced from 34 items to 15 items to include in the next stage of the QOL-ACC development alongside the preferred response category. The reduced set reflected the views of older adults, increasing the measure’s acceptability, reliability and relevance.

Quality of life is a key person-centred quality indicator recommended by the recent Royal Commission into Aged Care Quality and Safety. Responding to this policy reform objective, this study documents a key stage in the development of the QOL-ACC measure, a new measure designed to assess aged care specific quality of life.

This study extends prior accounting research on decision aids (DAs) relating to face validity. Specifically, this study aims to examine the effects of face validity through the presence of two levels of bias in DA output. The presence of bias in a DA will not affect how statistically informative an aid is but will decrease the face validity. The findings suggest that non-expert DA users recognize the bias in the DA’s suggestions as evidenced by users’ low agreement with the aid; however, they do not adjust for the bias in their performance, suggesting that non-expert users do not learn from the DA.

This repeated-measures experimental design allows us to examine performance effects over time in response to different levels of bias in the DA output. The participants in the study are provided with outcome feedback to examine learning effects.

The findings suggest that non-expert DA users recognize the bias in the DA’s suggestions as evidenced by users’ low agreement with the aid; however, they do not adjust for the bias in their performance, suggesting that non-expert users do not learn from the DA. Although users of an unbiased DA strongly agree with the DA’s output, individual performance deteriorates over time. Initially, the users of an unbiased DA perform better than those who use a biased DA; however, over time, the performance of users of an unbiased aid deteriorates and the performance of users of the biased aid does not improve.

Companies developing DAs may need to consider the effects of using a DA under circumstances different from those under which the aid was developed and that may lead to the biased DA output. This study has implications for firms that design, develop and use DAs.

This study considers a yet unexamined face validity issue – observable bias in DA output. This study examines deterministic DAs designed to assist the decision-maker through their ability to combine multiple cues in a systematic and consistent manner. This study has implications for firms that design, develop and use DAs. Firms need to consider the effects of using a DA under circumstances different from those under which the aid is developed, thereby, potentially leading to biased DA output. Each additional variable added to the DA will be associated with an incremental cost in a DA’s development, use and modification. The results of this study provide insights contributing to the information available for cost–benefit analyses conducted when developing a DA or when considering the modification of existing aid. Failure to change a DA because of face validity issues alone may result in a decline in user performance. Thus, the cost of modifying a DA must be weighed against the benefits resulting from improved performance. This study contributes insights into how users’ responses to DA bias could affect the assessments of the benefits of including an omitted variable in a DA.

Children’s cooking abilities are correlated with increased self-efficacy (SE) for selecting healthy foods and increased consumption of fruits and vegetables. Instruments that measure outcomes of nutrition education programs require psychometric assessment for face validity. Survey items related to cooking experience (CE), SE, and attitude used in a school-based cooking program were assessed for face validity. The paper aims to discuss these issues.

Cognitive interviews were conducted with children who had completed third to fifth grades in Northern Colorado, USA. Interviews were examined using content analysis to derive categories for children’s concepts of cooking and making food and to assess survey item comprehension.

In total, 24 children participated. Most were white, non-Hispanic/Latino and half had most recently completed fourth grade. Categories related to “making food” and “cooking” included foods prepared with and without a heat source, baked goods/desserts, and activities used in meal/food preparation. Most participants comprehended the survey items and provided responses that were congruent with operational definitions established from identified themes, demonstrating face validity with this sample.

Children’s concepts of “cooking,” although robust, show interpersonal variation requiring a prudent approach toward intervention evaluation and supporting use of these face valid survey items. Consider revisions of survey items that add frequency qualifiers and explicit cooking examples as appropriate.

This study addresses a gap in the literature on children’s understanding of cooking and offers face valid survey items to measure CEs, skill, and attitudes.

The purpose of this paper is to assess whether the Adult Attachment Projective (AAP) Picture System is a reliable and face valid measure of internal working models of attachment in adults with intellectual disabilities (ID).

The AAPs of 20 adults with ID were coded blind by two reliable judges and classified into one of four groups: secure, dismissing, preoccupied, or unresolved. Inter-rater reliability was calculated using κ. Six participants repeated the assessment for test-retest reliability. Two independent experts rated ten cases on the links between the AAP analysis and the clinical history.

There was significant agreement between AAP judges, κ=0.677, p<0.001. Five out of six participants showed stability in their classifications over time. The majority of expert ratings were “good” or “excellent”. There was a significant inter-class correlation between raters suggesting good agreement between them r=0.51 (p<0.05). The raters’ feedback suggested that the AAP had good clinical utility.

The inter-rater reliability, stability, face validity, and clinical utility of the AAP in this population is promising. Further examination of these findings with a larger sample of individuals with ID is needed.

This is the first study attempting to investigate the reliability and validity of the AAP in this population.

Describes the process and outcomes of operationalizing the 14 dimensions underlying the SPC implementation/practice construct. Employs a standard procedure to create a measurement instrument comprising 14 measurement scales, with the number of constituent measurement items ranging from one to four, that correspond to the 14 dimensions underlying the SPC implementation/practice construct. Reports the results of assessing three properties of measurement quality for these newly‐created measurement scales, namely: face validity, internal consistency reliability and uni‐dimensionality. Such a measurement instrument can then be applied to examine antecedents and consequences of SPC implementation/practice and to diagnose existing organizational efforts at implementing and practicing SPC and to identify opportunities to improve organizational implementation and practice of this quality improvement intervention. Demonstrates the application and interpretation of the SPC implementation/practice measurement instrument within one organizational setting. Concludes by identifying future research needs.

The purpose of this paper is to show the importance of validity process in survey questionnaire instrument development. It is to confirm all items chosen are valid in the context of study, especially in assessing municipal website Web user behaviours. The quality of measurement also can be assured.

Several methods used to assess validity of the survey instrument in this study, such as face validity, content validity index (CVI) and construct validity. CVI assessment is widely used to examine each item in the survey instrument exact measures what is supposed to be measured. Prolific items used to evaluate web aesthetic, usability, navigation, content organization, interactivity and user engagement.

Several items were rephrased and simplified during face validity assessment, while three items from user engagement construct were excluded after the CVI assessment. Reliability and redundancy analysis had shown good results for each item and construct for both dependent and independent variables. None of the items in any construct need to be eliminated.

The face validity, content validity and construct validity assessments are sufficient to assure the consistency of the conceptual framework, the content of items and overall measurement approach reflecting the setting or context of study which are web users.

The validated survey instrument provides practical guidelines for government municipal website owners on how to stimulate website user to keep engaged on the government municipal website. Identified website content that acts as credibility cues can be as object attention when planning the strategy of Web content management. Through proper design and attracting touch up, the credibility cues can attract website user and force the user to engage deeper on the government municipal website content, believe it as the main source of information and recognize it as authoritative organization.

The measurement model of this study that consists of formative construct of surface credibility, and user engagement is proposed to be tested in a different context of this study.

With changing employment conditions, technological advancement, frequent manpower reduction and global competition, the relevance of the protean and boundaryless career concepts is increasing. With this, the country’s culture plays a pivotal role in career choice. The purpose of this paper is to develop and validate protean and boundaryless career scales for college passing out students and in the Indian context. The protean career scale was measured by self-directed and values-driven dimensions, while the boundaryless career scale was measured by boundaryless mindset and organizational mobility preference.

The first step involved defining construct and determining face validity. The data collected via questionnaire from India’s final year engineering students were subjected to exploratory factor analysis and confirmatory factor analysis in the second and third steps, respectively. Finally, the nomological validity was tested by establishing the relationship between factors influencing career choice and newly developed protean and boundaryless career.

The result suggested using a two-factor model with a protean career (combining self-directed and values-driven items) and a boundaryless career as a separate construct for college passing out students.

The developed scale has nine items that can be used to conduct surveys at the time of campus hiring by academic scholars, HR managers, and practitioners who are working on the identification, development and management of human talent as a part of any human resource management system.

To the best of the authors’ knowledge, this is the first approach to developing the protean and boundaryless career scale for college passing out students and in the Indian context which can be replicable for South Asian countries.

Data are presented which indicate a need for improvement in the personnel skills of small business owners. A set of criteria is then provided for possible approaches to training small business owners in personnel skills. These criteria were developed from interview material acquired in a field study of small business owners. They include: research substantiation of overall effectiveness; face validity; degree of efficiency of time use; ease of access; relative cost; degree to which the method involves criticism of trainees; and effectiveness in skill development. The training approaches evaluated or these criteria are the lecture method, programmed instruction; business games/simulation; the case method, the role play method, sensitivity training; the conference method; and behaviour role modelling. Results suggest that most small business owners would derive the greatest benefits from behaviour role modelling, business games, and/or role play method and would benefit least from the lecture method and sensitivity training.