Search results

With behavioral experiments and protocol analysis, researchers can capture cognition in action. Using behavioral experiments, they can study realized behavior, not perception or self-reports. And they can do that in a controlled laboratory environment to establish causality, curbing spurious relationships. With protocol analysis, a method to elicit decision-makers’ thoughts, researchers can tap into cognitive processes. In combination, the two methods offer a novel approach to grasp mental processes alongside behavior, to reach causality and replicate findings. We describe the methods, demonstrate how researchers can apply them, and share practices from the design of experimental instruments to the replication of findings.

The verbal protocol method is used extensively in computer usability studies. This study was designed to test the feasibility of using the verbal protocol method as a means of conducting field research on the online catalogue. Ten undergraduate students conducted their own research on DRA’s Infogate. As they searched, they talked aloud about what keys they were pressing, what was happening on the screen, and their reactions. Transcripts of sessions were analyzed. A total of 65 different problems or comments were noted during search sessions, with 11 problems or comments noted in three or more sessions. This supports the hypothesis that the verbal protocol method is a valuable means of identifying common problems for users. It is suggested that the verbal protocol method offers great potential as a research tool in librarianship, for example in the area of interface design.

Behavioural studies of valuers have suggested that valuers rely on a number of cognitive strategies involving reasoning and intuition when undertaking a valuation task. However, there are few studies of the actual reasoning mechanisms in valuation. In other fields, much attention has been paid to forward and backward reasoning, as this shows the choices and decisions that are made in undertaking a complex task. This paper studied this during a valuation task. The purpose of this paper is twofold: first, to develop a methodological approach for empirical research on valuers’ reasoning, and, second, to report expert-novice differences on valuers’ use of forward and backward reasoning during a valuation problem solving.

The study utilised a verbal protocol analysis (VPA) to elicit think-aloud data from a purposive sample of a group of valuers of different levels of expertise undertaking a commercial-valuation task. Through a content analysis interpretive strategy, the transcripts were analysed into different cognitive segments identifying the forward and backward reasoning strategies.

The findings showed that valuers accomplished the valuation task by dividing the overall problem into sub-problems. These sub-problems are thereafter solved by integrating available data with existing knowledge by relying more on forward reasoning than backward reasoning. However, there were effects associated with the level of expertise in the way the processes of forward and backward reasoning are used, with the expert and intermediate valuers being more thorough and comprehensive in their reasoning process than the novices.

This study explores the possibility that forward and backward reasoning play an important role in commercial valuation problem solving using a limited sample of valuers. Given this, data cannot be generalised to all valuation practice settings but may motivate future research that examines the effectiveness of forward and backward reasoning in diverse valuation practice settings and develops a holistic model of valuation reasoning.

The findings of this study are applicable to valuation practice. Future training efforts need to evaluate the usefulness of teaching problem solving and explicitly recognise forward and backward reasoning, along with other problem-solving strategies uncovered in this study, as standard training strategies for influencing the quality of valuation decisions.

By adopting VPA, this study employs an insightful and rich dataset which allows an interpretation of thoughts of valuers into cognitive reasoning strategies that provide a deeper level of understanding of how valuers solve valuation problem; this has not been possible in previous related valuation studies.

This study aims to investigate quality of feedback as offered by supervisor-assessors with varying levels of assessor expertise following assessment of performance in residency training in a health care setting. It furthermore investigates if and how different levels of assessor expertise influence feedback characteristics.

Experienced (n=18) and non-experienced (n=16) supervisor-assessors with different levels of assessor expertise in general practice (GP) watched two videotapes, each presenting a trainee in a “real-life” patient encounter. After watching each videotape, participants documented performance ratings, wrote down narrative feedback comments and verbalized their feedback. Deductive content analysis of feedback protocols was used to explore quality of feedback. Between-group differences were assessed using qualitative-based quantitative analysis of feedback data.

Overall, specificity and usefulness of both written and verbal feedback was limited. Differences in assessor expertise did not seem to affect feedback quality.

Results of the study are limited to a specific setting (GP) and assessment context. Further study in other settings and larger sample sizes may contribute to better understanding of the relation between assessor characteristics and feedback quality.

Findings suggest that even with supervisor-assessors with varying levels of assessor expertise who are trained in performance assessment and the provision of performance feedback, high-quality feedback is not self-evident; coaching “on the job” of feedback providers and continuous evaluation of feedback processes in performance management systems is crucial. Instruments should facilitate provision of meaningful feedback in writing.

The paper investigates quality of feedback immediately following assessment of performance, and links feedback quality to assessor expertise. Findings can contribute to improvement of performance management systems and assessments for developmental purposes.

This study aims to investigate how participants have interacted during the execution of Online Public Access Catalogue (OPAC) searches, and whether they were satisfied or dissatisfied or confused.

This is based on a sample of 18 OPAC users of the British Council Library in Kolkata.

While implementing the verbal protocol method this study has developed a scheme of coding with the help of which the protocol data were analysed and proposed a generic model of online catalogue searching process flow. It is suggested that the method has a great potential in library and information science research.

The paper suggests that the method has a great potential in library and information science research.

Non-verbal communication (NVC) remains largely understudied despite its importance in today's fast-paced and cross-cultural management and research landscape. This article is significant because it reveals valuable insights into NVC, which represents 65–93% (Mehrabian, 1981) of communication and has the potential to considerably increase management effectiveness and efficiency by providing leaders and researchers with the knowledge they need to understand and handle diversity with competence.

This article draws on social identity theory (SIT) (Tajfel and Turner, 1979) and rapport management theory (RMT) (Brown and Levinson, 1987) to analyse illustrative interview extracts of co-occurring verbal and NVC from an interpretative phenomenological analysis (IPA) study focussed on understanding how London-based Romanian migrant entrepreneurs experience acculturation.

Romanian migrant entrepreneurs use a variety of verbal and non-verbal communication approaches in their acculturation narratives, providing depth and occasionally shifting meaning. These tactics include repeating verbal discourse with non-verbal clues, replacing verbal communication with non-verbal gestures, complementing verbal communication and juxtaposing non-verbal cues with verbal descriptions.

This study makes a valuable contribution to the fields of qualitative organisational management and entrepreneurial studies by addressing the lack of methodological tools available for analysing non-verbal language in interpretative research. This study presents a systematic technique for assessing non-verbal language symbols that has been developed through face-to-face interviews. The article utilises the first-hand interview experience of a Romanian co-researcher to demonstrate the significance of NVC in the transmission of meaning and the formation of identities amongst Romanian migrant entrepreneurs. These findings contribute to a better understanding of organisational management and research practices, particularly about this understudied entrepreneurial minority of Romanian businesses in London, by helping researchers and managers better grasp the cultural and contextual meanings communicated non-verbally. The article holds significance in the context of cross-cultural and organisational management practices.

This paper aims to report the development of an Islamic service quality scale that is derived from the literature, verbal protocol method interviews, and survey. Design/methodology/approach

Verbal protocol interviews were conducted with 24 men and 12 women from Indonesia. A pilot testing of the questionnaire was conducted with four Indonesian students. The items were further refined and pilot tested with six Indonesian students. Exploratory factor analysis and reliability analysis (n

The results indicate a robust measure of Islamic service quality: general Islamic values, Halal/Haram, attention to Islamic religious activities, honesty, modesty, and humaneness and trustworthiness. Future researchers can apply the Islamic service quality measure to Muslim consumers in other countries. Successful service providers need to be cognizant of the intrinsic roles played by Islamic values and practices among the Muslim consumers.

Major limitations include the recall ability of consumers during the verbal protocol method of interviewing, potential blending of Islamic values and Javanese culture, and the extent of separation of state and religion. Future researchers can apply the Islamic service quality measure to Muslim consumers in other countries.

Successful service providers need to be cognizant of the intrinsic roles played by Islamic values and practices among the Muslim consumers.

This paper contributes to the extant literature on Islamic marketing by developing a unique measure of service quality that is pertinent to Muslim consumers.

Nutrition labels are seen as offering the potential to educate consumers about healthy eating and to encourage and enable them to make healthy food choices. This study used verbal protocol analysis, a method new to food choice research, to examine which parts of the nutrition label are currently used by consumers when shopping “normally” and for “healthy” foods. The implications of the findings for nutrition educators are discussed.

The paper reports experimental results concerning user interaction with document organization, user‐librarian negotiation and the librarian's search processes in public libraries. The focus of the investigations is on the cognitive aspects of information retrieval. After defining the formal framework of the information retrieval (IR) process a theoretical section discusses the cognitive viewpoint on which the research is based, followed by an outline of applicable findings and theories within the fields of cognitive science and cognitive psychology. The experimental design involving tape‐recording and analysis of verbal protocols is briefly described and considered. The main part of the paper concentrates on the results of investigations and considers certain implications. It is shown how the user's knowledge structures cope with the structures of the system. User needs seem often to be presented as a label which may create ambiguity problems. Functions of open and closed questions are investigated and certain behaviouristic factors discussed. Matching the knowledge structure of the user and the librarian is considered a kind of learning process. Librarians prefer search activity before consideration of the presented problem. Without a user present the librarian's IR process is determined by three search attitudes involving motives and expectations as to search routines and possibilities. Conceptual knowledge, previous search and working domain play important roles. The attitudes have consequences for the objectives concerning use of routines and for the use of search concepts.

This paper contributes to leadership categorization theory by advocating a new method to surface people's implicit leadership theories. The purpose of this new approach is to simultaneously capture individual difference in how they conceptualize leadership but within a common framework to allow for comparison of within- and between-person effects.

The authors conduct a narrative review of the implicit leadership theory, leadership categorization theory, cognitive mapping and verbal protocol literature with the purpose of surfacing a research method that will overcome the problems of over-simplification and over-individualization in existing methods.

The authors argue that using a combination of cognitive mapping and verbal protocols can capture the idiosyncrasies of individual lay theories of leadership while retaining the ability to compare people's responses through a common framework. The authors provide an example of how this method can be used to elicit people's perceptions of one aspect of implicit leadership theories, intelligence.

This new method will provide a methodology to test the subset propositions advocated by leadership categorization theory. These include the idea that subordinate level implicit leadership theories contain a subset of attributes found in the basic-level implicit leadership theories, that there is attribute integrity in superordinate implicit leadership theories through the levels, and the idea that people define leadership differently depending on the context they are observing.

Whereas previous approaches to surfacing people's implicit leadership theories either heavily constrain their responses with a predetermined generic suite of attributes or are totally open-ended and idiosyncratic, the authors advocate an approach that combines the best of both.