Search results

In academia, assessment is often narrow in its focus on research productivity, its application of a limited number of standardised metrics and its summative approach aimed at selection. This approach, corresponding to an exclusive, subject-oriented concept of talent management, can be thought of as at odds with a broader view of the role of academic institutions as accelerating and improving science and scholarship and its societal impact. In recent years, open science practices as well as research integrity issues have increased awareness of the need for a more inclusive approach to assessment and talent management in academia, broadening assessment to reward the full spectrum of academic activities and, within that spectrum, deepening assessment by critically reflecting on the processes and indicators involved (both qualitative and quantitative). In terms of talent management, this would mean a move from research-focused assessment to assessment including all academic activities (including education, professional performance and leadership), a shift from focus on the individual to a focus on collaboration in teams (recognising contributions of both academic and support staff), increased attention for formative assessment and greater agency for those being evaluated, as well as around the data, tools and platforms used in assessment. Together, this represents a more inclusive, subject-oriented approach to talent management. Implementation of such changes requires involvement from university management, human resource management and academic and support staff at all career levels, and universities would benefit from participation in mutual learning initiatives currently taking shape in various regions of the world.

This chapter outlines the challenges that research and practice in higher education have faced in measuring students' competences and learning outcomes. Particular attention is given to the systematic and institutional contexts in Germany. Based on the outlined national and international contextual framework, the Germany-wide program “Modeling and Measuring Competences in Higher Education (KoKoHs)” is discussed in terms of its two central working stages, key outcomes and lessons learned. In particular, the central results of the second phase are presented for the first time and integrated into the current state of international research. Based on this analysis, perspectives for further research on student learning in higher education and implications for practice and policy are derived.

A framework for developing a multi-course undergraduate research project is presented, which (1) allows students to connect coursework learning with real company data, (2) engages students in relevant critical analysis, and (3) provides meaningful, content-rich learning assessment data that can be used to improve student learning. Sample assignments, an assessment rubric, and sample assessment data reports are also presented to illustrate how diverse assignments, with regard to scope, structure, and accounting skills, can be evaluated and used to improve student learning across the accounting curriculum. Importantly, the process of responding to the assessment data to make improvements to “close the loop” is discussed.

Each of the four objectives can be applied within the military training environment. Military training often requires that soldiers achieve specific levels of performance or proficiency in each phase of training. For example, training courses impose entrance and graduation criteria, and awards are given for excellence in military performance. Frequently, training devices, training media, and training evaluators or observers also directly support the need to diagnose performance strengths and weaknesses. Training measures may be used as indices of performance, and to indicate the need for additional or remedial training.

Purpose — This chapter provides an historical overview of assessments of research quality conducted by the UK funding councils in the period 1986–2008, with special reference to the assessments that have been carried out of departments in the library and information management (LIM) sector.

Methodology/approach — A literature review covering both LIM-specific material and more general sources discussing the assessment of research quality in UK universities.

Findings — There is clear evidence of an increase in the general quality of the research carried out by the LIM sector over the review period. This has been accompanied by a decrease in the number of traditional LIM departments submitting themselves for assessment, with these being replaced in the assessment process largely by information systems departments. The rankings over the review period have been dominated by a small number of departments with long-established research traditions.

Originality/value of the paper — While there is an extensive literature describing research assessment in general, and a few articles describing individual assessments in the LIM sector, there is no overview of the involvement of the LIM departments over the whole series of assessment exercises that has been carried out.

Over the past few decades, university reforms in line with management and enterprise ideals have been well documented. Changes in the ideals underlying the missions of universities have led to changes in their modes of governing and organizing, which in turn drive further transformation of their missions. One set of reforms in Swedish higher education has been the dissolution of collegial bodies and procedures. At the same time, in recent years, we have witnessed an increased interest in collegiality and a reintroduction of collegial bodies and procedures. New translations of collegiality appear not only in how universities are organized, but also in other core aspects of research and higher education. We review examples of peer reviewing, research assessment, and direct recruitment of professors and ask: Can these new translations of collegiality be understood as a revitalization of collegiality, or is it – to draw a parallel with greenwashing – rather a matter of collegiality-washing?

Purpose – This chapter provides a roadmap for future research and evaluation on violent extremist risk analysis.

Methodology/Approach – The authors synthesize the lessons learned from process evaluations of general violence risk assessment, bias research, survey designs, linguistic analyses, and spatial analyses, and apply them to the problem of violent extremist risk assessment and management.

Findings – The next generation of violent extremist risk assessment research will necessitate a focus upon process, barriers to effective implementation and taking the human element of decision-making into account. Furthermore, the development of putative risk factors for violent extremist attitudes and behaviors necessitates a movement toward more survey-based research designs. Future risk assessment processes may additionally take language and spatial components into account for a more holistic understanding.

Originality/Value – Based on existing literature, there is a paucity of research conducting process evaluations, survey designs, linguistic analyses, and spatial analyses in this area. The authors provide several roadmaps, assessments of respective strengths and weaknesses, and highlight some initial promising results.

Professional Doctorates (PDs) have been added to the curriculum of many universities worldwide, as an alternative to the traditional Doctor of Philosophy (PhD). PDs are more focused on practice-based knowledge that advances professional practice and contributes to society, industry and the economy. The dominance of the PhD as the typical higher degree by research has led universities to develop frameworks for their PDs which are very similar to the PhD framework. This includes the assessment of the PD, which in many cases follows the same process and is based on the same criteria as for the PhD. This similarity in the assessment of the two types of doctorates creates challenges for external examiners (EEs), who are invited to evaluate the contribution of the PD within frameworks which are tailored around the PhD. Here, the authors focus the investigation on the Doctorate in Business Administration and conduct a review and analysis of institutional documents from universities in England in an attempt to understand the similarities and differences between the examination process of the PD and the PhD and the extent to which the examination process of the PD supports the evaluation of the practice-based contribution that is at its heart. Through this review and analysis, the authors identify the challenges that exist for EEs who are called to assess PDs, and make recommendations which will support EEs to evaluate the contribution of the PD.

Student populations in higher education in the United States have become increasingly diverse as a result of demographic changes. As a result, educators need an understanding of the background and characteristics of these demographic subgroups in order to improve the quality of their education. Students’ approaches to learning affect their quality of learning and are influenced by their perceptions of the learning environment and assessment. The present study extends prior research by examining the approaches to learning, assessment preferences, and the relationship between approaches to learning and assessment preferences of intermediate accounting students enrolled in a public university in the United States with a diverse student population. Students with higher deep approaches to learning had higher preferences for assessment involving higher-order thinking tasks, integrated assessment, and nonconventional assessment. Students with higher surface approaches to learning had lower preferences for assessment involving higher-order thinking tasks. The differences in these relationships for subgroups of students defined by citizenship, age, gender, and race are presented. The implications of the results for teaching and learning in accounting education are discussed.