Search results
1 – 10 of over 1000Florian Fahrenbach and Karin Luomi-Messerer
This paper aims to draw on a socio-technical perspective to explore how information and communication technology (ICT) supports the validation of non-formal and informal learning…
Abstract
Purpose
This paper aims to draw on a socio-technical perspective to explore how information and communication technology (ICT) supports the validation of non-formal and informal learning (VNFIL) in specific practices and arrangements.
Design/methodology/approach
The authors use qualitative content analysis to analyse 43 country reports of the “European inventory on validation” published by the European Centre for the Development of Vocational Training (Cedefop) in 2019.
Findings
This study conceptualises ICT supported VNFIL practices and arrangements from a socio-technical perspective. Given this, the paper finds that ICT is used mainly to provide information on validation practices and arrangements, store qualification registers online and identify and document learning outcomes. The use of ICT to assess and certify learning outcomes remains limited.
Originality/value
VNFIL is very rarely seen in a technical context. This paper contributes to a theoretical perspective and highlights the mutual interdependence of social and technical components. Furthermore, this study provides an overview of inasmuch ICT is currently used to support VNFIL practices and arrangements. Based on the results, validation researchers and practitioners can get inspiration on how to develop ICT supported VNFIL practices and arrangements further.
Details
Keywords
Enrico Guarini, Francesca Magli and Andrea Francesconi
The purpose of this study is to analyse how academic staff cope with the new culture of performance measurement and assessment in universities. In particular, the study aims to…
Abstract
Purpose
The purpose of this study is to analyse how academic staff cope with the new culture of performance measurement and assessment in universities. In particular, the study aims to shed light on how external pressures related to measurement of research performance are translated into organisational and individual academic responses within the university and the extent to which these responses are related specifically to the operational features of performance measurement systems (PMS).
Design/methodology/approach
The study is based on a case study conducted in an Italian public university and based on interviews with a cross-disciplinary sample of faculty members.
Findings
The study provides insights into how linking financial incentives and career progression to research performance metrics at the system and organisational levels may have important reorientation effects on individual behaviours and epistemic consequences for the academic work.
Research limitations/implications
The study is based on interviews, so one limitation is related to the risk of researcher and interviewee personal bias. Moreover, this study is focused on one single case of a specific university setting, which cannot be fully representative of the experiences of others.
Originality/value
The study contributes to the literature on management accounting by exploring the factors that might explain why the unintended effects of PMS on academics’ behaviour reported by several studies might occur. From a practitioner’s point of view, it shows features of PMS that may produce unintended effects on academic activities. It also highlights the need to rethink PMS for the evaluation of university performance through the involvement of different stakeholders.
Details
Keywords
Geoff A.M. Loveman and Joel J.E. Edney
The purpose of the present study was the development of a methodology for translating predicted rates of decompression sickness (DCS), following tower escape from a sunken…
Abstract
Purpose
The purpose of the present study was the development of a methodology for translating predicted rates of decompression sickness (DCS), following tower escape from a sunken submarine, into predicted probability of survival, a more useful statistic for making operational decisions.
Design/methodology/approach
Predictions were made, using existing models, for the probabilities of a range of DCS symptoms following submarine tower escape. Subject matter expert estimates of the effect of these symptoms on a submariner’s ability to survive in benign weather conditions on the sea surface until rescued were combined with the likelihoods of the different symptoms occurring using standard probability theory. Plots were generated showing the dependence of predicted probability of survival following escape on the escape depth and the pressure within the stricken submarine.
Findings
Current advice on whether to attempt tower escape is based on avoiding rates of DCS above approximately 5%–10%. Consideration of predicted survival rates, based on subject matter expert opinion, suggests that the current advice might be considered as conservative in the distressed submarine scenario, as DCS rates of 10% are not anticipated to markedly affect survival rates.
Originality/value
According to the authors’ knowledge, this study represents the first attempt to quantify the effect of different DCS symptoms on the probability of survival in submarine tower escape.
Details
Keywords
Relying on a design science paradigm, the purpose of this paper is to describe the development and evaluation of items for an ICT artefact that supports the assessment of…
Abstract
Purpose
Relying on a design science paradigm, the purpose of this paper is to describe the development and evaluation of items for an ICT artefact that supports the assessment of transversal professional competences within the validation of prior learning (VPL). To do so, the authors build a conceptual bridge between the Occupational Information Network (O*NET) and the European Qualifications Framework (EQF).
Design/methodology/approach
Design science research paradigm, in particular the participatory development of candidate items and their evaluation in a multi-stakeholder approach.
Findings
The authors find that a self-assessment of professional competences should be comprised of 160 items in order to cover the breadth and depth of the O*NET in the hierarchical taxonomy. Such quantity of items sufficiently builds a conceptual bridge between the O*NET and the; EQF.
Practical implications
When designing procedures for the VPL, it is imperative to bear in mind the purpose of the validation procedure, in order to determine relevant stakeholders and their needs in advance as well as the; required language proficiency of the assessment instrument.
Social implications
The innovative value of this approach lies in the combination of an underlying hierarchical taxonomy with assessment items that are developed based on the qualification standards of different Austrian professions. Together with specific verbs that were adapted for each particular item, an innovative self-assessment is proposed. Thereby the authors aim to account for some of the mentioned shortcomings of the EQF.
Originality/value
This paper applies a design science paradigm to develop an ICT artefact that should support the VPL. By reflecting on the design process, the authors introduce a theoretical bridge between the O*NET and the EQF. Thereby the authors aim to account for some of the mentioned shortcomings of the EQF.
Details
Keywords
Key to transnational higher education (HE) cooperation is building trust to allow for seamless recognition of studies. Building on the Tuning Educational Structures initiative…
Abstract
Purpose
Key to transnational higher education (HE) cooperation is building trust to allow for seamless recognition of studies. Building on the Tuning Educational Structures initiative (2001) and lessons learnt from the Organisation for Economic Cooperation and Development (OECD)-Assessment of Learning Outcomes in Higher Education (AHELO) feasibility study, this paper offers a sophisticated approach developed by the European Union (EU)-co-financed project Measuring and Comparing Achievements of Learning Outcomes in Europe (CALOHEE). These evidence the quality and relevance of learning by applying transparent and reliable indicators at the overarching and disciplinary levels. The model results allow for transnational diagnostic assessments to identify the strength and weaknesses of degree programmes.
Design/methodology/approach
The materials presented have been developed from 2016 to 2023, applying a bottom-up approach involving approximately 150 academics from 20+ European countries, reflecting the full spectrum of academic fields. Based on intensive face-to-face debate and consultation of stakeholders and anchored in academic literature and wide experience.
Findings
As a result, general (overarching) state-of-the-art reference frameworks have been prepared for the associated degree, bachelor, master and doctorate, as well as aligned qualifications reference frameworks and more detailed learning outcomes/assessment frameworks for 11 subject areas, offering a sound basis for quality assurance. As a follow-up, actual assessment formats for five academic fields have been developed to allow for measuring the actual level of learning at the institutional level from a comparative perspective.
Originality/value
Frameworks as well as assessment models and items are highly innovative, content-wise as in the strategy of development, involving renown academics finding common ground. Its value is not limited to Europe but has global significance. The model developed, is also relevant for micro-credentials in defining levels of mastery.
Details
Keywords
Li Hsien Ooi and Arathai Din Eak
The purpose of this paper is to highlight how accreditation of prior experiential learning (APEL) is implemented, the challenges faced by the APEL assessors while assessing…
Abstract
Purpose
The purpose of this paper is to highlight how accreditation of prior experiential learning (APEL) is implemented, the challenges faced by the APEL assessors while assessing candidates as well as to suggest recommendations for improving the APEL process.
Design/methodology/approach
This paper is written based on the critical reflection of two accreditation of prior experiential learning: admissions (APEL-A) assessors appointed from a Malaysian Qualifications Agency approved assessment centre. This process would add depth and breadth to the study based on the assessor’s experience.
Findings
The study identified five challenges in the implementation of APEL-A. They are limited literature and records of the existing practices, conceptualisation of the APEL process, complicated and time-consuming APEL process, standard of acceptance vary according to discipline and lack of continuous training for APEL assessors. The four recommendations for improvements are as follows: the need for transparent and clear guidelines, ensuring consistency in practices and fairness to those from conventional learning, integrating APEL as part of the institution’s academic policy and providing continuous training for all APEL assessors.
Originality/value
Until now, not much research has been done regarding its implementation in Malaysia. The number of learners enrolled through this form of assessment may be low but growing. The feedback on the implementation of the APEL-A assessment process would be greatly beneficial to the stakeholders involved in improving its implementation process. The highlighted challenges faced as well as the recommendations put forth may also be useful for the continuous improvement of the APEL-A assessment process. Relevant stakeholders would benefit from this study.
Details