Search results

This paper aims to propose an innovative method for deploying a personalized instructor-created software-aided assessment system, that will disrupt traditional learning environments by allowing students to confidentially and with indirect supervision from the instructor, assess their knowledge and ability to achieve the course outcomes.

Through empirical evaluation in real-world educational settings, the authors examine the impact of augmenting human activity in the classroom with an innovative software platform to transform the learning process.

Findings indicate that this software-aided assessment system effectively augments human interactivity by providing timely instructor-designed feedback to increase knowledge retention and skillsets.

This study has shown that incorporating disruptive innovation through the use of software-aided assessment systems increases the effectiveness of the faculty in the classroom and enhances student learning and retention. Thus, a transformative software-aided assessment system design that incorporates artificial intelligence into the learning pathway should be pursued. These software-aided assessments are disruptive innovation as they are formative, frequent and require little direct involvement from the instructor.

To the best of the authors’ knowledge, this study is the first of its kind to incorporate artificial intelligence into the assessment process by analyzing results of pilot programs at several universities. The results demonstrate how using software-aided transformative assessments in various courses have helped instructors assess students’ preparedness and track their learning progress. These software-aided systems are the first step in bringing disruptive innovation to the classroom as these software-aided assessment instruments rapidly assess learners’ knowledge and skills based on short, easily created, multiple-choice tests, with little direct engagement from the faculty.

This article focuses on the assessment of entrepreneurship competence by selected vocational teachers in Italy. The exploratory research question addresses the extent to which entrepreneurship assessments are competence based, and the research seeks to identify fully fledged assessment programmes with both a formative and summative component, and the use of assessment rubrics. It also explores the extent to which entrepreneurship competence is referred to in school documentation and later assessed, and the tools and strategies used for such assessment.

This case study is part of a larger European research project promoted by Cedefop; in Italy it focused on six selected vocational IVET and CVET programmes and apprenticeship schemes. It used a wide range of instruments to ensure triangulation and multiple perspectives: analysed policy documents and undertook online interviews with experts and policy makers. At VET providers' premises it deployed: analysis of school documents; observations of learning environments; interviews and focus groups with (in schools) teachers, directors and vice directors, learners and alumni (in companies) instructors, company tutors and employers, apprentices and alumni.

Assessment tasks were rarely embedded within fully fledged assessment programmes involving both formative and summative tasks, and assessment rubric for grading. Most of the time, entrepreneurship programmes lacked self-assessment, peer assessment and structured feedback and did not involve learners in the assessment process. Some instructors coached the students, but undertook no clear formative assessment. These findings suggest institutions have a testing culture with regard to assessment, at the level of both policy and practice. In most cases, entrepreneurship competence was not directly assessed, and learning outcomes were only loosely related to entrepreneurship.

One limitation concerned the selection of the VET providers: these were chosen not on a casual basis, but because they ran programmes that were relevant to the development of entrepreneurship competence.

At the policy level, there is a need for new guidelines on competence development and assessment in VET, guidelines that are more aligned with educational research on competence development. To ensure the development of entrepreneurship competence, educators need in-service training and a community of practice.

So far, the literature has concentrated on entrepreneurship education at the tertiary level. Little is known about how VET instructors assess entrepreneurship competence. This study updates the picture of policy and practice in Italy, illustrating how entrepreneurship competence is developed in selected IVET and CVET programmes and apprenticeships.

This article presents our experience in implementing the assessment for learning process (AfL) to enhance the teaching–learning quality, which has faced numerous challenges impacting educational quality. The effectiveness of this technique is demonstrated through a case study conducted in a core course of chemical engineering.

The article shares insights into the systematic course design and planning processes that were discussed and developed through AfL practices. Significant emphasis is placed on implementing formative and summative student self-assessment surveys as simple yet effective methods to meet this purpose. Quantitative data were collected and analyzed over three consecutive academic years (2020–2022) using various statistical parameters such as percentage, interquartile range and the program’s numerical goal (%G).

The AfL process via formative and summative surveys could significantly and effectively improve teaching–learning quality. These findings assist educators in identifying appropriate teaching methods and recognizing areas of weakness and strength, thereby facilitating continuous improvement in the teaching–learning quality. Validation methods, including quizzes and numerical grades, were employed to practically verify the outcome obtained from the questionnaires.

The AfL techniques demonstrated in this study can be directly implemented or adapted for various educational fields to enhance the teaching–learning quality.

The practical implementation of AfL in an engineering context has hardly been reported, particularly in chemical engineering. This work represents the practical implementation of AfL to enhance engineering field education.

The study explored various dimensions of overconfidence bias (OB) among retail investors in Indian financial markets. Further, these dimensions were validated through formative assessments for OB.

The study applied exploratory factor analysis (EFA) to 764 respondents to explore dimensions of OB. These were validated with formative assessments on 489 respondents by the partial least square path modeling (PLS-PM) approach in SmartPLS 4.0 software.

The major findings of EFA explored four dimensions for OB, i.e. accuracy, perceived control, positive illusions and past investment success. The formative assessments revealed that positive illusions followed by past investment success among retail investors played an instrumental role in orchestrating the OBs that affect investment decisions in financial markets.

The formative index of OB has several practical implications for registered financial and investment advisors, bank advisors, business media companies and portfolio managers, besides individual investors in the domain of behavioral finance.

This research provides a novel approach to provide a formative index of OB with four dimensions. This formative index can acts as an overview for upcoming researchers to investigate the OB of retail individual investors.

1. Overconfidence bias is an important predictor of retail investors' behavior

2. Formative dimensions of the overconfidence bias index.

3. Accuracy, perceived control, positive illusions and past investment success are important dimensions of overconfidence bias.

4. Modern portfolio theory and illusion of control theory support this study.

Overconfidence bias is an important predictor of retail investors' behavior

Formative dimensions of the overconfidence bias index.

Accuracy, perceived control, positive illusions and past investment success are important dimensions of overconfidence bias.

Modern portfolio theory and illusion of control theory support this study.

In higher education, the usual assessment methods are oral or written exams, multiple-choice questions, and individual or group written essays. However, in a distance learning context, it is often necessary to offer students more support, including formative assessment and self-assessment strategies. International reports have shown that teachers have adapted their learning assessment strategies during the Covid-19 pandemic. How did educators adapt their assessment strategies recently during the pandemic? What are the intentions underlying their decision-making? Our objective is to understand the decision-making process of teacher educators and university teachers in adapting their methodology for assessing student learning during the pandemic. To answer these questions, we adopted a qualitative research approach. We collected data from 29 different countries via: (1) open-ended questionnaires, (2) personal accounts, (3) unstructured interviews, and (4) a specific questionnaire about assessment. Four main categories emerged from our data: (1) challenges, (2) assessment practices, (3) changes in teachers' perceptions and practices, and (4) reflection on assessment. The findings suggest that (1) uses of technology for assessment have developed strongly; (2) careful coordination among colleagues is very important; (3) educators developed formative assessment strategies; and (4) educators' reflections have focused on many challenges: ethical, technical, and pedagogical.

The purpose of this paper is to illuminate for social studies teachers and teacher educators the ways in which students' disciplinary writing is scaffolded within the context of the inquiry design model; trends in such scaffolding are called “the learner's pathway,” since it leads students to more abstract levels of historical argumentation. The author argues that engaging historical writing genres is a necessary component of historical thinking and that understanding the ways that teachers support students' historical writing capacities can help them to make more intentional choices when building inquiries.

To study genre-related scaffolding across inquiries, this study draws on systemic functional linguistics (SFL)-based genre theory as an analytical structure and seventy-four history-focused secondary social studies inquiries to determine any patterns in the ways that teachers scaffold students' writing genres through an inquiry.

Findings suggest that there is a learner's pathway that teachers use to develop students' argumentative writing capacities; however, there is also evidence to suggest that notetaking and source synthesis are not valued instructional products, limiting the potential impact of historical thinking work within the inquiry process.

The existence of this learner's pathway has implications for the ways that teachers and preservice teachers can be professionally developed to leverage this pathway. Rather than the often-used methods of support students' generic writing capacities, professional development should focus on the ways social studies teachers can guide students to more abstract reasoning through their writing. This study's findings also have implications for the ways that social studies teachers assess students' summative arguments. Assessment practices should focus on the genre-features of “argument” rather than just the stages of the argumentative essay.

This piece is original because genre-based research is missing from much of the social studies education research. This study's findings present an additional paradigm through which social studies teachers and teacher leaders can explore the purposes of historical writing tasks and assessment.

Lack of appropriate student support and drawbacks in academic progression signify the importance of enhancing assessment and feedback in higher education (HE). Although assessment and feedback are significant in HE, minimal empirical research holistically explores the best practices. This study aims to address the niche and develop a decisive guideline for enhancing assessment setting and feedback provision within HE curricula.

A systematic approach was taken to obtain data for the study: a literature review underpinning the thematic content analysis of study documents, followed by semi-structured interviews. Document analysis contained mid-module reviews/student feedback; rubrics used in assessment; and formative/summative feedback provided for the graded work. Documental analysis informed the key attributes of the semi-structured interview. Interpretive structural modelling (ISM) analysis identified the influence and reliance of each driver.

This study revealed 15 drivers – 4 fundamental, 6 significant and 5 important – for enhancing assessment and feedback. The level partitioning from the ISM analysis established that all assessment and feedback needs to be underpinned by the university policy and fed into the assessment regime and marking scheme. This study identified that National Student Survey results were significantly improved due to implementing said drivers compared with the national and sector benchmarks.

The developed drivers enable the best practices in assessment setting and feedback provision. The level partition diagram can be used as a decisive guideline or a provisional framework in assessment and feedback provision for quality assurance in HE.

This study is one of, if not the only, to develop a guideline for signposting drivers and their influence and reliance to enhance assessment and feedback in a holistic HE setting. The developed drivers and the level partition diagram bring novelty and add to the current body of knowledge.

The purpose of this paper is to explore more agile and effective learning processes that help identify potentially high-performing staff during workplace training.

To test the efficacy of the learning-oriented assessment (LOA) process in workplace training, a pharmaceutical sales organization implemented an online training over three months that was modeled with the LOA process. During work hours, employees within the organization took two tests (one before and after training) as well as participated in training with essential work-related content, where they were given problem sets and scenarios to complete that would vary based on their responses. Their assessment scores, formative learning behaviors and quarterly revenue were recorded to determine the effects of the training.

The outcome of this study supported the theory that the LOA model would facilitate the acquisition and application of knowledge differentially between employees of the organization, and this knowledge would serve to improve the performance of the employees to the extent that it increased revenue.

This study was a field experiment that did not allow for the control of possible confounds. However, the real-world real people outcomes provide novel insights on best practices in workplace training.

The findings of this study showed the short-term effectiveness of the LOA process in professional knowledge acquisition and application in relevant skills that increase organizational revenue.

This study provides an applied understanding on the applicability of the LOA process in workplace learning and training which has not been previously investigated.

The purpose of this study was to ascertain the relationship between EFL teachers' perception of the intended and unintended consequences of formative assessment (FA) decisions and their sense of self-efficacy and anxiety toward data-driven decision-making (DDDM).

A correlational research design and correlational/regression analysis was utilized to conduct this study. In addition, a thematic analysis was conducted of participants' responses to the open-ended questions.

Descriptive statistics suggest that most EFL teachers perceived both intended and unintended consequential validity of their FA decisions with a moderate level of DDDM self-efficacy and a low level of anxiety. The results of the correlational analysis indicated a strong positive relationship indicating that those with higher teachers' perceptions of consequential validity of formative assessment (TPCVFA) scores tended to report higher DDDM efficacy. The results of the correlational analysis also indicated that a significant relationship did not exist between TPCVFA scores and DDDM anxiety. Finally, multiple regression analyses revealed that TPCVFA was a significant predictor of DDDM efficacy; however, TPCVFA was not a significant predictor of DDDM anxiety.

Data collected from 114 Iranian EFL teachers using the Data-Driven Decision-Making Efficacy and Anxiety Inventory (3D-MEA, Dunn et al. 2013a) and the TPCVFA questionnaire, which was self-developed and validated for the current study.