Search results

The field of website quality evaluation attracts the interest of a range of disciplines, each bringing its own particular perspective to bear. This study aims to identify the main characteristics – methods, techniques and tools – of the instruments of evaluation described in this literature, with a specific concern for the factors analysed, and based on these, a multipurpose model is proposed for the development of new comprehensive instruments.

Following a systematic bibliographic review, 305 publications on website quality are examined, the field's leading authors, their disciplines of origin and the sectors to which the websites being assessed belong are identified, and the methods they employ characterised.

Evaluations of website quality tend to be conducted with one of three primary focuses: strategic, functional or experiential. The technique of expert analysis predominates over user studies and most of the instruments examined classify the characteristics to be evaluated – for example, usability and content – into factors that operate at different levels, albeit that there is little agreement on the names used in referring to them.

Based on the factors detected in the 50 most cited works, a model is developed that classifies these factors into 13 dimensions and more than 120 general parameters. The resulting model provides a comprehensive evaluation framework and constitutes an initial step towards a shared conceptualization of the discipline of website quality.

Incorporating flipped learning (FL) into teaching English as a foreign language may improve student learning outcomes. This study gathered information on Saudi EFL teachers' readiness and willingness to apply FL. So, it aims to describe Saudi EFL teachers' readiness and willingness to apply FL in language classrooms and to find suitable guidelines for Saudi EFL professional development (PD) designers to follow.

This descriptive study involved 153 male and female Saudi EFL teachers as participants, investigating the perspectives and perceptions of these teachers within the context of foreign language teaching in Saudi Arabia. Surveys in Qualtrics were employed as the primary data collection tool for the study.

Results showed that teachers' self-efficacy of their current teaching was high. Most participants had positive attitudes and abilities related to FL, although they also identified potential challenges related to its engagement and assessment. Teachers expressed a strong willingness to participate in PD in this area, with a preference for online videos and group workshops.

The study emphasizes the importance of PD for Saudi EFL teachers. In addition, it offers guidelines for planning effective PD.

To elaborate the nature of fact-checking in the domain of political information by examining how fact-checkers assess the validity of claims concerning the Russo-Ukrainian conflict and how they support their assessments by drawing on evidence acquired from diverse sources of information.

Descriptive quantitative and qualitative content analysis of 128 reports written by the fact-checkers of Snopes – an established fact-checking organisation – during the period of 24 February 2022 – 28 June, 2023. For the analysis, nine evaluation grounds were identified, most of them inductively from the empirical material. It was examined how the fact-checkers employed such grounds while assessing the validity of claims and how the assessments were bolstered by evidence acquired from information sources such as newspapers.

Of the 128 reports, the share of assessments indicative of the invalidity of the claims was 54.7%, while the share of positive ratings was 26.7%. The share of mixed assessments was 15.6%. In the fact-checking, two evaluation grounds, that is, the correctness of information and verifiability of an event presented in a claim formed the basis for the assessment. Depending on the topic of the claim, grounds such as temporal and spatial compatibility, as well as comparison by similarity and difference occupied a central role. Most popular sources of information offering evidence for the assessments include statements of government representatives, videos and photographs shared in social media, newspapers and television programmes.

As the study concentrated on fact-checking dealing with political information about a specific issue, the findings cannot be extended to concern the fact-checking practices in other contexts.

The study is among the first to characterise how fact-checkers employ evaluation grounds of diverse kind while assessing the validity of political information.

Key to transnational higher education (HE) cooperation is building trust to allow for seamless recognition of studies. Building on the Tuning Educational Structures initiative (2001) and lessons learnt from the Organisation for Economic Cooperation and Development (OECD)-Assessment of Learning Outcomes in Higher Education (AHELO) feasibility study, this paper offers a sophisticated approach developed by the European Union (EU)-co-financed project Measuring and Comparing Achievements of Learning Outcomes in Europe (CALOHEE). These evidence the quality and relevance of learning by applying transparent and reliable indicators at the overarching and disciplinary levels. The model results allow for transnational diagnostic assessments to identify the strength and weaknesses of degree programmes.

The materials presented have been developed from 2016 to 2023, applying a bottom-up approach involving approximately 150 academics from 20+ European countries, reflecting the full spectrum of academic fields. Based on intensive face-to-face debate and consultation of stakeholders and anchored in academic literature and wide experience.

As a result, general (overarching) state-of-the-art reference frameworks have been prepared for the associated degree, bachelor, master and doctorate, as well as aligned qualifications reference frameworks and more detailed learning outcomes/assessment frameworks for 11 subject areas, offering a sound basis for quality assurance. As a follow-up, actual assessment formats for five academic fields have been developed to allow for measuring the actual level of learning at the institutional level from a comparative perspective.

Frameworks as well as assessment models and items are highly innovative, content-wise as in the strategy of development, involving renown academics finding common ground. Its value is not limited to Europe but has global significance. The model developed, is also relevant for micro-credentials in defining levels of mastery.

While known by many names, qualifying exams function as gatekeepers to graduate student advancement to PhD candidacy, yet there has been little formal study on best qualifying exam practices particularly in biomedical and related STEM PhD programs. The purpose of this study is to examine the current state of qualifying exams through an examination of the literature and exploration of university-wide policies.

The authors conducted a literature review of studies on qualifying exams and completed an external evaluation of peer institutions’ and internal institutional qualifying exam requirements to inform our discussion of qualifying exams practices in PhD training at a research-intensive US institutions.

This study identified the need for more research on qualifying exams to establish evidence-based best practices. The authors found a wide variety of qualifying exam formats, with little evidence in support for specific formats. The authors also found little evidence that student expectations are made clear. The lack of evidence-based best practices coupled with insufficient clarity for students has a real potential to disadvantage PhD students, particularly first generation, underrepresented minority, international and/or other trainees who are not privileged or socialized to navigate training environments with vague landmarks such as the qualifying exams.

There are very few studies that evaluate qualifying exams in US doctoral education, particularly in STEM fields, and to the authors’ knowledge, there has been no analysis of campus-wide policies on qualifying exams reported. The lack of evidence for best practices and the need for to evaluate the implementation and effectiveness of qualifying exams are discussed.

This paper studies the interactive valuation discourses of an online user community (transfermarkt.de) that seeks to determine market values for soccer players. Despite their seemingly casual nature, these values have featured in newspapers, transfer negotiations, academic research, and capital market communication – and have thus become reified.

The paper employs netnographic research methodology to collect and thematically analyze a wide range of user entries on the platform. These entries are studied using theoretical insights from the sociology of quantification and valuation.

The analysis reveals how values are constructed in constant interaction between value-proposing users and value-justifying “experts.” This dynamic form of relational valuation positions players relative to one another as well as to actual transactions on the transfer market. In the absence of authoritative guidelines, it is this possibility and affordance for interaction that enacts a coherent valuation regime. The paper further reveals the platform's response to a disruptive event, which risked bringing the user-expert dynamics to a halt, requiring intervention from the platform to repair its valuation frame.

The paper responds to increased scholarly interests in the valuation of professional athletes. It contributes to the extant literature on valuation, first, by analyzing the dynamic valuation work that feeds into the social construction of values and, second, by studying platform participation and user interaction in a socially engineered online space.

This article aims to elaborate the context-sensitive nature of credibility assessment by examining how such judgments are made in online discussion in times of uncertainty caused by Finland's intent to join the North Atlantic Treaty Organization (NATO) in spring 2022.

The empirical findings draw on the qualitative content analysis of 3,324 posts submitted to a Finnish online discussion in February–March 2022. It was examined how the participants of online discussion assess the credibility of information sources referred to in debates on the NATO membership. It is assumed that the believability of the author of information is indicative of his or her expert power, for example based on the credentials of a scholar, while the credibility of information content, for example the provision of factual evidence is indicative of the source's informational power.

Political decision-makers, particularly the President of Finland were assessed as most credible information sources, due to their access to confidential knowledge and long-time experience in politics. The credibility assessments differed more strongly while judging the believability of researchers. On the one hand, their expertise was praised; on the other hand, doubts were presented about their partiality. Fellow participants of online discussion were assessed most negatively because information sources of these types are associated with low expert and informational power.

As the study concentrated on credibility assessments made in a Finnish online discussion group, the findings cannot be extended to concern the credibility judgments occurring information in other contexts.

The study is among the first to characterize the role of expert and informational power in credibility assessment in times of uncertainty.

This study aims to explore how an accessibility database (AD) has been developed and implemented as a tool for facility managers to evaluate and increase the accessibility of public facilities.

Eight participants were strategically sampled for semi-structured interviews, and documents on the AD were gathered. The Consolidated Framework for Implementation Research (CFIR) was used for a directed content analysis of the data. The CFIR domains used for the analysis were: intervention characteristics, outer setting, inner setting, characteristics of individuals and process.

The development and implementation of the AD demonstrated the complexity in assessing and planning for increased accessibility. The communication and iterative processes within the inner as well as with the outer setting was an important part of the development and implementation, as well as anchoring each step locally, regionally and nationally, within public authorities and disability organizations.

The assessments of environmental barriers and the results reported in the AD can serve as a guide for identification of accessibility issues. However, singular identified barriers were reported as a fragmentation of the building regulations, and thereby when retrofitting is carried out, experts who have the competence to suggest solutions based on the entirety need to be involved to reach the goals of increased accessibility and countering of exclusion and discrimination.

By structuring the implementation process by means of the CFIR, facilitators and barriers of using an AD as a basis for retrofitting were revealed. The practical challenges outlined in assessing and increasing accessibility can guide facility managers when considering actions to increase accessibility.

This article focuses on the assessment of entrepreneurship competence by selected vocational teachers in Italy. The exploratory research question addresses the extent to which entrepreneurship assessments are competence based, and the research seeks to identify fully fledged assessment programmes with both a formative and summative component, and the use of assessment rubrics. It also explores the extent to which entrepreneurship competence is referred to in school documentation and later assessed, and the tools and strategies used for such assessment.

This case study is part of a larger European research project promoted by Cedefop; in Italy it focused on six selected vocational IVET and CVET programmes and apprenticeship schemes. It used a wide range of instruments to ensure triangulation and multiple perspectives: analysed policy documents and undertook online interviews with experts and policy makers. At VET providers' premises it deployed: analysis of school documents; observations of learning environments; interviews and focus groups with (in schools) teachers, directors and vice directors, learners and alumni (in companies) instructors, company tutors and employers, apprentices and alumni.

Assessment tasks were rarely embedded within fully fledged assessment programmes involving both formative and summative tasks, and assessment rubric for grading. Most of the time, entrepreneurship programmes lacked self-assessment, peer assessment and structured feedback and did not involve learners in the assessment process. Some instructors coached the students, but undertook no clear formative assessment. These findings suggest institutions have a testing culture with regard to assessment, at the level of both policy and practice. In most cases, entrepreneurship competence was not directly assessed, and learning outcomes were only loosely related to entrepreneurship.

One limitation concerned the selection of the VET providers: these were chosen not on a casual basis, but because they ran programmes that were relevant to the development of entrepreneurship competence.

At the policy level, there is a need for new guidelines on competence development and assessment in VET, guidelines that are more aligned with educational research on competence development. To ensure the development of entrepreneurship competence, educators need in-service training and a community of practice.

So far, the literature has concentrated on entrepreneurship education at the tertiary level. Little is known about how VET instructors assess entrepreneurship competence. This study updates the picture of policy and practice in Italy, illustrating how entrepreneurship competence is developed in selected IVET and CVET programmes and apprenticeships.

The gap that this research attempts to fill is to analyse the explanatory factor “industry” when assessing the reputation of a corporate group. In other words, this research attempts to demonstrate the impact of the “industrial halo” on the assessment of corporate reputation, given that, to date, the academic literature has not considered industry as an explanatory variable in the assessment of the reputation of private companies.

A sample of 43 Spanish companies was used to analyse the relationship between the reputation of firms as measured by the Merco Empresas index, and the industries to which they belong, after controlling for company performance, size, turnover, public recognition of their leadership, and corporate responsibility. This involved conducting a cross-sectional analysis of the relationship between the variables for each year in the time period from 2005 to 2016. The available data were taken from the firms' annual financial reports and websites, as well as from the Merco.

The paper shows the existence of industrial halos that account for the corporate reputation of businesses in Spain. It is also shown that industrial halos are not permanent over time, and that they tend to occur in years of crisis.

It would have been desirable for this study to have had sufficient data to include other industries, but this was not possible. As for possible extensions, in addition to expanding the period considered, other analytical techniques, such as panel data models, could be applied to allow comparison with the results obtained here.

The results of this study have some practical implications. Firstly, firms that publish corporate reputation rankings should be aware of the distortion that the industrial halo can produce, especially in times of uncertainty, and seek to correct for it in their measurements. And secondly, corporate groups themselves should assume that the reputation of the industry affects their individual reputation, and consequently, they should see the other companies in the industry not only as competitors but also as “reputational allies”. They should therefore make collective efforts to improve in this respect, especially in the face of reputational crises.

This paper provides a better understanding of the relationship between the reputation of a company and the industry to which it belongs, and of its permanence over time. This relationship has been little studied in the Spanish market to date.

本研究擬分析當企業集團的信譽被評估時的解釋性因素-行業,以填補現時的研究缺口。具體來說,研究人員鑒於學術文獻至今仍未於評估私營企業的信譽時、把行業當作是一個解釋變量來看待,故擬進行研究、以顯示行業光環在評估企業信譽時所產生的影響。

研究使用的樣本為43間西班牙公司。研究人員分析以Merco Empresas 指數來測量的公司信譽與公司所屬行業之間的關係。有關的分析調控了公司的業績、規模、營業額、企業責任、以及企業領導能力的公眾認可程度所帶來的影響。研究人員對有關變量間的關係進行橫向分析 分析於2005年至2016年期間年度性地進行。現有數據取自有關公司的年度財務報表和其網站,也有取自Merco的。

研究結果表明了可解釋西班牙企業信譽的行業光環是存在的。研究結果亦顯示、行業光環不是永恆的,而且,行業光環往往會在營運極其困難的年度內出現。

本文讓我們更深入瞭解公司信譽與公司所屬行業之間的關係,以及其在時間上的永恆性。就這相關的關係而言,探討西班牙市場的研究至今為數不多。