Search results

1 – 10 of over 126000
To view the access options for this content please click here
Article

Mengni Zhang, Can Wang, Jiajun Bu, Liangcheng Li and Zhi Yu

As existing studies show the accuracy of sampling methods depends heavily on the evaluation metric in web accessibility evaluation, the purpose of this paper is to propose…

Abstract

Purpose

As existing studies show the accuracy of sampling methods depends heavily on the evaluation metric in web accessibility evaluation, the purpose of this paper is to propose a sampling method OPS-WAQM optimized for Web Accessibility Quantitative Metric (WAQM). Furthermore, to support quick accessibility evaluation or real-time website accessibility monitoring, the authors also provide online extension for the sampling method.

Design/methodology/approach

In the OPS-WAQM method, the authors propose a minimal sampling error model for WAQM and use a greedy algorithm to approximately solve the optimization problem to determine the sample numbers in different layers. To make OPS-WAQM online, the authors apply the sampling in crawling strategy.

Findings

The sampling method OPS-WAQM and its online extension can both achieve good sampling quality by choosing the optimal sample numbers in different layers. Moreover, the online extension can also support quick accessibility evaluation by sampling and evaluating the pages in crawling.

Originality/value

To the best of the authors’ knowledge, the sampling method OPS-WAQM in this paper is the first attempt to optimize for a specific evaluation metric. Meanwhile, the online extension not only greatly reduces the serious I/O issues in existing web accessibility evaluation, but also supports quick web accessibility evaluation by sampling in crawling.

Details

Internet Research, vol. 27 no. 5
Type: Research Article
ISSN: 1066-2243

Keywords

To view the access options for this content please click here

Abstract

Details

Automated Information Retrieval: Theory and Methods
Type: Book
ISBN: 978-0-12266-170-9

To view the access options for this content please click here
Article

Monireh Gharibe Niazi, Masumeh Karbala Aghaei Kamran and Amir Ghaebi

This study aims to design a proposed framework for evaluating university websites.

Abstract

Purpose

This study aims to design a proposed framework for evaluating university websites.

Design/methodology/approach

This study is an exploratory mixed research. It was an applied research in terms of objective and used the Delphi technique and systematic review and meta-analysis approaches. Data collection tools were done through library studies, Delphi checklist and observation. The statistical population of the research comprised 17 experts who are designers of university websites and 20 Iranian university websites selected from the Webometrics website. The statistical data were analyzed using fuzzy methods, descriptive and inferential statistical methods and the SWARA weighting method. Also, the statistical analysis software SPSS 20 and Excel 2016, TOPSIS engineering software and MAXQDA were used.

Findings

Findings indicated that the dimensions of the designed proposed framework in order of their weights are credibility (0.130), reliability (0.125), usability (0.120), website design (0.110), functionality (0.104), content (0.100), page design (0.0922), efficiency (0.082), Webometrics (0.070) and systematic evaluation (0.067). Mebrate’s (2010) framework had the highest overlap (mean = 74.65), and Webometrics (mean = 18.5) had the least overlap and dependency (mean = 19) with the proposed framework. In the evaluation of the 20 university websites of Iran selected from the Webometrics site, the University of Tehran was ranked first with a score of 82.7 and Shiraz University was ranked last with a score of 75.

Originality/value

This study provides a comprehensive proposed framework for evaluating university websites that eliminates the shortcomings of all models, frameworks and methods of university website evaluation that focused only on one or more dimensions of university websites.

Details

The Electronic Library , vol. 38 no. 5/6
Type: Research Article
ISSN: 0264-0473

Keywords

To view the access options for this content please click here
Article

Mohammad Hassanzadeh and Fatemeh Navidi

This paper aims to provide knowledge about methods used to evaluate the accessibility of Iranian web sites through a real research environment.

Abstract

Purpose

This paper aims to provide knowledge about methods used to evaluate the accessibility of Iranian web sites through a real research environment.

Design/methodology/approach

The main theoretical base of this article is that almost all research conducted to evaluate the accessibility of web sites has used only one of three methods (namely manual, automatic and users' experiences). However, it seems that using a combination of these three methods is actually necessary. Consequently, taking a critical approach this article examines 18 Iranian ministerial web sites using the three methods.

Findings

Findings in both documents and evaluative studies show that each of the methods has deficits and it is necessary to employ a combination of the methods in order to conduct a reliable accessibility assessment. The different rankings of ministerial web sites in various evaluations have confirmed this view.

Originality/value

Identifying the advantages and disadvantages of the three methods and employing them in real research environments to assess the accessibility of ministerial web sites has been a useful exercise. The work can not only be a starting point for further discussions on the reliability of accessibility evaluation methods, but can also be applied to other types of web site.

Details

The Electronic Library, vol. 28 no. 6
Type: Research Article
ISSN: 0264-0473

Keywords

To view the access options for this content please click here
Article

Nektarios Kostaras, Dimitris Stavrinoudis, Stavroula Sokoli and Michalis Xenos

The purpose of this paper is to present a methodology combining experimental and inquiry methods used for software usability evaluation. The software product of LeViS…

Abstract

Purpose

The purpose of this paper is to present a methodology combining experimental and inquiry methods used for software usability evaluation. The software product of LeViS project funded by the European Commission (Socrates/Lingua II) is used as an evaluation paradigm. The aim of the paper is twofold: to present the results of the usability evaluation using this software as an example and to suggest a number of improvements for the next version of the software tool; and to portray the advantages of combining methods from different evaluation approaches and the experiences from their application.

Design/methodology/approach

The evaluation for this experiment combined different usability methods, both experimental and inquiry ones. More specifically, the methods employed were the Thinking Aloud Protocol and the User Logging, which were performed in a usability evaluation laboratory, as well as the inquiry methods of Interview and Focus Group.

Findings

In this study, usability problems regarding the Learning via Subtitling (LvS) educational software were revealed as well as issues regarding the use of Thinking Aloud Protocol method and involving users with a specific profile. The research findings presented in this paper constitute an innovative and effective methodology for software usability evaluation and are useful for laboratories aiming to conduct similar evaluations.

Research limitations/implications

Although this methodology has been successfully applied for over 20 software products, due to practical purposes related to this paper's extent, only one software is used as an example.

Originality/value

Through the evaluation process, apart from discovering certain usability problems related to the software, there are a number of important conclusions drawn, regarding the methods used and the methodology followed in software usability evaluation.

Details

Journal of Systems and Information Technology, vol. 12 no. 2
Type: Research Article
ISSN: 1328-7265

Keywords

To view the access options for this content please click here
Article

Anthony Afful-Dadzie, Eric Afful-Dadzie, Stephen Nabareseh and Zuzana Komínková Oplatková

The purpose of this paper is to propose a new assessment methodology for the African Peer Review Mechanism (APRM) using fuzzy comprehensive evaluation method (FCEM) and…

Abstract

Purpose

The purpose of this paper is to propose a new assessment methodology for the African Peer Review Mechanism (APRM) using fuzzy comprehensive evaluation method (FCEM) and the Delphi technique. The proposed approach by its design simplifies the review processes and also quantifies the outcome of the assessment result for easier interpretation and benchmarking among member countries. The proposed hybrid method demonstrates how the subjective APRM thematic areas and their objectives can be efficiently tracked country by country while addressing the key identified challenges.

Design/methodology/approach

Using a numerical example, a demonstration of how the APRM assessment could be carried is shown using the FCEM and the Delphi method. The APRM's own thematic areas are used as the evaluation factors and the weights are assigned using Delphi technique. A novel remark set is constructed to linguistically describe the performance of a country against each or all of the thematic areas. Then in line with the maximum membership degree principle, the position of the maximum number would correspond to its respective remark element to indicate the level of performance.

Findings

The result shows a hybrid method of FCEM and Delphi used to determine whether a member country has “achieved”, “on track”, “very likely to be achieved”, “possible if some changes are made” or “off-track” on the four focus areas of the APRM. The method provides a well-organized way of tracking progress of member countries. It is also an ideal method of tracking progress of individual thematic areas and objectives. Moreover, the simplicity of the proposed method, the preciseness of the final result it generates and the clear interpretation of the result makes it a stronger alternative to the current approach for assessing member countries.

Practical implications

The APRM is a respected body with the backing of the heads of state in Africa. As most African countries become conscious of the pressure to meet international standards as far as governance performance is concerned, this proposed assessment methodology if adopted would go a long way in improving performance evaluation on the continent.

Originality/value

The proposed methodology is unique in its simplicity and its ability to evaluate any of the APRM thematic areas independent of the others. This means an overall performance can be tracked as well as that of individual evaluation factors.

To view the access options for this content please click here
Article

Wende Zhang

The paper aims to focus on the needs of the digital library.

Abstract

Purpose

The paper aims to focus on the needs of the digital library.

Design/methodology/approach

Digital library intellectual property right evaluation and method, application scope of commonly used methods, and digital library copyright evaluation and method are analyzed and discussed in the paper.

Findings

The paper finds that, for the electronic resources, the number of copiers, the term of usage, quantity of information, copyright, and the contract with authors should be considered; for technologies used in the digital library, the evaluation should cover the novelty, inventiveness, usefulness, and the access mode. In addition, the quantitative and qualitative should be combined with experience to evaluate virtual library resources and actual resources with stable right of use.

Originality/value

The paper provides recommendations on digital library intellectual property rights evaluation and methods.

Details

The Electronic Library, vol. 25 no. 3
Type: Research Article
ISSN: 0264-0473

Keywords

To view the access options for this content please click here
Article

Peng Li and Cuiping Wei

In multi-criteria decision-making with interval grey number information, decision makers usually take a risk to rank or choose some very similar alternatives…

Abstract

Purpose

In multi-criteria decision-making with interval grey number information, decision makers usually take a risk to rank or choose some very similar alternatives. Additionally, when evaluating only one alternative, decision makers can only obtain a specific value using traditional decision-making methods and may find it hard to cluster the alternatives to the “correct class” because these methods lack predetermined reference points. To overcome this problem, this paper aims to propose a two-stage grey decision-making method.

Design/methodology/approach

First, a new type of clustering method for interval grey numbers is designed by proposing a new possibility function for grey numbers. Based on this clustering method, a new grey clustering evaluation model for interval grey numbers is proposed by which decision makers can obtain the grade rating information of each alternative. Then, according to the grey clustering evaluation model, a new two-stage decision-making method is introduced to solve the problem that some alternatives are very similar by designing a grey comprehensive decision coefficient of alternatives.

Findings

The authors propose a new grey clustering evaluation model to deal with interval grey numbers. They design a new model to obtain the membership degree for the interval grey numbers and then propose a new grey clustering evaluation model, which can evaluate only one alternative by predefined grey classes. Then, by the grey comprehensive decision coefficient, a two-stage grey evaluation decision-making method is put forward to solve the problem that some alternatives are very close and hard to be distinguished.

Originality/value

A new grey clustering evaluation model is proposed, which can evaluate only one alternative by predefined grey classes. A two-stage grey evaluation decision-making method is given to solve the problem that some alternatives are very close and hard to be distinguished.

Details

Kybernetes, vol. 47 no. 4
Type: Research Article
ISSN: 0368-492X

Keywords

To view the access options for this content please click here
Article

Saleh Fahed Alkhatib, Robert Darlington and Trung Thanh Nguyen

The purpose of this paper is to provide an insight to the outsourcing decision-making through investigating if the old evaluation/selection criteria and methods still fit…

Abstract

Purpose

The purpose of this paper is to provide an insight to the outsourcing decision-making through investigating if the old evaluation/selection criteria and methods still fit with current business priorities or not and, therefore, to identify the appropriate criteria and methods to develop a new selection framework. Since the economic recession of 2008, logistics outsourcing decisions have become more prominent to avoid high fixed costs and heavy investment requirements and to achieve competitive advantages.

Design/methodology/approach

This is a focused literature review prepared after analyzing 56 articles related to the logistics service provider (LSP) evaluation and selection methods and criteria during 2008-2013. The academic articles are analyzed based on research focus/area, evaluation and selection methodology/methods and evaluation and selection criteria. Then reviewed result is compared with previous literature studies for the periods (1991-2008) to identify any possible shifts.

Findings

The review reveals that: several problems in current LSPs literature have been identified; the reviewed papers can be categorized into seven groups, the usage and importance of evaluation and selection criteria fluctuate during different periods; 12 crucial criteria have been identified, increasing the importance of specific selection methods and the integrated models and fuzzy logic in logistics literature. Then, a comprehensive LSPs’ evaluation and selection framework has been developed.

Originality/value

To the best of our knowledge, this is the first focused logistics outsourcing study that reviews the 2008-2013 period in detail, comparing results with previous literature studies, identifies current LSPs literature problems/gaps, new trends and shifts in the way that LSPs are evaluated and selected, identifies crucial selection criteria and proposes a new holistic LSPs evaluation and selection framework. In addition, it identifies important issues for future research.

Details

Strategic Outsourcing: An International Journal, vol. 8 no. 1
Type: Research Article
ISSN: 1753-8297

Keywords

To view the access options for this content please click here
Book part

Arch G. Woodside and Marcia Y. Sakai

A meta-evaluation is an assessment of evaluation practices. Meta-evaluations include assessments of validity and usefulness of two or more studies that focus on the same…

Abstract

A meta-evaluation is an assessment of evaluation practices. Meta-evaluations include assessments of validity and usefulness of two or more studies that focus on the same issues. Every performance audit is grounded explicitly or implicitly in one or more theories of program evaluation. A deep understanding of alternative theories of program evaluation is helpful to gain clarity about sound auditing practices. We present a review of several theories of program evaluation.

This study includes a meta-evaluation of seven government audits on the efficiency and effectiveness of tourism departments and programs. The seven tourism-marketing performance audits are program evaluations for: Missouri, North Carolina, Tennessee, Minnesota, Australia, and two for Hawaii. The majority of these audits are negative performance assessments. Similarly, although these audits are more useful than none at all, the central conclusion of the meta-evaluation is that most of these audit reports are inadequate assessments. These audits are too limited in the issues examined; not sufficiently grounded in relevant evaluation theory and practice; and fail to include recommendations, that if implemented, would result in substantial increases in performance.

Details

Evaluating Marketing Actions and Outcomes
Type: Book
ISBN: 978-0-76231-046-3

1 – 10 of over 126000