Search results

As existing studies show the accuracy of sampling methods depends heavily on the evaluation metric in web accessibility evaluation, the purpose of this paper is to propose a sampling method OPS-WAQM optimized for Web Accessibility Quantitative Metric (WAQM). Furthermore, to support quick accessibility evaluation or real-time website accessibility monitoring, the authors also provide online extension for the sampling method.

In the OPS-WAQM method, the authors propose a minimal sampling error model for WAQM and use a greedy algorithm to approximately solve the optimization problem to determine the sample numbers in different layers. To make OPS-WAQM online, the authors apply the sampling in crawling strategy.

The sampling method OPS-WAQM and its online extension can both achieve good sampling quality by choosing the optimal sample numbers in different layers. Moreover, the online extension can also support quick accessibility evaluation by sampling and evaluating the pages in crawling.

To the best of the authors’ knowledge, the sampling method OPS-WAQM in this paper is the first attempt to optimize for a specific evaluation metric. Meanwhile, the online extension not only greatly reduces the serious I/O issues in existing web accessibility evaluation, but also supports quick web accessibility evaluation by sampling in crawling.

In the supply chain disruption risk, the issue of supplier evaluation and selection is solved by an extended VIKOR method based on regret theory.

Considering the influence of irrational emotions of decision makers, an evaluation model is designed by the regret theory and VIKOR method, which makes the decision-making process closer to reality.

The paper has some innovations in the evaluation index system and evaluation model construction. The method has good stability under the risk of supply chain interruption.

The mixed evaluation information is used to describe the attributes, and the evaluation index system is constructed by the combined method of the social network analysis method and the literature research method to ensure the accuracy and accuracy of the extracted attributes. The issue of supplier evaluation and selection is solved by an extended VIKOR method based on regret theory.

This paper aims to provide knowledge about methods used to evaluate the accessibility of Iranian web sites through a real research environment.

The main theoretical base of this article is that almost all research conducted to evaluate the accessibility of web sites has used only one of three methods (namely manual, automatic and users' experiences). However, it seems that using a combination of these three methods is actually necessary. Consequently, taking a critical approach this article examines 18 Iranian ministerial web sites using the three methods.

Findings in both documents and evaluative studies show that each of the methods has deficits and it is necessary to employ a combination of the methods in order to conduct a reliable accessibility assessment. The different rankings of ministerial web sites in various evaluations have confirmed this view.

Identifying the advantages and disadvantages of the three methods and employing them in real research environments to assess the accessibility of ministerial web sites has been a useful exercise. The work can not only be a starting point for further discussions on the reliability of accessibility evaluation methods, but can also be applied to other types of web site.

The purpose of this paper is to present a methodology combining experimental and inquiry methods used for software usability evaluation. The software product of LeViS project funded by the European Commission (Socrates/Lingua II) is used as an evaluation paradigm. The aim of the paper is twofold: to present the results of the usability evaluation using this software as an example and to suggest a number of improvements for the next version of the software tool; and to portray the advantages of combining methods from different evaluation approaches and the experiences from their application.

The evaluation for this experiment combined different usability methods, both experimental and inquiry ones. More specifically, the methods employed were the Thinking Aloud Protocol and the User Logging, which were performed in a usability evaluation laboratory, as well as the inquiry methods of Interview and Focus Group.

In this study, usability problems regarding the Learning via Subtitling (LvS) educational software were revealed as well as issues regarding the use of Thinking Aloud Protocol method and involving users with a specific profile. The research findings presented in this paper constitute an innovative and effective methodology for software usability evaluation and are useful for laboratories aiming to conduct similar evaluations.

Although this methodology has been successfully applied for over 20 software products, due to practical purposes related to this paper's extent, only one software is used as an example.

Through the evaluation process, apart from discovering certain usability problems related to the software, there are a number of important conclusions drawn, regarding the methods used and the methodology followed in software usability evaluation.

This study aims to design a proposed framework for evaluating university websites.

This study is an exploratory mixed research. It was an applied research in terms of objective and used the Delphi technique and systematic review and meta-analysis approaches. Data collection tools were done through library studies, Delphi checklist and observation. The statistical population of the research comprised 17 experts who are designers of university websites and 20 Iranian university websites selected from the Webometrics website. The statistical data were analyzed using fuzzy methods, descriptive and inferential statistical methods and the SWARA weighting method. Also, the statistical analysis software SPSS 20 and Excel 2016, TOPSIS engineering software and MAXQDA were used.

Findings indicated that the dimensions of the designed proposed framework in order of their weights are credibility (0.130), reliability (0.125), usability (0.120), website design (0.110), functionality (0.104), content (0.100), page design (0.0922), efficiency (0.082), Webometrics (0.070) and systematic evaluation (0.067). Mebrate’s (2010) framework had the highest overlap (mean = 74.65), and Webometrics (mean = 18.5) had the least overlap and dependency (mean = 19) with the proposed framework. In the evaluation of the 20 university websites of Iran selected from the Webometrics site, the University of Tehran was ranked first with a score of 82.7 and Shiraz University was ranked last with a score of 75.

This study provides a comprehensive proposed framework for evaluating university websites that eliminates the shortcomings of all models, frameworks and methods of university website evaluation that focused only on one or more dimensions of university websites.

The purpose of this paper is to propose a new assessment methodology for the African Peer Review Mechanism (APRM) using fuzzy comprehensive evaluation method (FCEM) and the Delphi technique. The proposed approach by its design simplifies the review processes and also quantifies the outcome of the assessment result for easier interpretation and benchmarking among member countries. The proposed hybrid method demonstrates how the subjective APRM thematic areas and their objectives can be efficiently tracked country by country while addressing the key identified challenges.

Using a numerical example, a demonstration of how the APRM assessment could be carried is shown using the FCEM and the Delphi method. The APRM's own thematic areas are used as the evaluation factors and the weights are assigned using Delphi technique. A novel remark set is constructed to linguistically describe the performance of a country against each or all of the thematic areas. Then in line with the maximum membership degree principle, the position of the maximum number would correspond to its respective remark element to indicate the level of performance.

The result shows a hybrid method of FCEM and Delphi used to determine whether a member country has “achieved”, “on track”, “very likely to be achieved”, “possible if some changes are made” or “off-track” on the four focus areas of the APRM. The method provides a well-organized way of tracking progress of member countries. It is also an ideal method of tracking progress of individual thematic areas and objectives. Moreover, the simplicity of the proposed method, the preciseness of the final result it generates and the clear interpretation of the result makes it a stronger alternative to the current approach for assessing member countries.

The APRM is a respected body with the backing of the heads of state in Africa. As most African countries become conscious of the pressure to meet international standards as far as governance performance is concerned, this proposed assessment methodology if adopted would go a long way in improving performance evaluation on the continent.

The proposed methodology is unique in its simplicity and its ability to evaluate any of the APRM thematic areas independent of the others. This means an overall performance can be tracked as well as that of individual evaluation factors.

The paper aims to focus on the needs of the digital library.

Digital library intellectual property right evaluation and method, application scope of commonly used methods, and digital library copyright evaluation and method are analyzed and discussed in the paper.

The paper finds that, for the electronic resources, the number of copiers, the term of usage, quantity of information, copyright, and the contract with authors should be considered; for technologies used in the digital library, the evaluation should cover the novelty, inventiveness, usefulness, and the access mode. In addition, the quantitative and qualitative should be combined with experience to evaluate virtual library resources and actual resources with stable right of use.

The paper provides recommendations on digital library intellectual property rights evaluation and methods.

The purpose of this paper is to establish a maturity evaluation model for the application of construction steel structure welding robotics suitable for the actual situation and specific characteristics of engineering projects in China and then to assess the maturity level of the technology in the application of domestic engineering projects more scientifically.

The research follows a qualitative and quantitative analysis method. In the first stage, the structure of the maturity model is constructed and the evaluation index system is designed by using the ideas of the capability maturity model and WSR methodology for reference. In the second stage, the design of the evaluation process and the selection of evaluation methods (analytic hierarchy process method, multi-level gray comprehensive evaluation method). In the third stage, the data are collected and organized (preparation of questionnaires, distribution of questionnaires, questionnaire collection). In the fourth stage, the established maturity evaluation model is used to analyze the data.

The evaluation model established by using multi-level gray theory can effectively transform various complex indicators into an intuitive maturity level or score status. The conclusion shows that the application maturity of building steel structure welding robot technology in this project is at the development level as a whole. The maturity levels of “WuLi – ShiLi – RenLi” are respectively: development level, development level, between starting level and development level. Comparison of maturity evaluation values of five important factors (from high to low): environmental factors, technical factors, management factors, benefit factors, personnel and group factors.

In this paper, based on the existing research related to construction steel structure welding robot technology, a quantitative and holistic evaluation of the application of construction steel structure welding robot technology in domestic engineering projects is conducted for the first time from a project perspective by designing a maturity evaluation index system and establishing a maturity evaluation model. This research will help the project team to evaluate the application level (maturity) of the welding robot in the actual project, identify the shortcomings and defects of the application of this technology, then improve the weak links pertinently, and finally realize the gradual improvement of the overall application level of welding robot technology for building steel structure.

This paper improves the evaluation index system of green building operation effect and establishes the evaluation model of green building operation effect. It is expected to promote energy saving and emission reduction and provide a more scientific evaluation method for green building operation effect evaluation.

First, 20 key evaluation indexes are selected to establish the operation effective evaluation index system. Then, the combined weight method is proposed to determine the weight of each evaluation index. Next, the gray clustering-fuzzy comprehensive evaluation method is used to construct the green building operation effective evaluation model. Finally, the feasibility and validity of the selected model were verified by taking Shenzhen Bay One green building in Shenzhen as an example.

This paper establishes the evaluation system of green building operational effect, and evaluates green building from the angle of operational effect. Taking Shenzhen Bay One project as an example, the rationality and applicability of the model are verified.

In this paper, for the first time, relevant indexes of user experience are included in the evaluation system of green building operational effect, which makes the evaluation system more perfect. In addition, a more scientific fuzzy gray clustering method is used to evaluate the operational effect of green building, and a new evaluation model is established.