Search results

Discusses how most organizations use formal methods which are purely objective and rational to evaluate system projects. Such methods are incapable of capturing the social aspects of system projects and as such are not appropriate. Inappropriate evaluation mechanisms and criteria have caused the detrimental effects of organizational bias to flourish, thereby defeating the purposes of project evaluation. Organizations, either knowingly or unknowingly, are judging instead of evaluating projects with the intention to punish or reward the project teams and so encourage biasing effects. Contends that an effective project evaluation should adopt a socio‐technical approach to reflect the socio‐technical nature of information systems. Describes and illustrates managerial guidelines on socio‐technical approach to project evaluation capable of accounting and controlling for the obvious effects of organizational bias.

Puts forward a framework for carrying out user evaluations of expert systems, which is based on user evaluations carried out in a large British company over a period of three years. The aim of this framework is to ensure that the aims of the expert system designers and the users of the system are congruent. This in turn will make it more likely that the expert system will be a success. The framework covers aspects such as user type, updating knowledge, training, the value of the system and the human/computer interface.

This chapter describes an institutional choice that most Latin American countries have taken in the past 25 years: the creation of national Public Performance Monitoring and Evaluation (PPME) systems. We summarize research assessing their institutionalization, identify their shortcomings, and discuss trends demonstrating a potential – not yet realized – to fulfill their vocation as instruments of political and democratic accountability. Despite remarkable progress in their institutionalization, the evidence suggests that the systems fall short in producing strong results-oriented democratic accountability. Key factors hindering this aspiration include the systems' low credibility, problems associated to their diversification, low institutional coherence, and lack of effective coordination mechanisms to improve information legibility, its quality, its usefulness, and thus its use by both public managers and citizens. We suggest that PPME systems depend on environmental conditions beyond government structures and processes and argue that citizen-oriented mechanisms and entry points for social participation around the systems are required to fulfill their accountability function.

The objective of this research was to develop a new and highly accurate approach based on a fuzzy inference system (FIS) for the evaluation of usability based on ISO 9241-210:2019. In this study, a fully automated method of usability evaluation is used for interactive systems with a special look at interactive social robots.

Fuzzy logic uses as an intelligent computing technique to deal with uncertainty and incomplete data. Here this system is implemented using MATLAB fuzzy toolbox. This system attempted to quantify four criteria that correlate highly with ISO 9241-210:2019 criteria for the evaluation of interactive systems with maximum usability. Also, the system was evaluated with standard cases of computer interactive systems usability evaluation. The system did not need to train various data and to check the rules. Just small data were used to fine-tune the fuzzy sets. The results were compared against experimental usability evaluation with the statistical analysis.

It is found that there was a high strong linear relation between the FIS usability assessment and System Usability Scale (SUS) based usability assessment, and authors’ new method provides reliable results in the estimation of the usability.

In human-robot systems, human performance plays an important role in the performance of social interactive systems. In the present study, the proposed system has considered all the necessary criteria for designing an interactive system with a high level of user because it is based on ISO 9241-210:2019.

For future research, the system could be expanded with the training of historical data and the production of rules through integrating FIS and neural networks.

This system considered all essential criteria for designing an interactive system with a high level of usability because it is based on ISO 9241-210:2019. For future research, the system could be expanded with the training of historical data and the production of rules through integrating FIS and neural networks.

Evaluating health information systems is an integral part of the life cycle and development of information systems as it can improve the quality of health care. The purpose of this paper is to introduce a bilingual Web-based repository of health-related software products evaluation tools.

The present paper is an applied-developmental study that includes the stages of analysis, design, implementation and evaluation procedures. By searching valid databases as well as holding focus group meetings with a group of experts, the necessary elements for designing a Web-based repository were identified, and also unified modelling language diagrams were designed by using a visual paradigm. The coding(programming) was conducted based on the Gantlet Web Systems Development Framework at the next stage. Finally, after implementing and testing the system, the content was added to the repository, and then the repository was evaluated in terms of usability testing.

The health informatics evaluation tools (HIET) repository provides a functional and selective environment that facilitates the sharing, online storage and retrieval of assessment tools by the scientific community. The HIET repository is easily accessible at www.hiet.ir/ The website is implemented in structured query language (MySQL), personal homepage. Hypertext Preprocessor (PHP) and Linux, Apache, MySQL, and PHP (LEMP) and supports all major browsers.

The HIET repository, as mentioned earlier, serves as an application environment for sharing, storing and online retrieving the assessment tools of health information systems. Therefore, this tool not only facilitates the search, retrieving and study of many evaluation-related papers, which are time-consuming and stressful for researchers and students but can lead to a faster and more scientific evaluation of information systems.

The purpose of this paper is to utilise a “Wuli-Shili-Renli (WSR)” system approach to create models for complex smart building energy management and evaluate the establishment of a building energy management platform.

The complexity and diversity of the data and demands of the energy management platform mean that it is necessary to analyse comprehensively. This paper uses a WSR system approach to handle, and optimise, the relationship between demands and participants and improve the whole platform. Then, this paper establishes comprehensive evaluation models to analysis the current energy management platforms by using the best integration platform as the baseline.

The WSR conceptual model clarifies the relationship between the elements and elements of the energy management platform clearly and provides the appropriate analytical methods with which to resolve key platform construction issues. The comprehensive evaluation based on a WSR system approach can take into account the systematic effect, so it is more accurate.

The correlation degree between the layers of the energy management platform is rarely reflected.

This paper improves the modelling method used in the WSR system approach and demonstrates that the comprehensive evaluation based on the WSR system approach analyses the energy management platform for public buildings in a synthetic approach.

This article examines the relationships among two types of strategy (defender and prospector), two types of evaluation systems (output‐oriented and behavior‐oriented), and one dimension of organizational structure (centralization) and their interactive effects on the job performance of marketing managers. Findings from an empirical study indicate that marketing strategies must be matched with the appropriate types of evaluation systems and structure to affect job performance positively. More specifically, the results suggest that an output‐oriented evaluation system combined with a high level of centralization is associated with higher managerial performance for organizations pursuing a defender strategy, whereas a behavior‐oriented evaluation system combined with a low degree of centralization is associated with higher managerial performance for a prospector strategy. Implications for the successful implementation of marketing strategies are discussed. Finally, study limitations and directions for future research are noted.

Purpose – The purpose of the research was to examine the process of new teacher evaluation policy development in South Korea, in order to gain insight into how a controversial policy could be established in education. Research questions were about the process of the policy development, political actors involved and their influences, and the meaning of teacher evaluation in the newly established teacher evaluation policy.Methodology – The study uses a qualitative and descriptive-analytical process from a hermeneutics perspective that views policy as text to be interpreted. This perspective allows policy to be connected to a larger social context through interpretations of text. The main data sources included policy documents, statements by various organizations, research reports, and public media artifacts produced between 2000 and 2012. For data analysis, constant comparison and content analysis methods were used.Findings – The findings show that the process of developing a teacher evaluation system demonstrated an unsuccessful attempt to apply the Habermasian notion of discursive democracy. Relevant stakeholders were invited to deliberate on the reform, but official meetings ended prematurely without consensus. In the end, the government proceeded without full support of any stakeholders. During the deliberation process, teacher organizations and parent groups demonstrated conflicting perspectives on teacher work and the new evaluation system only partially accommodated both perspectives. The effectiveness of the new evaluation system remains to be researched.Value – The policy development process and the evaluation system shown in this study should inform similar efforts in other contexts.

Grey modeling technique is an important element of grey system theory, and academic articles applied to agricultural science research have been published since 1985, proving the broad applicability and effectiveness of the technique from different aspects and providing a new means to solve agricultural science problems. The analysis of the connotation and trend of the application of grey modeling technique in agricultural science research contributes to the enrichment of grey technique and the development of agricultural science in multiple dimensions.

Based on the relevant literature selected from China National Knowledge Infrastructure, the Web of Science, SpiScholar and other databases in the past 37 years (1985–2021), this paper firstly applied the bibliometric method to quantitatively visualize and systematically analyze the trend of publication, productive author, productive institution, and highly cited literature. Then, the literature is combed by the application of different grey modeling techniques in agricultural science research, and the literature research progress is systematically analyzed.

The results show that grey model technology has broad prospects in the field of agricultural science research. Agricultural universities and research institutes are the main research forces in the application of grey model technology in agricultural science research, and have certain inheritance. The application of grey model technology in agricultural science research has wide applicability and precise practicability.

By analyzing and summarizing the application trend of grey model technology in agricultural science research, the research hotspot, research frontier and valuable research directions of grey model technology in agricultural science research can be more clearly grasped.