Search results

This paper proposes a new hierarchical approach toward MIS evaluation, which emphasizes the evaluation of the strategic aspects of MIS, as well as the evaluations of the activities of MIS functions and the quality of application systems. Based on the previous studies and the preliminary field survey, concepts and contents of three hierarchical evaluation types such as system‐oriented, function‐oriented and strategy‐oriented evaluations were presented, and four propositions were drawn. The surveys of 130 Korean firms, conducted in 1991 and 1997 successively, show that majority of firms use system‐oriented or function‐oriented evaluation type, although the usage rate of strategy‐oriented type is slightly higher in 1997 than in 1991 and most MIS managers consider the strategy‐oriented evaluation as the ideal one. It is also found that the firms of higher MIS maturity use the strategy‐oriented evaluation type, and the firms with strategy‐oriented evaluation type show a higher MIS performance. Results of this study imply that strategic roles of MIS should be more emphasized and different evaluation types should be used along with MIS maturity. In addition, the design of MIS evaluation framework should be done carefully in the strategic and managerial contexts, because MIS performance can vary with evaluation type. Finally, some limitations of the study and directions for further research were suggested.

The purpose was to evaluate the effectiveness of Google (as an international search engine) as well as of Parsijoo, Rismoon, and Yooz (as Persian search engines).

In this research, Google search engine as an international search engine, and three local ones, Parsijoo, Rismoon, and Yooz, were selected for evaluation. Likewise, 32 subject headings were selected from the Persian Subject Headings List, and then simulated work tasks were assigned based on them. A total of 192 students from Ferdowsi University of Mashhad were asked to search for the information needed for simulated work tasks in the selected search engines, and then to copy the relevant website URLs in the search form.

The findings indicated that Google, Parsijoo, Rismoon, and Yooz had a significant difference in the precision, recall, and normalized discounted cumulative gain. There was also a significant difference in the effectiveness (average of precision, recall, and NDCG) of these four search engines in the retrieval of the Persian resources.

Users using an efficient search engine will attain more relevant documents, and Google search engine was more efficient in retrieving the Persian resources. It is recommended to use Google as it has a more efficient search.

In this research, for the first time, Google has been compared with local Persian search engines considering the new approach (simulated work tasks).

The effort in addition to relevance is a major factor for satisfaction and utility of the document to the actual user. The purpose of this paper is to propose a method in generating relevance judgments that incorporate effort without human judges’ involvement. Then the study determines the variation in system rankings due to low effort relevance judgment in evaluating retrieval systems at different depth of evaluation.

Effort-based relevance judgments are generated using a proposed boxplot approach for simple document features, HTML features and readability features. The boxplot approach is a simple yet repeatable approach in classifying documents’ effort while ensuring outlier scores do not skew the grading of the entire set of documents.

The retrieval systems evaluation using low effort relevance judgments has a stronger influence on shallow depth of evaluation compared to deeper depth. It is proved that difference in the system rankings is due to low effort documents and not the number of relevant documents.

Hence, it is crucial to evaluate retrieval systems at shallow depth using low effort relevance judgments.

This paper aims to describe a study of the queries generated from a user experiment for cross‐language information retrieval (CLIR) from a historic image archive.

A controlled lab‐based user study was carried out using a prototype Italian‐English image retrieval system. Participants were asked to carry out searches for 16 images provided to them, a known‐item search task. Italian speaking users generated 618 queries for a set of known‐item search tasks. User's interactions with the system were recorded and queries were analysed manually quantitatively and qualitatively. The queries generated by user's interaction with the system were analysed and the results used to suggest recommendations for the future development of cross‐language retrieval systems for digital image libraries.

Results highlight the diversity in requests for similar visual content and the weaknesses of machine translation for query translation. Through the manual translation of queries the authors show the benefits of using high‐quality translation resources. The results show the individual characteristics of users while performing known‐item searches and the overlap obtained between query terms and structured image captions, highlighting the use of user's search terms for objects within the foreground of an image.

This research looks in depth into one case of interaction and one image repository. Despite this limitation, the discussed results are likely to be valid across other languages and image repositories.

To develop effective systems requires studying user's search behaviours, particularly in digital image libraries.

The growing quantity of digital visual material in digital libraries offers the potential to apply techniques from CLIR to provide cross‐language information access services. The value of this paper is in the provision of empirical evidence to support recommendations for effective cross‐language image retrieval system design.

Analyzing educational evaluation not only implies investigating its goals, methods, and dimensions, but also studying the rationale behind it. The present contribution relates this rationale to the interests and the goals set by the agents involved in the formulation and implementation of educational evaluation. When it comes to the evaluation of higher education in Brazil, the specific topic of this chapter, those agents are not restricted to the scope of public departments and boards of education; also included are national and international companies as well as inter- and supranational organizations that directly or indirectly set up quality and efficiency standards for educational processes. Particularly, the rationale and the goals of the higher education evaluation models developed in Brazil from the 1970s up to the present will be focused on, highlighting the close relationship between educational assessment and educational regulation.

This paper aims to use intellectual thinking to solve the problem of how to carry out collaborative governance of the academic ecological environment.

This paper selected academic ecosystem, academic ecological environment and academic ecological governance as three keywords to collect literature data. The hot issues on the academic ecological environment and its governance system in China are analyzed, with visualization software such as Citespace, China National Knowledge Infrastructure (CNKI) and other literature metrology tools.

The previous research literature cannot fully explain the governance mechanism of the academic ecological environment. In this paper, the authors use the way of group cooperation thinking in the crowd science category, to build a collaborative governance framework of the academic ecological environment from the national level, the institutional level and the individual level, taking full advantage of the in-depth analysis on crowd intellectual thinking.

The authors use the way of group cooperation thinking in the crowd science category, to build a collaborative governance framework of academic.

A performance framework is described that distils concepts from the literature about existing frameworks in order to extend capacity to evaluate and appraise performance. This open system interpretation recognises dynamic flows between various organizational levels and allows performance to be viewed in a holistic sense. Both macro and micro views are addressed that range from simple feedback control models to broader evaluation perspectives appropriate to stakeholder requirements and organisation purpose. Three basic dimensions of performance are observed using this framework that form a performance triplet, which is described in a series of principles as part of a first step towards a theory of performance measurement.