Search results

The purpose of this paper is to present an approach to evaluating contributions in collaborative authoring environments, and in particular, Wikis using social network measures.

A social network model for Wikipedia has been constructed, and metrics of importance such as centrality have been defined. Data has been gathered from articles belonging to the same topic using a web crawler, in order to evaluate the outcome of the social network measures in the articles.

Finds that the question of the reliability regarding Wikipedia content is a challenging one and as Wikipedia grows, the problem becomes more demanding, especially for topics with controversial views such as politics or history.

It is believed that the approach presented here could be used to improve the authoritativeness of content found in Wikipedia and similar sources.

This work tries to develop a network approach to the evaluation of Wiki contributions, and approaches the problem of quality Wikipedia content from a social network point of view.

The purpose of this paper is to further the debate on Knowledge Artefacts (KAs), by presenting the design of WikiRate, a Collective Awareness platform whose goal is to support a wider public contributing to the generation of knowledge on environmental, social and governance (ESG) performance of companies.

The material presented in the paper comes from the first-hand experience of the authors as part of the WikiRate design team. This material is reflexively discussed using concepts from the field of science and technology studies.

Using the concept of the “funnel of interest”, the authors discuss how the design of a KA like WikiRate relies on the designers’ capacity to translate general statements into particular design solutions. The authors also show how this funnelling helps understanding the interplay between situativity and objectivity in a KA. The authors show how WikiRate is a peer-production platform based on situativity, which requires a robust level of objectivity for producing reliable knowledge about the ESG performance of companies.

This paper furthers the debate on KAs. It presents a relevant design example and offers in the discussion a set of design and community building recommendations to practitioners.

In a project-based learning experience, the detailed monitoring of the activities in which team members participate can be useful to evaluate their work. However, the project activity produces a large amount of data that can be hardly assessed by a single project supervisor. This poses a scalability issue if the number of users or projects size increases. In this vein, the purpose of this paper is to make the assessment of online learning experiences more sustainable.

This paper describes a learning-oriented collaborative assessment method, supported by an open data framework. Also, an architecture for the extraction of different indicators to facilitate the assessment process is presented.

The assessment method and the open data framework were applied to a project-based course on web engineering. This experience has provided positive evidences because the grade measurement was backed up with assessment evidences and calculated with less effort.

At the moment, results indicate that apparently there are no significant evidences against the sustainable evaluation practices for students’ summative evaluation. Nevertheless, when more data become available, a more statistically significant analysis could be made to determine the influence of the assessment practices in the final result of the evaluated skills.

In contrast to various existing proposals for e-assessment, the strategy focuses on assessing learning experiences in software development projects. Also, the approach is based on the reuse of information from external process supporting tools by integrating a number of metrics in a non-intrusive way.

The purpose of this paper is to introduce a new knowledge quality assessment framework based on interdependencies between content and schema as knowledge resources to enhance the quality of the knowledge that is being generated, disseminated and stored in a collaborative environment.

A knowledge elaboration approach is based on intervening factors of schematic clustering applied to a trial wiki bulletin board. Through this schematic intervention in the form of group creation within a wiki environment, a user-centric mechanism is created to substantiate, compose and narrate the generated contents in a self-organizing way.

Through this approach, quality in content can be enhanced by means of a favourably manipulated collaboration schema adopted by the knowledge management system (KMS) users instead of applying knowledge mining tools.

With consideration to trust as a significant factor in this study, the verification and referral process may vary for KMS structures that are of larger scale or in low-trust collaborative environments.

This study demonstrates transition to higher quality knowledge with less time spent on the original content refinement and composition by paying due consideration to the interdependencies between knowledge resource content and its schema. Validation is done via a clustered group structure in a specially designed wiki which had been used as a discussion bulletin board on directed topics over an extended period.

The purpose of this paper is to present an innovative in-house knowledge management system of core know-how for European Commission (EC) officials. It shows how the quality of the work of officials could be improved and how talent growth and recognition could be better fostered within the EC, taken as target for the proposal, as well as example for other large, multi-disciplinary organisations that might wish to implement a similar system.

The study considered what the key issues for better knowledge management in the EC are, and what could be learnt from the successful implementation of Diplopedia, the knowledge wiki of the US Department of State, and from previous studies of author rank, quality and stability of individual entries in the public Wikipedia. The less known Citizendium wiki was also considered. Adopting a design science approach, a first conceptual design for a EC-wide in-house knowledge wiki was developed and validated through two successive iterations using a simplified Delphi approach. A final conceptual design of this wiki was then prepared.

The study found that a system aiming at high quality of entries, allowing for a healthy breadth of substance-based opinions, covering a vast scope of subjects and offering security of operation can be designed. It is argued that visible authorship, allowing room for dissenting opinions, opting for non-public access of the entries and setting up a bibliometrics method to reward high-quality contribution to the system are essential elements to ensure its adoption and ultimate success.

The main limitation of the study is that the new system, yet to be accepted within the EC, is untested in a real situation. The paper should, therefore, be seen as an example of “design science” rather than an analysis of an already implemented system. It is surmised that more research is needed on preservation and growth of quality in wiki entries, and how ranking editors can contribute to that aim.

The Commipedia system proposed in the present paper will have practical positive implications in the EC discharge of its duties, which have constantly increased over the years at each revision of the EU treaties. A similar system can address similar needs of in-house knowledge management and talent management in large public and private organisations.

This paper fulfils the need to provide the EC with a way to cope with mobility and retirement of experienced officials, to retain their knowledge, distribute across its different departments, update and improve it and, additionally, reward expertise and talent of officials, increasing in turn their wish to contribute to Commipedia. Neither the EC nor other large multi-disciplinary organisations have such a general system at their disposal.

The purpose of this paper is to present extensions of Semantic MediaWiki for the purpose of technology forecast and technology monitoring. The user friendliness and applicability of the components is evaluated by task-based user studies.

Based on the requirements given by potential end users (technology experts), visualization possibilities were designed and implemented. Potential users used the new features of technology forecast and monitoring within a semantic wiki and were controlled regarding the effectiveness.

Although semantic wikis are ideal tools for knowledge management in industry settings, especially due to their user-friendly way of storing and retrieving knowledge, they have rarely been used for technology forecast and monitoring purposes so far. The authors show that the additional requirements for such purposes can be met and provide established technology analysis possibilities within Semantic MediaWiki. In that way, a new application area of Semantic MediaWiki is introduced.

Tools and techniques for Semantic MediaWiki are presented, opening the application area of Semantic MediaWiki for technology and innovation management. The research provides evidence that the open-source implemented visualization and storage techniques can be applied in real-world settings, where so far mainly costly dedicated software has had to be used.

To keep librarians and colleagues informed about the issues and programs of the Electronic Resources & Libraries (ER&L) Conference held in Atlanta, Georgia on the Georgia Institute of Technology campus in February 2007.

Provides a review of the conference.

Acquisitions staff, catalogers, public service staff, administrators, IT personnel, information providers from the vendor side, content managers, and others all came together to assess what needs to be done to continue high servicing of both born digital and electronically available resources in a hybrid environment that continues to describe all library settings today. As the percentage of electronic resources quickly grows, there are new challenges in acquiring, caring for, servicing, preserving, using and citing them that keep librarians up at night to consider short‐and long‐term solutions in how they should be organized bibliometrically and how we can re‐engineer some of our procedures to best treat the wide range of e‐Resources now common in all libraries.

The program blended services with processing reinforcing the importance of electronic resources for the “total” library environment. It seemed like there was nothing left out.

As for academic papers, the customary methods for assessing the impact of books are based on citations, which is straightforward but limited to the coverage of databases. Alternative metrics can be used to avoid such limitations, such as blog citations and library holdings. However, content-level information is generally ignored, thus overlooking users’ intentions. Meanwhile, abundant academic reviews express scholars’ opinions on books, which can be used to assess books’ impact via fine-grained review mining. Hence, this study aims to assess books’ use impacts by conducting content mining of academic reviews automatically and thereby confirmed the usefulness of academic reviews to libraries and readers.

Firstly, 61,933 academic reviews in Choice: Current Reviews for Academic Libraries were collected with three metadata metrics. Then, review contents were mined to obtain content metrics. Finally, to identify the reliability of academic reviews, Choice review metrics and other assessment metrics for use impact were compared and analysed.

The analysis results reveal that fine-grained mining of academic reviews can help users quickly understand multi-dimensional features of books, judge or predict the impacts of mass books, so as to provide references for different types of users (e.g. libraries and public readers) in book selection.

Book impact assessment via content mining can provide more detail information for massive users and cover shortcomings of traditional methods. It provides a new perspective and method for researches on use impact assessment. Moreover, this study’s proposed method might also be a means by which to measure other publications besides books.

This study aims to investigate the factors that influence user experience (UX) of eLearning systems implemented in two institutions in Tanzania.

The study adopted questionnaire consisting of Nielsen’s heuristics and didactic metrics as pragmatic metrics and hedonic metrics followed by focus group discussions with students.

The study found that the eLearning system of University of Dar es Salaam had 43 UX problems related to Nielsen’s heuristics and 54 UX problems related to didactic heuristics. The eLearning system of the Open University of Tanzania had 50 UX problems related to Nielsen’s heuristics and 59 UX problems related to didactic heuristics. Moreover, the two systems provided positive UX hedonic quality on identification and evocation dimensions while stimulation was perceived to be neutral.

The study has used learners as evaluators rather than expert evaluators. Learners are not particularly experienced in the learning domain, and therefore, it is difficult for them to identify many didactic violations of the eLearning systems.

The study contributes toward finding the underlying factors for non-use or underuse of the installed eLearning systems in various universities in sub-Saharan Africa.

The authors introduce two semantics-based navigation applications that facilitate information-seeking activities in internal link-based web sites in Wikipedia. These applications aim to help users find concepts within a topic and related articles on a given topic quickly and then gain topical knowledge from internal link-based encyclopedia web sites. The paper aims to discuss these issues.

The WNavi s application consists of three information visualization (IV) tools which are a topic network, a hierarchy topic tree and summaries for topics. The WikiMap application consists of a topic network. The goal of the topic network and topic tree tools is to help users to find the major concepts of a topic and identify relationships between these major concepts easily. In addition, in order to locate specific information and enable users to explore and read topic-related articles quickly, the topic tree and summaries for topics tools support users to gain topical knowledge quickly. The authors then apply the k-clique of cohesive indicator to analyze the sub topics of the seed query and find out the best clustering results via the cosine measure. The authors utilize four metrics, which are correctness, time cost, usage behaviors, and satisfaction, to evaluate the three interfaces. These metrics measure both the outputs and outcomes of applications. As a baseline system for evaluation the authors used a traditional Wikipedia interface. For the evaluation, the authors used an experimental user study with 30 participants.

The results indicate that both WikiMap and WNavi s supported users to identify concepts and their relations better compared to the baseline. In topical tasks WNavi s over performed both WikiMap and the baseline system. Although there were no time differences in finding concepts or answering topical questions, the test systems provided users with a greater gain per time unit. The users of WNavi s leaned on the hierarchy tree instead of other tools, whereas WikiMap users used the topic map.

The findings have implications for the design of IR support tools in knowledge-intensive web sites that help users to explore topics and concepts.

The authors explored to what extent the use of each IV support tool contributed to successful exploration of topics in search tasks. The authors propose extended task-based evaluation measures to understand how each application provides useful context for users to accomplish the tasks and attain the search goals. That is, the authors not only evaluate the output of the search results, e.g. the number of relevant items retrieved, but also the outcome provided by the system for assisting users to attain the search goal.