Search results

The importance of software has been growing rapidly owing to the development of various Internet and e‐business applications. One of the active research areas in software involves its evaluation methods or models. The traditional approaches to software evaluation are based on the development process point of view, and their major concerns are not strongly related to user or customer‐oriented evaluation of software. In this paper, a maturity model and a corresponding evaluation system are suggested that focuses on software customer satisfaction. As a case study, they are applied to 18 software companies and their 180 customers in Korea to prove their practical values.

The purpose of this paper is to present a methodology combining experimental and inquiry methods used for software usability evaluation. The software product of LeViS project funded by the European Commission (Socrates/Lingua II) is used as an evaluation paradigm. The aim of the paper is twofold: to present the results of the usability evaluation using this software as an example and to suggest a number of improvements for the next version of the software tool; and to portray the advantages of combining methods from different evaluation approaches and the experiences from their application.

The evaluation for this experiment combined different usability methods, both experimental and inquiry ones. More specifically, the methods employed were the Thinking Aloud Protocol and the User Logging, which were performed in a usability evaluation laboratory, as well as the inquiry methods of Interview and Focus Group.

In this study, usability problems regarding the Learning via Subtitling (LvS) educational software were revealed as well as issues regarding the use of Thinking Aloud Protocol method and involving users with a specific profile. The research findings presented in this paper constitute an innovative and effective methodology for software usability evaluation and are useful for laboratories aiming to conduct similar evaluations.

Although this methodology has been successfully applied for over 20 software products, due to practical purposes related to this paper's extent, only one software is used as an example.

Through the evaluation process, apart from discovering certain usability problems related to the software, there are a number of important conclusions drawn, regarding the methods used and the methodology followed in software usability evaluation.

Two aspects of the selection and evaluation of software packages are reviewed: the strategy for evaluation and selection, and criteria that might be applied in selection. The evaluation and selection of a software package should be approached as a project. Appropriate strategies for the selection and evaluation of software packages can be based on information systems methodologies. The main stages in the project are: definition of objectives, evaluation of options, definition, selection and design, implementation and evaluation and maintenance. A system requirements specification is an important document in this process. Software selection must be guided by appropriate criteria. General criteria are cost, lifetime and life history, originator, supplier, support, maintenance, technical considerations and compatibility, ease of use, interfaces and integration. In addition specific criteria must be developed for specific categories of packages. A checklist of criteria for database packages is given.

Organizations worldwide are adopting software as a service (SaaS) applications, where they pay a subscription fee to gain access rather than buying the software. The extant models on software acquisition processes, several of which are based on organizational buying behavior, do not sufficiently explain how SaaS application acquisition decisions are made. This study aims to investigate the acquisition process organizations follow for SaaS software, the changes to the roles of the Chief Information Officer (CIO) and the business user and also looks at the impact of SaaS on the proliferation of unauthorized software systems.

The authors used exploratory research using the grounded theory approach based on 18 in-depth interviews conducted with respondents who have studied with enterprise software delivered on-premise and as SaaS in different roles such as sales, consulting, CIO, information technology (IT) management and product development.

The authors identified a need to classify the SaaS software and developed a framework that uses software specificity and its strategic importance to the organization to classify SaaS applications. The aforementioned framework is used to explain how software evaluation processes have changed for different kinds of SaaS applications. The authors also found that the CIO’s and the business users’ have changed substantially in SaaS application evaluations and found evidence to show that shadow IT will be restricted to some classes of SaaS applications.

By focusing on the changes to the roles and responsibilities of the members of the buying center, this paper provides unique insights into how the acquisition process of SaaS is different from the extant models used to explain enterprise software acquisitions. An understanding of how information search is conducted by the business users will help software vendors to target business users better.

Organisations make use of different tools and methods in testing software to ensure quality and appropriateness for business needs. Despite the efforts, many organisations continue to have challenges with the quality of their software. This has impacted the service that the organisation provides to their customers and business partners. Software quality challenges persist because of two main reasons: some organisations do not conduct testing and evaluation of their software, and many organisations pay less attention to the non-technical activities in the testing and evaluation of software in their organisations. Thus, the purpose of this paper is to understand the factors that influence software testing through empirical study.

This study used actor–network theory (ANT) to assess the factors that influence the testing and evaluation of software, using a South African organisation as case in the study. Qualitative data was collected from 14 participants using semi-structured interview techniques. The interpretivist approach was applied in the analysis of the data.

From the analysis, six factors, software evaluation, process oriented, implementation policy, change management, power relationship and organisational structure, were found to be of influence on software testing. Based on the factors, a framework was developed to help software testers and managers understand how to customise their testing tools.

The originality of this study comes from its empirical nature, through which it contributes to practice by proposing a model for practical actions towards improving software testing in organisations. Also, this study contributes to ANT usefulness from the point of investigative effectiveness.

Service supplier selection is a multi-criteria decision-making (MCDM) problem assuming a strategic role for the competitiveness of high-tech manufacturing companies. Nevertheless, especially for service quality evaluation, there is little empirical evidence of the practical usefulness of MCDM methodologies. Aiming to cover this gap between theoretical approaches and empirical applications, the purpose of this paper is to propose a fuzzy extended analytic hierarchy process (FEAHP) approach for service supplier evaluation.

A hybrid approach which combines some of the strengths of the analytic hierarchy process (AHP) and of the fuzzy set theory is presented, as organized into five steps. A case study is used to evaluate the applicability in a real company context.

The usability of the approach is demonstrated in an aerospace company for solving the supplier selection problem of a business software whose applications are still in infancy: a Test Data Management System (TDMS). The illustrative application contains both “general” criteria to be used for other service supplier selection contexts as well as service-specific criteria related to software selection.

Even if the application regards the selection of a software supplier, the methodology can be generically extended to other services’ selection in complex manufacturing industries through the personalization of some criteria.

Implications can be derived both for business managers involved into the decision-making process and for suppliers identifying the most promising features of software quality.

The originality consists in the combination into a hybrid approach of the strong points of the AHP with the fuzzy set; the inclusion of multiple perspectives of decision criteria for service supplier selection, basically the “software product” and “supplier” ones; a real empirical application to test and demonstrate the efficacy and the practical utility of the proposed approach.

Due to the increasing complexity of decision environments, suitable multi-criteria methods are gaining importance for the decision support function in management accounting. The analytic hierarchy process (AHP), a well-known and established OR method for solving complex decision settings, is accompanied by the ongoing development of suitable software solutions. Especially for practical issues, software support can reduce barriers to applying AHP and can enhance acceptance by managers. For this reason, five heterogeneous software products are evaluated from a management accounting perspective. The paper aims to discuss these issues.

Based on the increasing relevance of AHP and the major changes in the field of AHP software solutions, the study of Ossadnik and Lange was replicated, with modifications. Five leading software products that use AHP were selected and evaluated with regard to their quality for solving decision problems. Pairwise comparisons were generated and integrated into an AHP-based decision model. The relevant criteria contained in this model were developed from the international standard norm for software evaluation.

In addition to revealing the necessity for further research on the development of appropriate software for multi-criteria decision problems, the result also shows that, under certain assumptions, “ Make It Rational” is the preferred software product.

Originating from different demands, the evaluation reveals the strengths and weaknesses of various software solutions for practical purposes.

This study shows that characteristics of software products using AHP vary, enabling users to select an appropriate software solution.

Many open source software packages are available for organizations and individuals to create digital libraries (DLs). However, a simple to use instrument to evaluate these DL software packages does not exist. The objectives of the present work are to develop a checklist for DL evaluation and use this checklist on four DL software packages.

Features that characterized “good” open source DL software were determined from the literature. First identified were essential categories of features that DL software should possess. These categories were then decomposed into supporting features. From these, a checklist that covered all such features was developed. The checklist was then used to evaluate four popular open source DL software packages (CDSware, EPrints, Fedora, and Greenstone) for the purposes of assessing suitability for use in a DL project to be undertaken by the authors.

A checklist consisting of 12 categories of items was developed. Using this, Greenstone was found to be the best performer, followed by CDSware, Fedora and EPrints. Greenstone was the only software package that consistently fulfilled the majority of the criteria in many of the checklist categories. In contrast, EPrints was the worst performer due to its poor support for certain features deemed important in our checklist, and a total absence of functionality in other categories.

The present work attempts to develop a comprehensive checklist for assessing DLs. Its flexibility allows users to tailor it to accommodate new categories, items and weighting schemes to reflect the needs of different DL implementations.

A common user interface replaces the multiple interfaces found among individual electronic library resources, reducing the time and effort spent by the user in both searching and learning to use a range of databases. Although the primary function of a common user interface is to simplify the search process, such products can be holistic solutions designed to address requirements other than searching, such as user authentication and site branding. This review provides a detailed summary of software currently on the market. The products reviewed were EnCompass, MetaLib, Find‐It‐All OneSearch, ZPORTAL, CPORTAL, InfoTrac Total Access, MetaFind, MuseSearch, SiteSearch, Single Search, Chameleon Gateway, and WebFeat.

The evaluation and selection of a library software package, whether it be for library housekeeping, text retrieval or the creation of some other database should be approached as a project. Appropriate strategies for the selection and evaluation of software packages can be based on systems analysis and design methodologies. Stages in the project should include: definition of objectives, evaluation of options, definition, selection and design, implementation and evaluation and maintenance. Some checklists of features to seek in text retrieval and library housekeeping software are included. These are discussed in the context of new developments in library software.