Search results

The purpose of this study is to compare the evaluation of search result lists and documents, in particular evaluation criteria, elements, association between criteria and elements, pre/post and evaluation activities, and the time spent on evaluation.

The study analyzed the data collected from 31 general users through prequestionnaires, think aloud protocols and logs, and post questionnaires. Types of evaluation criteria, elements, associations between criteria and elements, evaluation activities and their associated pre/post activities, and time were analyzed based on open coding.

The study identifies the similarities and differences of list and document evaluation by analyzing 21 evaluation criteria applied, 13 evaluation elements examined, pre/post and evaluation activities performed and time spent. In addition, the authors also explored the time spent in evaluating lists and documents for different types of tasks.

This study helps researchers understand the nature of list and document evaluation. Additionally, this study connects elements that participants examined to criteria they applied, and further reveals problems associated with the lack of integration between list and document evaluation. The findings of this study suggest more elements, especially at list level, be available to support users applying their evaluation criteria. Integration of list and document evaluation and integration of pre, evaluation and post evaluation activities for the interface design is the absolute solution for effective evaluation.

This study fills a gap in current research in relation to the comparison of list and document evaluation.

The purpose of this paper is to examine changes in relevance assessments, specifically the selection of relevance criteria by subjects as they move through the information search process.

The paper examines the relevance criteria choices of 39 subjects in relation to search stage. Subjects were assigned a specific search task in a controlled test. Statistics were collected and analyzed using descriptive statistics and the chi‐square goodness‐of‐fit tests.

The statistically significant findings identified a number of commonly reported relevance criteria, which varied over an information search process for relevant and partially relevant judgments. These results provide statistical confirmations of previous studies, and extend these findings identifying specific criteria for both relevant and partially relevant judgments.

The study only examines a short duration search process and since the convenience sample of subjects were from similar backgrounds and were assigned similar tasks, the study did not explicitly examine the impact of contextual factors such as user experience, background or task in relation to relevance criteria choices.

The paper has implications for the development of search systems which are adaptive and recognize the cognitive changes which occur during the information search process. Examining and identifying relevance criteria beyond topicality and the importance of those criteria to a user can help in the generation of better search queries.

The paper adds more rigorous statistical analysis to the study of relevance criteria and the information search process.

This study aims to investigate the effects of organizational culture factors on the selection of software process development models and develops a conceptual model for selecting and adopting process development models with an organizational culture approach, using 12 criteria and their sub-criteria defined in Fey and Denison’s model (12 criteria).

The research hypotheses were investigated using statistical analysis, and then the criteria and sub-criteria were selected based on Fey and Denison’s model and the experts’ viewpoints. Afterward, the organizational culture of the selected company was measured using the data from 2016 and 2017, based on Fey and Denison’s questionnaire. Due to the correlation between the criteria, using the decision-making trial and evaluation technique, the correlation between sub-criteria were determined, and by analytical network process method and using Super-Decision software, the process development model was preferred to the 12 common models in information systems development.

Results indicated a significant and positive effect of organizational culture factors (except the core values factor) on the selection of development models. Also, by changing the value of organizational culture, the selected process development model changed either. Sensitivity analysis performed on the sub-criteria implied that by changing and improving some sub-criteria, the organization will be ready and willing to use the agile or risk-based models such as spiral and win-win models. Concerning units where the mentioned indicators were at moderate and low limits, models such as waterfall, V-shaped and incremental worked more appropriately.

While many studies were performed in comparing development models and investigating their strengths and weaknesses, and the impact of organizational culture on the success of information technology projects, literature indicated that the impact of organizational sub-culture prevailing in the selection of development process models has not been investigated. In this study, new factors and indicators were addressed affecting the selection of development models with a focus on organizational culture. Correlation among the factors and indicators was also investigated and, finally, a conceptual model was proposed for proper adoption of the models and methodologies of system development.

The purpose of this paper is to better understand the dynamic nature of the relevance judgment process and the influence of work task on that process.

The empirical study reported here examined the information seeking behavior of a group of undergraduate college students assigned a set of research assignments (work tasks). Subjects recorded their selection of documents used for an assignment and the criteria used to judge those documents relevant. Statistical analysis was used to associate relevance judgments and the criteria used to make those judgments with work tasks.

Findings indicate a strong statistical association between work task and criteria used to judge relevance. Findings also include identification of specific criteria used to judge relevance and the relative importance of those criteria based on frequency of selection of criteria for a work task.

Findings provide additional insights into the dynamic nature of the relevance judgment process. Relevance judgment influences revealed in these findings in the form of criteria used to make relevance judgments further explicate the relevance judgment process and provide suggestions for the improvement of information retrieval systems and information literacy efforts.

Understanding the relevance judgment process is critical to understanding information behavior in general. Few studies have examined relevance criteria selections as part of the relevance judgment process and fewer still have studied these selections in relation to work tasks. A better understanding of this relationship is an essential part of understanding the dynamic nature of the relevance judgment process and its influences.

The purpose of this article is to identify design guidelines for online resources based on the subjective assessment criteria used by individuals to assess and process information resources. This method of creating design guidelines targeted at precise user groups has the potential to aid designers and developers to create more user-centred information resources.

The authors gathered data using a prospective longitudinal study investigating the information behaviour of expectant and new mothers. Women were asked to report on their information-seeking activities in a series of semi-structured interviews covering pregnancy and early motherhood.

This research identified 15 assessment criteria that were utilised by women to assess and process information resources. The most popular resource criteria amongst participants were credibility and convenience, while completeness and relevance were the most popular information content criteria. The authors found that assessment criteria were not considered in isolation, with criteria such as formatting and search engine ranking impacting on participants' perception of other criteria.

This research demonstrates the potential of linking a user groups subjective assessment criterion to design guidelines. The authors propose that these guidelines could be used to help design an online information resource. They could also be used to assess if an existing online resource met the needs of a user group. The methodology used in this study could be leveraged to create design guidelines for user groups.

This research uses subjective assessment criteria as a means of understanding how expectant new mothers process information resources. People use subjective judgements when processing information resources, and this should be incorporated into the design of information resources. Analysing longitudinal data allowed the authors to build a rich picture of how participants evaluated and compared different information resources.

In vol. 6, 1976, of Advances in Librarianship, I published a review about relevance under the same title, without, of course, “Part I” in the title (Saracevic, 1976). [A substantively similar article was published in the Journal of the American Society for Information Science (Saracevic, 1975)]. I did not plan then to have another related review 30 years later—but things happen. The 1976 work “attempted to trace the evolution of thinking on relevance, a key notion in information science, [and] to provide a framework within which the widely dissonant ideas on relevance might be interpreted and related to one another” (ibid.: 338).

The issue of model selection in applied research is of vital importance. Since the true model in such research is not known, which model should be used from among various potential ones is an empirical question. There might exist several competitive models. A typical approach to dealing with this is classic hypothesis testing using an arbitrarily chosen significance level based on the underlying assumption that a true null hypothesis exists. In this paper, the authors investigate how successful the traditional hypothesis testing approach is in determining the correct model for different data generating processes using time series data. An alternative approach based on more formal model selection techniques using an information criterion or cross-validation is also investigated.

Monte Carlo simulation experiments on various generating processes are used to look at the response surfaces resulting from hypothesis testing and response surfaces resulting from model selection based on minimizing an information criterion or the leave-one-out cross-validation prediction error.

The authors find that the minimization of an information criterion can work well for model selection in a time series environment, often performing better than hypothesis-testing strategies. In such an environment, the use of an information criterion can help reduce the number of models for consideration, but the authors recommend the use of other methods also, including hypothesis testing, to determine the appropriateness of a model.

This paper provides an alternative approach for selecting the best potential model among many for time series data. It demonstrates how minimizing an information criterion can be useful for model selection in a time-series environment in comparison to some standard hypothesis testing strategies.

The objective of this study is to analyse how changes in relevance criteria are related to changes in problem stages during the task performance process. Relevance is understood as a task‐ and process‐oriented user construct. The assessment of relevance is based on both retrieved bibliographical information and the documents acquired and read on the basis of this information. The participants of the study were eleven students who attended a course for one term for preparing a research proposal for the master’s thesis. The students were asked to make an IR search at the beginning, middle and end of the course. Data for describing their understanding of the work task, search goals and tactics as well as relevance assessments were collected during the search sessions. Pre‐ and post‐search interviews were conducted during each session. The students were asked to think aloud during the search session. The transaction logs were captured and the thinking aloud was recorded. Research and search diaries were also collected. The findings support to a certain extent the overall hypotheses that a person’s problem stage during task performance is related to his or her use of relevance criteria in assessing retrieved references and documents. There is a connection between an individual’s changing understanding of his or her task and how the relevance of references and full texts is judged. The more structured the task in the process, the more able the person is to distinguish between relevant and other sources. The relevance criteria of documents changed more than the criteria of references during the process. Moreover, it seems that understanding of topicality varies depending on the phase of the process.

This paper aims to deal with the perceptions of banks’ managers about some criteria for assessing creditworthiness related to firms and how these criteria affect non-performing loans (NPLs). The paper wants to respond to the following research question: “Which criteria influence the magnitude of NPLs?” The evidence is based on the improvement of credit quality in the Italian banking system, which the authors study in aggregate and size-specific analyses, creating two subsamples (large and small banks).

The methodology used was a mixed method approach. The values of the variables were quantified according to the information derived from Thomson Reuters (Eikon, Datastream), the financial reporting of the banks and questionnaires directly administered to the bank managers.

This research about loans selection criteria provides useful indications for “The Basel Framework”. The results show that managers of the large banks are improving the approach of allocating the loans; the managers of the small banks are getting worse in the period 2006-2016. Therefore, it should be valuable to build a new standard about qualitative and quantitative criteria to recognize credit risk. In particular, these criteria could be adopted to reduce NPLs, and they should be different in small banks and large banks.

The study is part of empirical research investigating the causes of the significant increase in NPLs in the Italian banking system in 2006-2016. Most research interprets the increase in NPLs in the Italian banking system only as an effect of the crisis in the Italian entrepreneurial system. This research offers a different interpretation of the problem, interpreting the phenomenon as a delay of the banking system in investing in an effective information criterion.

Traditionally, information security management standards listing generic means of protection have received a lot of attention in the field of information security management. In the background a few information security management‐oriented maturity criteria have been laid down. These criteria can be regarded as the latest promising innovations on the information security checklist‐standard family tree. Whereas information security maturity criteria have so far received inadequate attention in information security circles, software maturity endeavours have been the focus of constructive debate in software engineering circles. Aims to analyze what the alternative maturity criteria for developing secure information systems (IS) and software can learn from these debates on software engineering maturity criteria. First, advances a framework synthesized from the information systems (IS) and software engineering literatures, including six lessons that information security maturity criteria can learn from. Second, pores over the existing information security maturity criteria in the light of this framework. Third, presents, on the basis of results of this analysis, implications for practice and research.