Search results

Surveys in multinational, multiregional and multicultural contexts (or “3MC” surveys) are becoming increasingly important to global and regional decision-making and theory building. To serve this purpose, the surveys need to be well managed, with an awareness of key sources of survey error and how to minimize them, mechanisms in place to control the implementation process and an ability to intervene in that process when necessary in a spirit of continuous improvement (Pennell et al., 2017). One key approach for managing and assessing the quality of 3MC surveys is the total survey error (TSE) framework and associated survey process quality. This paper aims to examine the application of the TSE framework and survey process quality to the Programme for the International Assessment of Adult Competencies (PIAAC).

The authors begin with a background on TSE and discuss recent adaptations of TSE and survey process quality for 3MC surveys. They then presents a TSE framework tailored with examples of potential contributions to error for PIAAC and ways to address those through effective quality assurance (QA) and quality control (QC) approaches.

Overall, the authors find that the design and implementation of the first cycle of PIAAC largely reflect the current best practice for 3MC surveys. However, the authors identify several potential contributions to error that may threaten comparability in PIAAC and ways these could be addressed in the upcoming cycle.

With a view toward continuous improvement, the final section draws on the survey process quality approach adapted from Hansen et al.’s study (2016) to summarize the recommendations in terms of additional QA elements (inputs and activities) and associated QC elements (measures and reports) for PIAAC’s consideration in the next cycle.

At the invitation of the Programme for the International Assessment of Adult Competencies (PIAAC), this paper aims to examine advances in survey interviewer monitoring and make recommendations on minimizing the effect of interviewers on survey results.

The authors first provide an overview of the most recent literature on interviewer effects, quality assurance and quality control. Here, they draw upon recent publications such as the cross-cultural survey guidelines (www.ccsg.isr.umich.edu) and newly published or in-press material specifically addressing these issues in multicultural, multinational and multiregional (3MC) contexts.

The authors discuss trends and innovations in quality assurance and quality control in 3MC studies and draw upon examples from international surveys that are using cutting-edge and innovative approaches to monitor interviewer behavior and minimize interviewer effects.

With a view to continuous quality improvement, the authors conclude with concrete recommendations for PIAAC to consider for the next cycle. Many of the recommendations have general relevance for other large-scale cross-national surveys.

Evidence from past surveys suggests that some interviewees simplify their responses even in very well-organized and highly respected surveys. This paper aims to demonstrate that some interviewers, too, simplify their task by at least partly fabricating their data, and that, in some survey research institutes, employees simplify their task by fabricating entire interviews via copy and paste.

Using data from the principal questionnaires in the Programme for International Student Assessment (PISA) 2012 and the Programme for the International Assessment of Adult Competencies (PIAAC) data, the author applies statistical methods to search for fraudulent methods used by interviewers and employees at survey research organizations.

The author provides empirical evidence for potential fraud performed by interviewers and employees of survey research organizations in several countries that participated in PISA 2012 and PIAAC.

The proposed methods can be used as early as the initial phase of fieldwork to flag potentially problematic interviewer behavior such as copying responses.

The proposed methodology may help to improve data quality in survey research by detecting fabricated data.

The purpose of this paper is to explain how an academic library’s Student Experience Survey was revised and improved based on available research on survey design methodology and piloting efforts. Thus, it aims to contribute existing literature on library assessment and survey methodology by addressing issues of planning and coordinating assessment. The paper also provides a guideline on the survey revision process for existing instruments.

The library assessment coordinator collaborated with Assessment Coordinator Advisory Committee (AC2) to revise and improve the survey. The revision process started with adding suggested items and constructing new items based on library assessment planning survey administered to library faculty previously. Regular monthly meetings were held with the committee to facilitate the revision process. Multiple facets of the survey implementation were revised including wording, content, order and format of the items, response scales and survey distribution. Each facet was addressed based on available research on survey methodology and cross-checked with the committee members.

The revised 2018 University of Illinois at Chicago (UIC) Libraries Student Experience Survey consists of a total of nine items with response matrices, single choice response format and open-ended response format to measure students’ satisfaction, need and their use of the various library resources and services. The changes made to the survey are grouped into three categories: wording and content, response categories and scaling and design, font and layout. The revision process of the UIC Libraries Student Experience Survey can serve as an example for academic or other types of libraries that wish to track and report their impact regularly.

The UIC Libraries Student Experience Survey provides evidence that careful revision and piloting as well as obtaining relevant stakeholder buy-in to the process lead to build effective survey tools.

This paper aims to investigate how to promote two types of knowledge contribution tasks. The authors focus on the role of supervisor and coworker support on motivation, and their effects on two different contribution tasks. Motivating employees to contribute knowledge is quite challenging. While previous studies have tried to understand how to promote knowledge contribution, few have differentiated between knowledge contribution tasks.

Information technology support was chosen as the context of this study, and data were collected from system administrators within a Fortune 500 company via a web-based survey.

Results show the differential effects of two forms of motivation on different contribution tasks, and supervisor support is positively associated with intrinsic motivation. Specifically, while intrinsic motivation is positively associated with challenging knowledge contribution, external motivation is positively related to mundane knowledge contribution and negatively related to challenging knowledge contribution.

This study contributes to the current literature by providing a deeper theoretical understanding of knowledge contribution tasks, and contributes to practice by offering suggestions on how to better motivate employees within organizations and promote different knowledge contribution tasks.

The purpose of this paper is twofold: first, to develop, test and validate a set of dimensions that can verify whether any specific online survey tool can be effectively developed and deployed; second, to provide a framework and working topology for web-based survey tool selection.

A panel comprised of five experts determined the validity of the proposed dimensions the authors compiled from extensive feature research of the top online survey software identified by Alexa and Datanyze, which allows for web survey data to be pulled in a customizable fashion over a selected period of time. The validated dimensions were then ranked via a paper survey (n = 98) in a controlled environment using a 9-point Likert scale.

There was no strong correlation between highest-ranked dimensions and the market share and use of a particular online survey tool. However, overall dimension ranking dominance did predict an online survey tool obtaining higher market implementation and use. In addition, the influence of business roles on dimension weights should be considered when selecting survey software. Finally, two additional dimensions not prevalent in existing research – data analysis and technical support – must be considered in survey tool selection.

Online survey tools are increasingly supplementing or replacing random telephone-based opinion and polling surveys for data collection on important social issues, political candidacies, etc. Representative samples yielding the most accurate results are more easily obtained via mixed-mode methods that incorporate online survey tools.

The paper's findings suggest which dimensions must be present for widespread acceptance and implementation of a successful web-based online survey tool. Organizations must be able to assess a particular survey tool's viability for their specific purposes. The dimensions presented here can be developed into an effective adoption heuristic to meet an organization's particular requirements. Findings suggest that when evaluating survey software, one must remain cognizant of the various business roles associated with survey software to better account for decision-maker tendencies. For example, managers place greater emphasis on overall cost whereas developers may value survey creation and integration features.

The primary objective of this paper is to identify and analyze factors that influence choice and quality of healthcare of the elderly population in two northern and two southern states in India. The purpose of this paper is to look beyond the obvious factors that influence choice and therefore the quality of healthcare and seek to find whether there are some additional indirect factors that also influence choice and quality of healthcare.

This paper utilizes data from the Longitudinal Aging Study in India pilot project, which was a cross-sectional survey of men and women aged 45 and over focusing on two northern states (Punjab and Rajasthan) and two southern states (Kerala and Karnataka). In this paper the authors carry out a Probit analysis to estimate the factors that influence the elderly’s choice of healthcare.

The authors find that social activity via different types of social interactions outside the home and access to a phone (which is one of the cheapest and most commonly used methods of communication used by people in India) are statistically significant in influencing better quality of healthcare for the elderly. Moreover, gender-segregated results suggest that social activity is particularly important for elderly females. Relative price of healthcare is also an important determinant of the quality of healthcare sought. The authors also find some consistent regional influences on healthcare choices by the elderly.

The main limitation is the data itself which is cross-sectional in nature. However, as further rounds of survey are conducted the authors hope to be able to build on the results of this paper using a longitudinal approach. A second limitation is the lack of variables available for carrying out an instrumental variables analysis. The results imply that elderly males and females are influenced by different things when it comes to healthcare choices. Thus for policy to be effective, the government needs to pursue avenues that would be most likely to succeed.

One of the most important practical implications of this research is the understanding that informal channels of knowledge transmission are important especially for the elderly in India. Traditional methods of knowledge transmission such as education, media, and income are less likely to be effective in a country where majority of the people are illiterate and poor. Social interactions appear to be most effective in influencing healthcare choices of elderly females.

The most obvious social implications of this paper are the importance of social interactions via social activities outside the home and ability for social communication via access to a phone for the elderly population in India to make better healthcare choices and therefore receive better healthcare.

The literature on elderly healthcare is limited when it comes to developing countries. What makes matters worse for India is that up until recently there have been no comprehensive efforts to collect reliable data on the elderly population in India. As a result there is extremely limited availability of policy-relevant research dedicated to issues relating to the older population. Most of the existing literature looks at self-reported health and healthcare status or utilization. This paper would be among the first to address factors influencing quality of healthcare received by the elderly population in India.

The purpose of this study was to explore 232 service providers’ and policymakers’ experiences of supporting children’s well-being during the pandemic, across sectors, in 22 countries – including Kenya, the Philippines, South Africa, India, Scotland, Sweden, Canada and the USA, in the last quarter of 2020.

A smartphone survey delivered via a custom-built app containing mostly open-ended questions was used. Respondents were recruited via professional networks, newsletters and social media. Qualitative content analysis was used.

The findings reveal numerous system-level challenges to supporting children’s well-being, particularly virus containment measures, resource deficiencies and inadequate governance and stakeholder coordination. Those challenges compounded preexisting inequalities and poorly affected the quality, effectiveness and reach of services. As a result, children’s rights to an adequate standard of living; protection from violence; education; play; and right to be heard were impinged upon. Concurrently, the findings illustrate a range of adaptive and innovative practices in humanitarian and subsistence support; child protection; capacity-building; advocacy; digitalisation; and psychosocial and educational support. Respondents identified several priority areas – increasing service capacity and equity; expanding technology use; mobilising cross-sectoral partnerships; involving children in decision-making; and ensuring more effective child protection mechanisms.

This study seeks to inform resilience-enabling policies and practices that foster equity, child and community empowerment and organisational resilience and innovation, particularly in anticipation of future crises.

Using a novel approach to gather in-the-moment insights remotely, this study offers a unique international and multi-sectoral perspective, particularly from low- and middle-income countries.

Construction trade unions have been a vital force in improving the job standards and wellbeing of trade workers. However, the union membership in the construction industry has dropped by half between 1983 and 2017. The objective of this study is to identify and assess the controlling factors of construction electrical trade unionization in the United States.

The study involved four main steps. Literature review and industry townhall meetings were conducted to identify the electrical trade unionization factors. A new unionization trend metric was developed using available union market share data to quantify the growth and decline of local unions. Mixed-mode surveying was used to collect questionnaire and interview data on the unionization factors in different local units of the electrical trade union. Finally, the survey data from the questionnaire and interviews were merged and their correlation with the unionization trend data was assessed.

The study found that the unionization of this specialty trade is dependent on increasing the crew ratio, expanding the non-apprenticeship union membership program, organizing larger contractors, and continuing the union focus on public and heavy industrial projects.

The study contributes to the construction management body of knowledge by providing a data-driven industry-wide assessment of the factors that affect electrical construction unionization. The study advances the understanding of construction trade unions by narrowing the theory-practice knowledge gap, illustrating the use of macro quantitative empirical research methods, and developing a new unionization trend metric.