Recent trends of research in open and distance education in India

Purpose – The purpose of this paper was to analyse the research trends on the Indian Open and Distance Education (ODE) system as reflected in the articles published in the prominent journals of distance education across the world. Design/methodology/approach –A study was undertaken to review the research articles on ODE in India published in 11 prominent peer-reviewed journals of distance education during the period 2010–2019. Content analysis was done to find out areas of research undertaken in the ODE of India based on a validated classification of research areas; types of research studies conducted; and authorship and publication patterns. Findings –Out of a total of 2,571 articles published in 11 selected journals, only 191 (7.42%) pertained to ODE in India. The majority of these 191 articles (68.42%) were published in Indian journals. The Indian and Asian journals together accounted for 93.55% of total articles. Globally, the share of articles on the Indian ODE system was significantly low ranging between 4.27 and a maximum of 10.77%, which was much below expectations from a country having the maximum number of ODE learners in the world. Results further revealed that 63% of the contributors to research on ODE in India were affiliated to Indira Gandhi National Open University. Research limitations/implications – The limitation of this study was only analysing the research articles published in journals of distance education and other types of articles, namely, book reviews, editorials, field notes and workshop reports were excluded from the analysis. Practical implications – The study is intended to help researchers, policymakers, and open and distance education institutions to draw a roadmap for the promotion and conduct of system-based research, which would be vital for strengthening the system. Recent trends of research in education


Introduction
The seed of distance education, sown in the middle of the 19th century, blossomed a century later, for the reason that many countries had adopted it post-Second World War. Decolonization led many nations on the trail of expanding their educational base. The opportunity of access, affordability and convenience offered by the Distance Education system made it the preferred choice for them. The foundation of the British Open University in 1969 was a seminal moment in the history of distance education and its subsequent success had a rippling effect across the world (Srivastava, 2012). The Open University system ushered in "radical deviations from the traditions of University Education" by introducing large scale industrialization of education (Peters, 1983). By this time, a century's worth research had gone into the growth and development of the Distance Education system. On the basis of review of the research conducted in the field of distance education during 1970s and 1980s, "the dearth of research on Distance Education was replaced by a wealth of studies" (Holmberg, 1986). More than 300 studies on distance education could be listed that had been published mostly in the latter half of the 1970s and the beginning of the 1980s. Interestingly these research studies had their base in the knowledge and theory already developed in other disciplines such as Education, Philosophy, Psychology, Sociology, History and Economics. Such efforts that lead to emergence of new knowledge, can be ascribed to the beginnings of a new discipline, that of distance education (Holmberg, 1986).
The first journal to publish research specifically in the field of distance education was "Distance Education" published by the Australian and South Pacific External Studies Association (ASPESA)the predecessor of the Open and Distance Learning Association of Australia (ODLAA), founded in 1973 for professional development of distance educators working in Australia, New Zealand, Papua New Guinea and the member countries of the University of the South Pacific (Bewley, 2008). It was followed, almost simultaneously in the 1980s, by launch of three more international journals, namely, "Open Learning" in 1986 (renamed as "Open Learning: The Journal of Open Distance and e-Learning"); the "Journal of Distance Education" in 1986 (renamed as "The International Journal of E-Learning and Distance Education" in 2014) and the "American Journal of Distance Education" in 1987. These journals played a pivotal role in establishing distance education as a separate discipline in the scholarly world (Moore, 2016). The distance education as a discipline thereafter never looked back and a number of good quality journals were introduced centred around various facades of open and distance education (ODE) which has resulted in an exponential growth in the literature on ODE.
India, with 15 Open Universities (OUs), more than a 100 Directorates of Distance Education (DDEs) which are functioning under Dual Mode Universities (DMUs), and more than 1.7 million learners pursuing their higher education through this mode (UGC, 2019), has one of the largest ODE systems in the world. For any system to grow and maintain its quality and standards, its periodic review is essential. Being a dynamic technology-assisted system, ODE keeps on evolving with the adoption of new technological interventions, and needs to be regularly evaluated to ensure the efficacy and effectiveness of the system. The journals published in the field of distance education are providing the platform to distance educators/ practitioners, teachers and students working/studying at these institutions to publish scholarly work in the field of ODE and at the same time disseminate their scholarship and extension of their research to the rest of the world. From an Indian perspective, the Indira Gandhi National Open University (IGNOU) took the lead and started the "Indian Journal of Open Learning (IJOL)" in 1992 for promoting professional development of its teachers, academics and students, including their counterparts working in other OUs and DDEs. The launch of IJOL was major milestone in the journey of research in distance education in India. Along with launching the journal, IGNOU also played a major role in strengthening the concept of system-based research by funding ODE faculty members working at IGNOU, other OUs and DDEs to undertake research on various facets of ODE. The erstwhile Distance Education Council (DEC) under its research project scheme provided funding to nearly 100 research projects to the tune of about 10m rupees (Srivastava, 2012).
The University Grants Commission (Open and Distance Learning) Regulations, 2017, which regulates all ODE Institutions in India, lays major emphasis on research by faculty members (Government of India, 2017). Research has also been made mandatory for all teachers and academics working in Higher Education Institutions (HEIs) including universities, as it acts as an important indicator for evaluating their academic performance in appointments and career advancement (Government of India, 2010, 2018. Promoting and undertaking quality research is as essential for Indian universities, as it is for other universities, to achieve higher global rankings. To encourage system-based research, Research, Innovations and Extension, forms a major criterion for assessing and grading an OU or a DDE working under a DMU for accreditation by the National Assessment and Accreditation Council (NAAC). In the case of an OU, this criterion is assigned 20% of the overall weightage. NAAC evaluates an OU by assessing the contribution of its teachers and other academic staff members in research for the development of the ODE system; and other disciplines to contribute to new knowledge. Therefore, OUs are expected to give due consideration to research and provide a conducive and enabling environment in terms of infrastructure, human resource and finance, etc. to different stakeholders. Research, hence, needs to be facilitated by a suitable policy framework. This criterion seeks information on the policies, practices of research and development at a university (NAAC, 2019). Also, it is the quality of research which represents the academic image of not just the individual carrying out research, but also the institution to which the researcher belongs.

Objectives
It is in the above-mentioned context, that this research study was undertaken by our team with the dual purpose, first, to review the quantum of research done in the area of ODE in India, and secondly, to find out the status of system-based research in the country in the light of the above developments. The key objectives of the study were as follows: (1) To assess the quantum of research done on ODE at higher education level in India; (2) To explore the trends of areas research in the ODE; (3) To categorize research in ODE from the point of view of the research methods used along with the institutional affiliation of the researchers undertaking research in ODE; (4) To find out the potential areas and the hitherto neglected areas of research in ODE in India and (5) To suggest measures to improve the standards and encourage system-based research.

Recent trends of research in education
Literature review Regular attempts have been made to review and classify research on distance education across the world, with a few isolated attempts on research trends on ODE in India. The first major study that focussed on the research articles published on Correspondence Education, prevalent in India since 1960s, was undertaken by Gupta and Arun in 1986. In their study Gupta and Arun categorized the research articles into 11 areas and highlighted that the focus of research was on the concept and definitions, course development, use of media and technology, student evaluation, student enrolment and dropout, the problems that ails the system and its future. They pointed out that research was still at the nascent stage since most of the articles expressed the views of the authors and not based on empirical study (Gupta and Arun, 1986). The next major study was undertaken by Panda (1992), which was far more comprehensive and exhaustive, covering 142 research articles on ODE in India both published and unpublished and MPhil and PhD dissertations. The research studies across selected articles were classified under nine research themes, with a clear demarcation of research under correspondence education and ODE and further placed in the structural framework of input, process and output model. The themes shortlisted by Panda covered almost all facets of ODE, namely, concept and growth; course design and development; instruction; learner support; media and technology; learners and learning; policy and management; evaluation; economics and staff development. Through his study, Panda (1992) brought out that the majority of the research articles were descriptive surveys with not so structured methodological designs and that there was a lack of holistic studies to arrive at any generalizations. He highlighted numerous constraints for research in distance education which were lack of funding, staff members and institutional policy. This study evolved into a book covering 152 research studies on ODE in India with detailed annotations on 88 research studies with the authors expressing the same concerns as pointed out by Panda in 1992(Panda et al., 1996. The study by Panda was followed by Mishra (1997), who undertook an elaborate study across 361 articles published in four leading distance education journals. He analysed the nature of research published in these journals; research methods used; average number of references per contribution; contributions without references; authorship pattern; the most frequent contributors and their country of origin. The study by Mishra revealed that research in distance education was majorly based on survey method, mostly descriptive and lacked methodological rigour. He also found that single authors were contributing to majority of the research articles and that more than 80% papers originated from the UK, USA, Canada and India, which interestingly coincides with our findings.
On the completion of 10 years of IJOL, Mishra (2002) undertook another study. This time, he did a comprehensive review of all the research articles published in the IJOL since its inception covering the first decade of its existence. In his analysis pointed out that it was the IGNOU that provided it strong institutional support to the journal because of which it emerged as a good platform for exchange of ideas and dissemination of information for both Indian and foreign authors. Mishra's findings, however, matched with his own as well as other researcher's findings that the research methods used in the articles published in IJOL were mostly descriptive, followed by survey method and conceptual analysis with the majority of researchers using questionnaire and psychometric scale and lack of methodological rigour. Another finding that the first author's country of origin being India (66%) and that even within India, majority of articles originated from Delhi, again coincides with our findings. Thereafter, Tripathi and Kanungo (2010) made an attempt to profile the type of research including citation analysis, authorship pattern, popular areas of research and research methodologies used, published in IJOL from 2000 to 2009 covering 204 articles authored by 335 contributors. In a recently published article, Satyanarayana and Mantha (2018) AAOUJ 15,2 had summarized all the review studies undertaken in a chronological manner up to 2006 only. In any case, in the study by Mishra of 2002 IJOL emerged as one of the most scholarly publications of ODE in India.
We did not come across any other such major review of research in ODE in India, justifying the need for taking up the review of literature published on ODE system of India and find out the gaps in the existing research, so as to suggest a way forward.

Methodology
This research study was undertaken to explore the research on ODE conducted in India and abroad and published in prominent journals of distance education during the last decade from 2010 to 2019 by mapping the research contribution of Indian and foreign researchers working at HEIs in India and abroad. The study was based on an extensive review of articles on "Open and Distance Education in India", published in 11 prominent journals in the field of distance education, three of which were published within India while rest eight were published abroad (Table 1). Only those Indian journals were included in the study which featured in the UGC Consortium for Academic and Research Ethics (UGC CARE) list.
Based on data mining of 2,571 articles published across 104 volumes and 306 issues and published between 2010 and 2019 in 11 selected journals; 191 articles that focussed on research in ODE in India, were shortlisted. The content of these 191 articles was thoroughly analysed by our team of six raters or coders for classification of the areas of research, the types of research methods used by the researchers including their institutional affiliations, authorship pattern, gender-wise distribution and a content analysis of research studies conducted. A tool was prepared for data collection covering the following parameters: volume number, issue number; total number of articles published in each issue; article on ODE in India which was further classified under the following: research area, research method used; institutional affiliation of the author(s) and gender of the first author, The collected data were subjected to quantitative and descriptive analysis for reporting the outcomes of the study and graphical presentations to explicitly highlight the findings.

Inter-rater reliability between coders
In order to ensure the reliability of data and rating methods, the authors conducted an interrater reliability test, by conducting a sample analysis across 30 randomly selected articles. In order to ensure minimum variation, the coding was done at two levels, first all the six authors (coders) coded the articles distributed amongst them and second, once the coding at individual levels was completed, all the six coders were divided into two groups of three coders each, who again checked the correctness of coding. Finally, for evaluating the degree of consistency amongst the coders, we used the Cohen's Kappa by randomly selecting 30 articles (Cohen, 1960;Neumann, 2007;Zawacki-Richter et al., 2009). For the classification of research methods, a coding consistency of 0.799 was achieved between groups A and B. The coding consistency for classification of research area between group A and group B was 0.934. Thus, the inter-rater reliability, being more than 0.75, was excellent for both coding of research methods as well as research area (Fleiss, 1981;Bakeman and Gottman, 1997).

Findings and analysis
Journal-wise representation of research on ODE in India An analysis of articles published in the selected 11 journals of distance education, revealed that out of total 2,571 articles published during the period 2010-2019, only 191 or a meagre 7.42 pertained to ODE in India (Table 1). Interestingly a majority of these articles (68.42%) were published in the journals published from India, namely, Indian Journal of Open Learning  Figure 1).
The shares of articles published on Indian ODE within respective journal was also calculated. The findings show that barring IJOL wherein articles on Indian ODE featured to the tune of 72.92%, no other journal, including those published within India, contributed more than 34% on Indian ODE (EduTech 33.33% and AJDE 30.57%) of the total articles published therein.
The year-wise distribution data of articles further showed that the share of articles on ODE in India in the overall publications was significantly low ranging from a low of 4.27% in 2014 to maximum 10.77% in 2013 ( Figure 2). This low representation for sure was much below expectations from a country contributing to maximum number of ODE learners in the world. Thus, our findings coincide with the findings of other researchers including Mishra (2002).

Pattern of authorship
In order to study the authorship pattern as to whether the research on ODE in India has been solitary or collaborative, and if collaborative, then whether the collaboration was inter-or  Recent trends of research in education intra-institutional, we examined the trends in authorship of the research articles over a period of 10 years across both Indian and International journals. We also tried to map the genderwise distribution of the researchers, by taking into account the gender of the principal and corresponding author. In case the principal and corresponding authors were different and belonging to different genders, then we split the score equally between the two. In respect of articles not explicitly notifying the principal or corresponding author, the gender of the first author was taken into account. The total number of authors, who contributed the 191 articles in our study, was 333. The authorship pattern (Table 2, Figure 3) revealed that almost 97 (50.78%) articles were published by single authors against 94 (49.22%) articles in collaboration. Of the 94 articles published in joint authorship by 241 researchers, accounted for 29.32%; and 14.66% of total 191 articles were published in joint collaboration of two and three authors, respectively. An insignificant 3.66% and 1.57% of the articles were published in joint collaboration of four and five authors, respectively. Trends further showed that except for the year 2010, when publications in joint collaboration of two authors were more than the single author publication, the single author publications always outnumbered publications by two or more authors. This trend in publication of articles on Indian ODE system was indicative of the kind of research undertaken by these authors, which was mostly system based, directed towards policy formulations or representation of learner support services data, where most of the  An analysis of the institutional affiliation pattern of the 333 authors showed that almost 99% of the articles were written by authors affiliated to Indian Institutions (50 institutions) against only three authors belonging to institutions outside India, i.e. Commonwealth of Learning, Canada, Queensland University of Technology, Brisbane, Australia and University of Houston, Texas. Interestingly all the authors (100%) in both Indian and foreign institutions were of Indian origin who had contributed articles on ODE in India (see Figure 4).
Further analysis of institutional affiliation of the authors revealed that 233 authors were affiliated to Indian Open Universities and 205 were from the Indira Gandhi National Open University alone. Thus, out of the total number of authors from Indian HEIs, 63% came from National Open University, i.e. IGNOU. The contribution of authors from State Open Universities was 8%, together making the contribution of authors working in OUs to 71%. Authors working at other universities (55 authors) and institutions and colleges (38 authors) accounted for the 29% of the total authors which was below expectation, considering more than 200 conventional universities and standalone institutions have been offering programmes through distance mode during this period. Our data in respect of institutional affiliation and collaboration of authors coincides with that of Wong et al. (2016) who reported that a majority of research collaboration was done between authors from the same institution.

Recent trends of research in education
Classification of research methods On the lines of majority of reviewers (Grant et al., 1987;Zawacki-Richter et al., 2009), we also classified research in ODE into quantitativecomprising articles based on statistical analysis of data using simple to multivariate techniques; qualitativecomprising articles using data without any statistical analysis, like case studies, interpretive and descriptive ethnographies, etc.; and mixedcomprising both qualitative and quantitative aspects. Table 3 describes the types of research articles published on the ODE in India during the last decade (2010-2019) in the 11 journals of distance education selected for this study. The study revealed that, as already mentioned in previous sections, out of a total 191 research articles on ODE in India the majority (36.64%) were published in IJOL, followed by TOJDE (20.41 %) and AJDE (19.37%). Interestingly, not even a single article was published in IJEDE on Indian ODE during the last decade. The study further revealed that around 57.07% of the total 191 articles were based on empirical research whereas nearly 42.93% were theoretical in nature. On further exploration of articles based on empirical research studies, it was established that maximum (55.05%) research studies were of mixed type, i.e. using both qualitative and quantitative methods followed by quantitative research (25.69%) and qualitative research (19.26%).
Our findings vary from Zawacki-Richter et al. (2009) who in their study between 2000 and 2008 comprising 695 articles, had reported 29.1% quantitative, 19.9% qualitative, and 12.9% mixed and 38.1% other studies. Our results also vary from that of Bozkurt et al. (2015) who while studying the research trends in distance education on the basis of articles published between 2009 and 2013, brought out that research studies were mostly qualitative (47%) and quantitative (37%), and just a few were mixed (16%). One of the reasons for this variation is perhaps the fact that only about three-fifth of research studies on ODE in India were empirical in nature (see Figure 5).
Further analysis of data on two specific parameters, namely, (1) authorship and (2) the research methods used by the authors, (Table 3) revealed that 53.40% of the principal authors/corresponding authors were females whereas 46.60% were males. This shoulder to shoulder contribution of males and female researchers was certainly an encouraging trend, establishing an encouraging gender-wise representation of faculty members and researchers working in ODE system. With regard to the research methods employed, it was found that while quantitative methods of research were dominated by males, female researchers had majorly undertaken theoretical research methods, and in case of empirical studies they were   Recent trends of research in education more focussed towards qualitative research as well as usage of mixed methods comprising both quantitative and qualitative methods in comparison to their male counterparts,. A journal-wise analysis has been presented in Table 3.

Classification of areas of research
The ODE system is a global phenomenon and hence every country has different research priorities based on the social, economic and geographical context, complexities and requirements. Since the authors attempted to evaluate the trend analysis of research in the ODE system in India, they found it appropriate to select those parameters that were likely to have an impact and change the direction in which ODE was likely to progress in the near future. Therefore, the seven key parameters identified and prescribed by the NAAC for assessment and accreditation of Open Universities and Directorates of Distance Education, formed the broad categories of classifying research articles published in the journals selected for present study, (mentioned at serial number 1 to 7, Table 4). In addition, since the research in the country could not be segregated and isolated from global perspectives and development in the field of ODE, the following four more areas were also added explicitly in addition to the above listed seven categories, namely, Scope, Growth and Development; Economics and Funding; Quality Assurance in ODE; and Globalization and Networking (mentioned at serial number 8 to 11, Table 4). We thoroughly examined all the 191 articles on Indian ODE system for classifying them on the basis of research area an analysis of which has been given in Table 5, Figure 6. The data in Table 5 revealed the frequency of publications under different areas as categorized under 11 heads. A glance at the total number of publications across the broad categories of research over a period of 10 years showed that teaching, learning and evaluation comprised the highest number of articles with 36.13% of the total publications followed by articles on the curricular aspects (18.85%); learner support and progression (14.13%); governance, leadership and management (9.95%); research, innovation and extension (6.81% ); scope, growth and development (6.28%); infrastructure and learning resources (3.14%); quality assurance in ODE (2.62%); institutional values and best practices (0.52%); economics and funding (1.05%); and globalization and networking (0.52%). Our findings somewhat coincide with the findings of Wong et al. values and best practices, which certainly was discouraging, requiring ODE institutions in India to introspect and take measures to improve research in those areas. Taking cue from the available data, it could be inferred that probably our ODE institutions were yet to focus on areas with a global perspective. Our findings of an imbalance in the articles published across various research areas is in consonance with that of Zawacki-Richter et al. (2009) andBozkurt et al. (2015) who had also found an imbalance between research areas as well as the fact that research on areas such as globalization and cultural aspects of ODE remain relatively scarce. We further carried out a brief content analysis of kind of research reflected under each research area and the key focus of the articles identified under the 11 research themes/areas have been outlined area wise: (1) Curricular Aspects (36 articles) A large number of articles (36 or 18.85%) were from this theme. There were articles on the use of electronic media for transaction of the curriculum focussing on the development of mainly cognitive skills through use of information and communication technology (ICT). Several of the articles were based on studies undertaken that used enquiry methods for eliciting response from the learners on their preferred media for instructional purposes. A few studies were on programme development processes as well as programme evaluation on lab-based programmes through distance mode, namely, geriatric medicine, physics, dietetics and food Economics and funding Costing; cost benefit analysis; funding; income and expenditure 10 Quality assurance in ODE Assessment and accreditation practices; quality-related issues and policies; mechanisms for quality assurance 11 Globalization and networking Issues pertaining to globalization; networking amongst institutions, etc.   Table 5.
Journal-wise frequency of publication across the 11 research areas AAOUJ 15,2 safety management, engineering, etc. Enhancement of employability skills of the learners through components on skill development in the curriculum design was also emphasized upon in a few articles. Even collaboration with industry for design of the skill component for smooth transition from learning to earning was suggested. A few articles were also based on need assessment studies for development of programmes.
(2) Teaching Learning and Evaluation (69 articles) This theme represented the highest number of articles (69 or 36.13%). However, it is worth mentioning that the articles on this theme were concentrated in two journals, namely, IJOL and AJDE. The articles have dealt comprehensively about the use of ICT interventions in ODE institutions for reaching the unreached particularly in respect of disadvantaged sections of the society for their education including jail inmates. The articles focussed on some viable models for integrating ICT in teaching-learning, student admission, library services and student evaluation. A number of articles highlighted the massive use of OER, MOOCs, cloud computing to the advantage of reaching out to heterogeneity in population and the challenges associated with them. A considerable number of articles also dealt with the MOOC initiative of India, i.e. Study Webs of Active -Learning for Young Aspiring Minds (SWAYAM). Articles had dealt with the importance of data mining and how it helped in maintenance of admission records and examination performances. The articles had also focussed on the challenges before institutions in using ICT (such as mobile applications, online learning, virtual labs, podcasting, OERs, MOOCs, etc.) with regard to their acceptability amongst learners by analysing the learners' perception towards the use of various ICT in their learning endeavours. The publication trends in this area were indicative of massive thrust by Indian ODE Institutions including OUs towards infusing technology in the teaching learning and evaluation processes, which certainly was an encouraging trend.
(3) Research, Innovations and Extension (13 articles) The articles under this theme were devoted to innovations in the use of Web 2.0 tools in enhancing the learning experience of the distance learners, such as social networking services for reaching out to new generation learners. Some articles were specific about innovations done through collaborations with industry in the skill enhancement of the workforce; for improving agricultural practices in the farming community; for teaching foreign language programmes through ICT; initiation of the project for providing continuing education and Recent trends of research in education obtaining civilian degrees to armed forces; and creation of a centre for innovation for dissemination and collation of innovative practices in an ODE institution.
(4) Infrastructure and Learning Resources (6 articles) The articles under this theme, underlined the instrumental role played by ICT to promote and facilitate learning in the distance learners and focussed on the adoption of web-based technologies and IT infrastructure by ODE institutions. Some of the articles also discussed about the role of government technical support in the delivery of ODE programmes. Case studies and best practices with regard to use of technology and their impact particularly on the functioning of OUs and on the ODE system as such were also included under this category.
(5) Learner Support and Progression (27 articles) After first two research areas, learner support and progression attracted a good number of articles (27 or 14.1%). The majority of the research studies under this area discussed the use and effectiveness of ICT/latest technologies in support services to improve the quality of ODE in India. Some studies were undertaken to garner the views of the learners on: the curriculum of the programme of study; effectiveness of academic counselling; their study habits; the use of ICT in programme delivery; improvement in their career prospects after completion of their programme of study and their opinion/expectations from the policy on ODE. The nature of student's grievances and queries and resolution mechanisms were also analyzed. There was also a study that compared the motivation levels of ODE learners with that of conventional learners.
(6) Governance, Leadership and Management (19 articles) The articles under this thematic area were dedicated majorly to e-governance and management of institutions for both human resource and financial management, through the use of modern technologies. Some articles focussed on online staff development strategies for improving the effectiveness of the internal processes as well as delivery of services to the learners. Thus, the focus was on the use of ICT for bringing in the much-needed transformation of the ODE system.

(7) Institutional Values and Best Practices (1 article)
There was only one publication found under this theme. The article focussed on ODE system in India for promoting inclusive education and discussed the role of the national OU in successfully imparting education and training to socially, economically, physically and/or geographically disadvantaged, in addition to women, minorities and jail inmates.
(8) Scope, Growth and Development (12 articles) The research studies under this theme, discussed mainly the scope of ODE in empowering the marginalized sections of the Indian society; for reaching out to the populations living in the remote and hilly regions such as the North East; a system suitable for catering to the needs of a post-industrial age; and one research study even discussed the need for the disruption in the existing system and the suggested the way forward to cope with the requirements of the digital age. There was only one impact assessment study of ODE on urban and rural distance learners.
(9) Economics and Funding (2 articles) Both the articles have dealt with the unit cost of higher education in general and ODE in particular, focussing on the cost effectiveness of investment in higher education, comparative development cost per student in universities, different types of educational costs, including the cost analysis of academic programmes and economies of scale.
(10) Quality Assurance in ODE (5 articles) All the articles focussed on quality of the pedagogy through ODE and online modes. One of them focussed specifically on how to improve the quality of Teacher Education through distance mode. Also, an online model for mentoring HEIs preparing for quality assessment and accreditation was included under the theme quality assurance.

Potential areas
Themes like "Governance, Leadership and Management" and "Research, Innovations and Extension" were moderately explored by researchers during last decade. It has further been observed that "Globalization and Networking" thematic area was the least preferred by the researchers for the purpose of research as only one research article was written in this area. Besides this, "Economics and Funding" theme was not touched upon significantly with only two articles found in the journals, though the inflow and outflow of monetary resources is the backbone of any system and considerably required to plan for future endeavours and hence, needs exhaustive research. For any institution to flourish and mark its significance, both quantity along with quality matters, however, without quality, numbers may not sustain for long. Keeping this fact in mind, it is pertinent to mention here that a theme like "Quality Assurance in ODE" was not considered a priority area for research as only five articles were published in the said area. Another area, namely "Institutional Values and Best Practices" was also a neglected area with only one article belonging to this particular theme. Apart from above-mentioned thematic areas, "Infrastructure and Learning Resources" which is an important area reflecting the development of an institution, barely six articles were articulated on this theme, in the last 10 years. Further, the OUs and DMUs over the years have evolved and have established practices that have become their recognizable attributes or distinctions. These special attributes need to be studied and extensively published so that the model can be replicated or modified as per the needs of other universities. Also, NAAC has established the benchmarks to maintain the standards of quality in the ODE system. New areas of importance have emerged which need to be explored and investigated such as empowerment and inclusion; environmental consciousness and sustainability, human values and professional ethics; transparency in financial, academic and administrative functioning; responsiveness towards learners; accountability and transparency; e-governance; technology enabled learner support; etc. (NAAC, 2019).

Measures for strengthening system-based research
The journey of distance education research, not only in India but also in Asia, has been staggered in terms of its outcome and application for development of the ODE system. The SCImago Institutions Rankings (SIR) (2020) which ranks academic and research-related institutions based on research performance, innovation outputs and societal impact measured by their web visibility reveals that only five OUs figure in the portal consisting of 3898 HEIs, namely, The Open University of UK (United Kingdom) ranked 795; the Open University Netherlands (Netherlands)1658 ; the Open University of Israel (Israel) 2,144; Anadolu University (Turkey) 2,328 and Hellenic Open University (Greece) 3105. Interestingly, none of the Asian Open Universities featured in the list. This scenario is palpable since the Recent trends of research in education ODE institutions particularly in India need to travel extra miles and take their endeavours towards making their research base strong. It is not that research is not going on in Indian Open Universities; rather, perhaps it is the non-publication by Indian researchers in international journals that has projected this picture. A university is known by the research it indulges in. Research is the gateway to investigate and identify the gaps and infuse new ideas into the system. The following measures adopted by ODE institutions will strengthen research on ODE system and yield the desired results.  (Gaba, 2007).

Institutional policy on system-based research
A critical analysis through the present study also poses a formidable question. Where have we gone wrong? Maybe it is the absence of a robust institutional policy which has prevented or impeded the research temperament in the OUs and Dual Mode Universities. An institutional policy will put the faculty on the path to undertake both discipline-based and system-based research. System-based research needs to be encouraged by ODE institutions to constantly review the existing practices and bring about qualitative improvements in the functioning of the system. ODE being a dynamic system adopting and adapting to the new technological advancements, needs to be constantly changing as per the requirements of the target groups it serves. However, all systemic changes should be informed decisions embedded in solid research. This will reflect on the commitment of the institution towards quality assurance.

Funding of research activities
The financial health of the OUs, further limits the promotion of research. The 14 State Open Universities in India, contributing significantly to the higher educational aspirants in the country have immense potential. They need adequate financial resources for research, capacity building activities, incentive for research and most pertinently, government support. Therefore, the onus is on the government as well as ODE institutions to encourage research at the university, both systemic and discipline based. In India, where the government targets towards increasing the GER, thrust should be on empowering those universities/institutions particularly which are offering education at affordable costs to the disadvantaged sections of the society.

Collaboration with industry
Collaborative research activities with industries, is one of the important aspects to be integrated in the institutional policy of an ODE institution. Besides the institutional policy, AAOUJ 15,2 what is important is the need to conduct multidimensional research. It is worth mentioning Borje Holmberg's distinction between endogenous and exogenous research. Endogenous research looks at work done within distance education, such as studying the methods, systems, media, etc. Exogenous research focusses on the economic, demographic, cultural, social and political contexts of ODE. (Kanwar and Balasubramanian, 2014). "Institutions that generate knowledge increasingly play a role in the networks of relations among the key actors: University (Science), Industry (Business), and Government (Governance). The governments create a system that defines, regulates an innovation process of enterprises. Conceptualization of this system is provided by a three-dimensional vector space called Triple Helix of university-industry-government model. Each of the three actors, universityindustry-government, participates in Wealth generation" (Vaivode, 2015).

Conclusion
The extensive review done by the authors reveals that in spite of having access to online journals, the presence of research studies on ODE on India in foreign journals is scanty; slightly better represented in the Asian journals and Indian journals. The quantum of research is not proportionate to the number of faculty members working in the ODE system of India and the large number of learners that it serves, which is a matter of concern. Research on ODE in India, in absence of a strong institutional policy for research in the premier universities offering programmes through distance mode, faces a number of challenges that need to be addressed. Even after nearly six decades of the existence of Dual Mode Universities, and nearly four decades of OUs in India, the institutional best practices pertaining to ODE have not generated required attention perhaps due to lack of networking and collaborative ventures amongst ODE institutions as well as fewer number of publications in international journals. However with the emphasis on research output of the teachers working in HEIs, including Open Universities and Directorates of Distance, Education, which is an essential and important parameter for accreditation of the institution, its national ranking, as well as a mandatory requirement for career advancement of teachers, the research is picking up a fast rate. This study will provide valuable insights and certainly act as an ignition to motivate ODE practitioners, working at Open Universities and Dual Mode Universities, to take the research on ODE forward. In fact, for any system to grow its periodic systemic review is essential, more so for the ODE system, being a dynamic and innovative system that constantly keeps on evolving, through the adoption of newer technologies for improving curricular aspects, teachinglearning and evaluation and learner support services to its dispersed learners. The ODE system in India requires more empirical research to be undertaken periodically. The research outcomes need to be ploughed back into the system for its betterment. Thus, the missing links in distance education research which are yet to be addressed in its entirety needs to be systematic, professional and action based.