STANDARDS AND INDEXES FOR EVALUATING OPEN UNIVERSITIES

This article is the second part of the research on the institutional evaluation of the open universities. The title of the first one was ‘Evaluation Standards for Institutional Evaluation of Open Universities,’ which was presented at the 22nd AAOU Annual Conference, Tianjin, China. In the previous study we discussed the definition of university evaluation and some of the controversial points in the existing evaluation. The focal point was that the existing standards and indexes are not appropriate for Korea National Open University (KNOU) as an open university, and that it is necessary to establish a new evaluating system for the university. We believe it is true of the other open universities throughout Asia and the world. In short, the present research provides the practical and effective data on the evaluation standard. It also includes some new qualitative, quantitative and modified evaluation indexes reflecting the distinctive features of the open universities. The main part of this article elaborates on 5 evaluation domains, 23 evaluation sections, 81 evaluation items and 229 evaluation indexes. These evaluation domains, sections, items and indexes result from the practical surveys and AHP and Swing analyses. The result of this research will prove a good and essential element for ranking indicators in ODE universities. At the end of the paper we add some new standards and indexes for evaluating regional campuses of the open universities, which is another important agenda for upgrading the learner support throughout the country.

As only university of its kind in Korea, Korea National Open University (KNOU) has been categorized and evaluated as one of traditional universities by Ministry of Education, Science and Technology (MEST) of Korea and Korean Council for University Education (KCUE).Since 1972, KNOU was evaluated twice by KCUE, in 1999 and2006.However, due to the inappropriate evaluation standards and indexes, the results of evaluation were not gladly accepted by KNOU.Kim, Bowon & C. Y. Yang (2008) raised a question about standards and indexes for evaluating open universities which was conducted by government.They discussed about followings; first, the definition of university evaluation including types and areas evaluation is mentioned.Second, it explains why the results of evaluation on KNOU are not accepted and which are controversial among the existing evaluation and the standards.Third, it elaborates the distinctive features of KNOU, which are based on the circumstances of KNOU.Finally, it discusses and suggests several modified and new standards and indexes for KNOU evaluation reflecting more prominent features of KNOU.
On the basis of the results of previous study, this study will be more specific and practical in terms of providing evaluation domains, sections, items and indexes.Since Kim, Bowon & C. Y. Yang (2008) already pointed out the problems of existing standards and indexes and what should be added and modified in order to properly evaluate open universities, in this study we mainly focus our attention on how we make evaluation standards and indexes and how distinctive features of open universities are reflected in evaluation standards and indexes.Full list of evaluation standards and indexes are provided in this study.

EVALUATION DOMAINS, SECTIONS, ITEMS AND INDEXES
The evaluation standard for KNOU consists of 4 categories, that is, evaluation domain, section, item and index.Each category is subdivided as follows; 5 evaluation domains, 23 sections, 82 items and 229 indexes.The full marks of this evaluation standard are 1,000 points.The practical surveys, AHP (Analytical Hierarchy Process) and Swing analyses are used to analyze and select them.

MANAGEMENT OF UNIVERSITY
The first domain of evaluation standard is 'management of university'.120 points are full marks of this domain.Under the management of university, there are 3 sections, 10 items and 24 indexes.In this domain, 'goal of lifelong education' is added to assess uniqueness of KNOU as an open university.

STUDENTS
Since one of the indispensable factors in evaluating universities is 'students', one fourth of the full marks in evaluation standard, i.e. 250 points, is assigned to this domain.Under the domain of 'students', there are 4 sections, 15 items and 38 indexes.Three out of 15 items are added anew to this standard.In order to properly evaluate the institutional role of lifelong education as an open university, 'the registration rate of new and transferred students' should be examined and included in the evaluation standard.Another important factor which shows effort of university to support students is 'operation of students group'.The third item is connected to student supporting system.It is 'regional accessibility'.

PROFESSORS
Along the previous domain 'students', 'professors' is another essential domain which should be included in evaluation standard.Under the domain of 'professors', there are 4 sections, 17 items and 57 indexes.250 points are assigned to this domain.What is noticeable in this domain is how KNOU operates tutoring and mentoring system and how KNOU manages evaluation system.Unlike other conventional universities and cyber universities, the evaluation forms of KNOU are very various.Various assessment forms are burden to university.Thus, it clearly shows that KNOU willingly provides evaluation service for the sake of students.

SUPPORTING EDUCATION, RESEARCH & FACILITIES
The last domain in this evaluation standard is 'supporting education, research & facilities'.Under this domain, there are 6 sections, 22 items and 69 indexes.The full marks of this domain are 250 points.In order to properly evaluate an open university three items are especially listed in this domain; multimedia lecturing system, institute specialized in open and distance education and equipments related to computers.How easy & convenient to use system Compatibility of system How easy to update system Individual service (10 pts.) Maintaining & repairing plan Speed of system Security of system System of learning management (10 pts.)Adequacy of capacity of system of learning management Goodness on supporting activities of learning Goodness on supporting activities of teaching Goodness on supporting operator of system of learning management Adequacy of data saving & management Stability & security of system of learning management

CONCLUSION
In this study we provides whole list of appropriate evaluation standard for open universities.Since this study is providing practical and empirical data, the result of this study is very useful not only for KNOU but also for other Asian open universities.Such items as 'target of lifelong education', 'average rate of graduation', 'role of lifelong education', 'registration rate of new and transferred students', 'operation of students groups', 'regional accessibility', 'operation of tutoring and mentoring system', 'management of evaluation', 'lecturing facilities prepared with multimedia', 'supporting organization of research & its operation' and 'equipments related to computers' reflect especially uniqueness of KNOU.And 229 indexes which listed in this study are dealing very wide range of evaluating KNOU.Therefore they need to be modified or altered or reduced for applying properly to other open universities.

Table 1 .
Management of university

PLANS OF EDUCATION, CURRICULUM AND OUTCOMES The
next domain of evaluation standard is 'plans of education, curriculum and outcomes'.There are 6 sections, 17 items and 41 indexes under this domain.The full marks of this domain are 130 points.There are two important items which properly evaluate role of open universities in the society.The item 'average rate of graduation' reflects the effort by KNOU to keep students studying at school.Another item is 'role of lifelong education & its contribution to local community'.