Index

A Machine Learning, Artificial Intelligence Approach to Institutional Effectiveness in Higher Education

ISBN: 978-1-78973-900-8, eISBN: 978-1-78973-899-5

Publication date: 29 July 2019

This content is currently only available as a PDF

Citation

Moye, J.N. (2019), "Index", A Machine Learning, Artificial Intelligence Approach to Institutional Effectiveness in Higher Education, Emerald Publishing Limited, Leeds, pp. 215-232. https://doi.org/10.1108/978-1-78973-899-520191012

Publisher

:

Emerald Publishing Limited

Copyright © 2019, John N. Moye.


INDEX

Note: Page numbers followed by “n” with numbers indicate notes.

Ability/abilities
, 1, 6, 10–11, 31–32

instructional support services
, 105

to persist
, 153, 157

Academic success center

component assessment
, 121

service assessment
, 120

Academic years (AYx)
, 146, 175, 178

Accreditation
, 71, 111

Acculturalization
, 4

Achieve/achievable/achievement
, 16–17, 31, 63, 78, 80, 97, 142, 155

Acquisition
, 150

Act
, 164

Action planning process
, 171–172, 189–191

Activities
, 4, 17, 79, 102

Actual functional performance
, 135, 140

Acyclical data
, 192

in ML
, 7

Adapted/adaptable/adaptability
, 2, 7

Advocacy
, 109, 124

Aggregated/aggregate(s)/aggregating/aggregation(s)
, 2–3, 7, 10–11, 26, 29, 36, 39–41, 52–53, 62, 73, 75, 77, 87, 90, 96–98, 113, 115, 119, 121, 126, 129, 131, 133–134, 158, 161, 192

correlation matrix
, 136

functional data into causal triads
, 135

KPIs clusters based on strength of correlation
, 137–138

Agile
, 51

Agility
, 43

Aktas, E.
, 135

Al-Anzi, K. S.
, 24

Alaee, F. F.
, 33

Alan, B.
, 17, 140, 150, 156, 172

Aldge, J. M.
, 77

Alfirević;, N.
, 143, 155

Algorithms
, 6

as measurement strategies
, 7

select and frame performance of interactions
, 192

Ali, L.
, 31

Alibali, M. W.
, 4, 13, 115

Align
, 15, 18

Alignment
, 10, 18, 33, 39, 64, 147

Allen, J.
, 77

Allmer, J.
, 219

Alpaydin, E.
, 6

Alston, G. L.
, 36

Alt, D. d.
, 36, 57

Altaf, A.
, 11, 164

Amabile, T. M.
, 3–4

Amalgamation
, 4

American Libraries Association
, 107

Americans with Disabilities Act
, 21, 108

Amin N.
, 23

Aminbeidokhti, A.
, 139

Ammirato, S.
, 164

Analysis/analyses
, 3, 11–12, 39

Analytic(s)
, 6, 173

Anchors
, 43

Angelides, P.
, 171

Anohina-Naumeca, A.
, 25

Antony, J. S.
, 133, 140, 164

Applied
, 7, 64, 144, 157, 177

Appreciate
, 46–47, 58–59

Aptitudes
, 25, 28

Aranha, C. N.
, 17

Armon, B. K.
, 32

Articulate(d)
, 1–3, 10, 15–18, 20–21, 32–33, 36, 52, 78, 99, 108, 129, 140, 144, 154, 156, 178, 181, 189

Artifact
, 83–87

Artificial intelligence (AI)
, 6, 8–9, 190

visualizations
, 193

Artificial Neural Network (ANN)
, 9, 193

Ashour, A.
, 142

Aspirational/aspirations
, 15–16

Assess/assessing/assessment
, 1–3, 6, 11, 22, 31, 39, 41, 113, 115, 119, 126, 144, 146, 190

authentic application
, 154

career services service
, 127–128

through competing-values approach
, 156, 158, 160–161

competing-values
, 22

component level
, 115

counseling services service
, 125–126

course components
, 90–98

disabilities services component
, 124

disabilities services service
, 123–124

experiential learning
, 115–119

global student services
, 126, 129–131

identification and articulation of KPIs for institution
, 151–153

institutional effectiveness
, 173

process
, 21–22

through strategic constituency approach
, 155–156, 159

through strategic contingencies approach
, 154–155, 158

through systems approach
, 146, 150

trending report of sensemaking data for institution
, 157

Association learning
, 8, 192

Attainment
, 142

Attract stakeholders
, 150–151

Attributes
, 4–9, 11–12, 16, 31–33, 36, 38, 40, 42, 51, 55, 62, 64, 78, 111, 155, 158, 171

Authentic(ity)
, 1, 5, 15, 22, 42, 173, 193

Authentic data
, 5, 190

measure performance of functional systems
, 133

in ML
, 7

models
, 161

Averages (Avg)

GPA of withdrawing students
, 177

length of time to complete program
, 178

program GPA of graduates
, 177

time to withdraw from program
, 177

Badawy, M.
, 3

Badia, A.
, 2

Baetz, M. C.
, 10, 15

Baldasare, A.
, 102

Baldwin, W. G.
, 36

Balint, A. O.
, 173

Banta, T. W.
, 22

Barnett, R.
, 32

Bart, C. K.
, 10, 15

Bauer
, 102

Bazeley, P.
, 6, 164

Bedeian, A. G.
, 6

Beehr, T. A.
, 101

Beemer, J.
, 134

Behavioral/behavior(s)
, 17, 48, 60, 79, 161

Beliefs
, 17

Bell, L. M.
, 77

Benbow, R. J.
, 23

Bennis, W. G.
, 171

Bhatt, C.
, 142

Bidermann, P. W.
, 171

Binswanger, J.
, 4, 11, 13, 115

Birnbaum, H. G.
, 143

Birri, T.
, 51

Bishop, C.
, 199

Blackmore, P.
, 33

Blair, E.
, 80

Blanchard, N.
, 36

Blignaut, R.
, 172

Bloom, B. S.
, 196

Bloom’s
, 51

Blouch, W. E.
, 33

Bock, D. E.
, 36

Boden, M. A.
, 8

Bontis, N.
, 10

Borges, M. N.
, 36

Bortree
, 164

Borysowich
, 172

Bowling, N. A.
, 101

Bowman-Bowen, L. C.
, 18

Boyle, A.
, 164

Bozeman, B.
, 64

Brandon, A. F.
, 57

Breazeale, D.
, 164

Breckenridge, R. S.
, 6

Brigman, S. L.
, 119

Broemmel, A. D.
, 33, 36

Brown, J. S.
, 164

Brown, J. T.
, 140

Burger, S. V.
, 6

Cabral, A. P.
, 190

Camelia, G.
, 2

Cameron, K. S.
, 9, 11, 134

Capabilities
, 16

Capacity
, 73

Career
, 72, 111

Career services

component assessment
, 128

service assessment
, 127–128

Carey, J. O.
, 180

Carey, L.
, 180

Carini, R. M.
, 78

Casarejos, F.
, 145

Categorical

average
, 33, 38, 53, 55, 62, 148

counts
, 33, 38–42, 50, 55, 62, 96, 119

Category/categories/categorized/categorization
, 13, 21–22, 26, 29, 42–43, 62, 73, 77, 79, 90, 99, 115, 140, 142, 150, 161

Causal
, 4, 9, 133, 142, 174, 181

Causality
, 8–9, 181

Causation
, 6

Causative
, 180

Centralized career services
, 126

Certifying
, 176–177

Chada, D. M.
, 17

Chambers, C. R.
, 64, 99, 101

Chan, V.
, 3

Change strategy
, 140, 172, 190–191

Channels
, 140

Characterized/characteristic(s)
, 4, 64

Charteris-Black, J.
, 6

Chernoded, A.
, 201

Chianese, G.
, 8

Chidambaranathan, K.
, 156

Chong, S. S.
, 101

Christakis, M. N.
, 102

Christiansen, B.
, 164

Class size
, 187–188

Classification process
, 7, 192

Clifton, R. A.
, 36

Climate
, 17

Cline, T. R.
, 133

Clinical practice
, 46, 57

Clouder, D. L.
, 77

Clues
, 4, 9–10, 161, 188

Clustered/cluster(s)
, 10–11, 15, 135, 155, 174, 178, 181, 186, 190

Clustering
, 4

analysis
, 174

procedure method
, 135

process
, 139

Coate, K.
, 32

Coates, H.
, 154

Codified
, 2, 12

Coefficient
, 14, 134, 174

Coertjens, L.
, 23

Cognitive

dissonance
, 156

styles
, 78, 90, 115, 119

Cohen, J.
, 12–13

Coherence
, 33, 139, 147

Coherent

experience
, 179

learning experience
, 33

system
, 10

Colapinto, C.
, 164

Collaborate/collaborative/collaboration
, 4, 16, 81, 164, 193

Collins, L.
, 15

Colvin, J. B.
, 9

Community
, 11, 15, 17, 20, 102

Community learning
, 101–102, 152, 157

Competence
, 53

Competency
, 51–52

Competing-values

approach
, 143–144, 156, 158, 160–161

assessment
, 22

Competitor(s)
, 71

Compiled/compile(s)/compiling
, 6, 15, 42, 83, 146, 155, 173–174

Completers
, 74

Completion percentage factor
, 180

Complexity/complexities
, 10, 33, 113, 135, 147

Compliance
, 38–40, 90, 146

Component level assessments
, 115

Components
, 4–5, 16, 18, 21, 77–78, 80, 83, 99, 110–111, 115, 119, 126, 129, 145, 193

Concept
, 16, 102

Conceptual frameworks
, 8, 10, 15–16, 32–33, 51, 63–64, 77, 98–99, 134, 144

Confidence
, 4

Confirm
, 3, 174, 179, 181, 189

Confirmatory

factor analyses
, 134

research
, 63

Confounding effect
, 172

Congruence
, 36, 64

Conlon, E. J.
, 155

Connectedness
, 42

Connolly, T.
, 155

Consequences
, 139, 161, 171–172, 190

Consistency
, 10, 32, 36, 148, 186

Consolidate
, 174

Constituency grouping
, 155

Constituent
, 7, 192

averages
, 155

groups
, 155

parts
, 164, 174

Constraint(s)

of effectiveness
, 181–190

of performance
, 135

Construct(s)
, 3–6, 8–9, 15, 18, 20–21, 33, 42, 51, 57, 62, 64, 71, 77, 79–80, 83, 99, 150, 174

Constructed

approach
, 10, 57

learning experience
, 33

Constructivist process
, 9–10

Consumer protection
, 25, 28

Content
, 5, 9–10, 15, 18, 32, 36, 51–52, 64, 77, 80, 83, 99, 107

Context
, 102, 187

Contingency
, 20–21, 26

Continuous qualities improvement
, 171, 173

data
, 174–178

drivers and constraints of effectiveness, sensemaking of
, 181–190

institutional effectiveness report, sensemaking of
, 178–181

machine learning loop
, 190–193

sensemaking
, 173–174

Convergent questions
, 101

Cook, W. D.
, 11, 134, 173

Correlate(s)/correlated/correlative
, 29, 42, 55, 62, 64, 72–73, 77, 87, 133, 135, 139, 180, 185–187

Correlating indicators
, 135

Correlation coefficients
, 134

Correlation matrix
, 135, 181, 192

indicators
, 136

for performance indicators
, 182–184

Spearman correlation matrixes
, 192

Counseling services
, 121

component assessment
, 126

service assessment
, 125

Courses

components assessment
, 90–98

components measurement
, 80–83

measurement
, 36–38

performance assessment
, 40–42

Covarying
, 135

Coverage
, 33, 147

Credibility
, 2, 5, 12, 20, 29

Credible
, 2–4, 9, 15, 21–22, 31, 42–43, 51, 73, 77, 80, 83, 98, 113, 133, 142, 173, 189, 190, 192–193

Cresswell, J. W.
, 9, 144

Criteria
, 32–33, 36, 39–42, 51–52, 64–65, 72, 79, 87, 142, 145–146

Criterion
, 33, 38, 41, 43, 51–52, 83, 87, 145–146

Critical
, 10–12, 16, 32–33, 71, 87, 99, 101, 111, 171, 173

Cross-functional

performance
, 134

process
, 180

Cultural(ly)/culture(s)
, 4, 11, 17, 19, 46, 48, 52, 60, 101

Cureton, D.
, 77

Curricula(r)/curriculum
, 31–32, 39–41, 146

assessment
, 39–40

curriculum–external validity
, 139

design
, 152

measurement
, 31–35

Curry, L.
, 32

Data modeling
, 133–134

institutional
, 140, 142–144

processes
, 6

Data set
, 8, 13, 39, 133–135, 164, 181

Dawis, D.
, 101

Dawson, S.
, 2–3, 11, 32, 77, 142

De Donder, P.
, 23

Deci, E. L.
, 150

Decision-making process
, 73, 164

Demir, E.
, 64

Demonstrate(s)/demonstrated/demonstrating/demonstration(s)
, 1, 3–6, 12, 15, 18, 22, 26, 33, 36, 38, 40–41, 43, 46–47, 53, 62–63, 73, 83, 87, 90, 99, 140, 142, 149, 154–155, 156, 174, 179, 181, 190

Depending
, 144, 187

Depends
, 29

Descriptive process
, 3, 62, 134

Deutsch, S. J.
, 155

Developmental

portfolio
, 83

students
, 180, 189

Dey, N.
, 142

Diagnosis
, 44

Diamond, R. M.
, 32, 36, 51

Dichotomous event
, 144

Dick, W.
, 180

Difference(s)
, 4, 9, 11–14, 154–155

Differentiation
, 41

Dimension(s)
, 32–33

reduction and modeling
, 8, 192

Dirks-Naylor, A. J.
, 36

Disability/disabilities
, 108

component assessment
, 124

service assessment
, 123–124

Disagreement
, 11, 13

Discipline(s)
, 32–33, 36, 38, 64, 78, 146

Discrete(ly)
, 8, 32, 42–43, 52, 71, 78, 105, 115, 143

Discriminate
, 13, 52

Dissonance
, 156

Distinct
, 22, 43, 77

Distinguishing characteristics
, 4–5

Distributed/distribution
, 36, 71–72, 78–79, 87, 140, 150

Divergent perspectives
, 4

Diverse/diversity

array of strategies
, 17

cognitive styles
, 78

constituencies
, 143

populations
, 2, 32, 105

of thinking
, 11–12

Domingos, P.
, 6–7, 192

Dougherty, K. J.
, 24

Douglas-Gabriel, D.
, 24

Doyle K. J.
, 143

Driver(s)
, 6, 13, 17, 19, 22, 31, 135, 142, 161, 164, 174, 181, 186–187, 192

Drouin, M.
, 4, 11

Dualistic thinking models
, 6, 144

Duda, R. O.
, 8

Dudko L.
, 201

Dumitrescu, D.
, 101

Dunne, D. D.
, 174

Duque, L. C.
, 155

Dutra, E. V.
, 11

Economic factors
, 20, 27, 162

Educational institutions
, 5–6, 16, 142, 161

Effect(s)
, 40, 101

size attribute
, 13

of system
, 9

Effectiveness
, 1

assessing
, 2

institutional assessment of
, 5–6

of institutional conceptual framework
, 15

of instructional system
, 83

systematic approach to
, 10–11

Efficacy
, 43, 80

Efficiency
, 36, 134, 142

Elahi, S.
, 64

Ellis, S. E.
, 99

Embed(s)/embedded/embedding
, 4, 12, 17, 21, 57

Emerge
, 4, 7–8, 129, 146, 164, 171, 174, 181, 186–187, 189

Emergent interrelationships
, 134

Emotional
, 28, 163

Empathy
, 44, 47, 85

Empirical models
, 101

Employ
, 2, 5–7

Employers
, 23, 27, 32, 162

Employment/profession factors
, 20, 27, 162

Engage(s)/engaged/engaging/engagement
, 2, 4, 11, 32–33, 73, 78–79, 87, 115, 144, 173, 181, 193

Engenders
, 12

Engineer(s)
, 31, 33

Enhance(s)/enhanced/enhancement(s)
, 8, 15, 32, 36, 41, 99, 102, 105, 111, 139, 146, 161, 164, 171, 190

Environmental/environment(s)

alignment
, 153

assessing
, 21

environmental data aggregation
, 27–28

institutional environmental data
, 23–25

measurement to support institutional definition
, 22

scanning
, 19–20

SWOT analysis
, 26, 29

Equivalent(ly)
, 13, 72, 87, 154, 179

Erichsen, E. A.
, 149

Error
, 2, 5, 9, 12–13

Esi, M. C.
, 10

Ethical

conduct
, 71

framework
, 17

standards
, 12

Evaluate(s)/evaluation process
, 3, 11, 49, 53, 60

Everyone
, 83

Evidence-based decision-making process
, 172

Ewell, P. T.
, 32, 36

Examination
, 43, 178, 187

Expectations
, 18–22, 32, 101–102, 189

Expected
, 17, 36, 39, 79, 139, 180, 188

Experience(s)
, 104, 119, 130

Experiential learning
, 115, (see also Program learning)

assessments
, 115–119

experiences
, 99

services
, 102–105

Explicit
, 189

Exploration
, 179

Exploratory factor analysis
, 134

External environment
, 156, 161

curriculum with expectations
, 32

at institutional level
, 64

measuring
, 19–21

Externally valid content
, 32, 147

Externship
, 102, 104–105, 115, 117, 131

Extracted/extraction
, 7, 21, 32, 171

Facilitate learning
, 36

Factored/factor
, 10, 20, 36, 72, 134

Faculty
, 83

Fadelelmoula, A. A.
, 24

Feasibility analysis
, 21, 64, 161

Feeney, M. K.
, 64

Fernandez, R.
, 25

Ferren, A. S.
, 32, 36

Fifolt, M.
, 15

Filho, H. Z.
, 11

Financial responsibility
, 71

Fink, J. E.
, 102

Finnveden, G.
, 139

First-order effect of functional changes
, 139

Fisher, J. A.
, 16

Fisk, P. C.
, 79

Fooladvand, M.
, 140, 171

Forero, D. E.
, 101

Formative assessment
, 52, 57

Fortuin, K. P. J.
, 33

Fosnacht, K.
, 5

Foster communication
, 100

Fourie-Malherbe, M.
, 4

Foxlee, N.
, 20

Frame
, 7

Framework
, 20

Franceschini, L.
, 161

Freeman, M.
, 64, 164

Freeman, S.
, 36, 64

Freeze, R.
, 36, 87

Frempong, G.
, 172

Frequency
, 78

Friedman, J. H.
, 6

Frota, M. N.
, 145

Frymier, A. B.
, 87

Fuller, M. B.
, 12, 21

Function
, 38, 42, 101–102

Functional data
, 5

institutional dashboard summarizing functional assessments
, 141

over time
, 140

Functional data modeling
, 133, (see also Institutional data modeling)

aggregating functional data into causal triads
, 135–138

conceptual underpinnings
, 144

exploratory factor analysis
, 134

first-, second-, and third-order effects of functional changes
, 139

functional data over time
, 140, 141

functional performance data
, 133

Functional educational systems
, 142

Functional KPIs
, 140

into data models
, 142

through goal-path approach
, 145

Functional models
, 11

Functional MVVs’ statements
, 18–19

Functional performance
, 113

coherent system of measurements and assessments
, 10

data
, 111, 133

multidimensional
, 9

quantify
, 2

Galliott, N. Y.
, 9

Gardner, H.
, 36

Garg, P.
, 11

Gavin, R. B.
, 23

General education (GE)
, 14, 185

avg length of time to withdraw
, 177

course completion %
, 177

course failure rate
, 177

course stud/inst ratio
, 177

Generalizability
, 12

Generalization
, 51

George, G.
, 6

Ghazinoory, S.
, 64

Gibson, C.
, 105

Gillies, R. M.
, 140

Glidden, R.
, 2

Global assessment
, 40, 111

Global student services assessment
, 126, 129–131

graduate assessment
, 129

graduate student support services institutional assessment
, 131

Goal
, 10, 38, 51

Goal-attainment approach
, 142

Goal-path approach
, 142, 144–145, 154

to assess effectiveness
, 146

to sensemaking
, 147–148

trending analysis using
, 149

Gochyyev, P.
, 102

Goldman, P.
, 206

Goldratt, E. M.
, 135

Goldratt, E.
, 135

Goldratt, R.
, 135

Gómez, A.
, 101

Gonyea, R. M.
, 78

Gonzaga, R. P.
, 11

Goodman, S. N.
, 174

Goodness of Fit (GoF)
, 64

analysis
, 64

tool
, 36

Gopnik, A
, 206

Grabowski, L.
, 143, 161

Graduate

assessment
, 129

GPA average
, 14, 185–186

student support services institutional assessment
, 131

Graham, L. J.
, 9

Grant, D.
, 17

Grebennikov, L.
, 80

Greenberg, P. E.
, 143

Griffin, K. A.
, 10

Grosemans, I.
, 23, 64

Grounded in identity construction
, 4

Group
, 36, 41

Guardrails
, 31

Guidelines
, 21, 48

Gullickson, T.
, 26

Gulosino, C. A.
, 161

Gurley, D. K.
, 15

Gurvitch, R.
, 33

Gustavson, L. M.
, 145

Haak, D.
, 64

Hajisoteriou, C.
, 171

Hanson, G. R.
, 119

Hargreaves, A.
, 164

Hargrove, R. A.
, 164

Harmon, J.
, 11, 139, 140, 164

Harper, V. B.
, 73

Harris, A.
, 164

Harrison, D. J.
, 64

Harrison, M. I.
, 1, 10–11, 15, 140

Hart, D.
, 149

Hart, P. E.
, 8

Hassanien, A. E.
, 142

Hastie, T.
, 6, 8, 192

Hayek, J. C.
, 78

Hearn, J. C.
, 24

Hefny, H.
, 3

Heikonen, L.
, 78

Heinze, T.
, 3

Henning, G.
, 114

Henson, A.
, 57

Herzo, S.
, 9

Hickson, D. J.
, 142

Hinings, C. R.
, 142

Hints (indicators)
, 4

Holbeche, L.
, 143

Holder, B.
, 31, 99, 101

Horst, J. A.
, 171

Hoseini, A. M.
, 139

Hoseini, S. H. K.
, 64

Hossam, S.
, 3

Houser, M.
, 87

Howard, H. A.
, 164, 171–172

Howard-Hamilton, M. F.
, 52

Howe, E.
, 5

Huet, I.
, 190

“Human dynamic adaptive” systems
, 10

Human information processing

limits
, 8

system
, 140

Hummel, M. L.
, 102

Hurst, K.
, 63

Hutchings, P.
, 87, 154

Hypothesis testing
, 12

Identification
, 71

in action-planning process
, 171

of KPIs
, 151

Idress, A. M.
, 3

IE system
, 7

Ikenberry, S. O.
, 87, 154

Imam, T.
, 33

Immediacy
, 32, 102

Implications
, 188

Implicit strategies
, 142

Implied “goodness or badness”
, 161

Imprecise/imprecision
, 2, 10

Incompetence
, 53

Inconsistent
, 2

Indicators
, 3, 174, 177

conceptualization and treatment of institutional data as
, 4

correlation matrix
, 136

curricular coherence and disabilities services
, 139

functional
, 174

single performance
, 6

Individual processes
, 133

Individuals with Disabilities Education Act
, 21

Ineffective/ineffectiveness
, 1

Inferring/inferences/inferential method
, 3, 129

Infrastructure measurement
, 74

Iniesta-Bonillo, M. A.
, 25

Institutional data modeling
, 140, 142–144, (see also Functional data modeling)

action planning
, 171–172

competing-values approach
, 156, 158, 160–161–163

continuous qualities improvement
, 171

functional KPIs through goal-path approach
, 145

goal-path approach to assess effectiveness
, 146, 147–149

institutional effectiveness report
, 164–171

sensemaking of institutional effectiveness models
, 161

strategic constituency approach
, 155–156, 159

strategic contingencies approach
, 154–155, 158

systems approach
, 146, 150–154, 157

Institutional effectiveness
, 1–2, 193

approaches
, 140, 161, 171

assessment
, 173

report
, 164–171, 174–177

sensemaking
, 178–181

Institutional/institution
, 188, 193

assessment of effectiveness
, 5–6

competitive
, 71

conceptual framework
, 16

dashboard summarizing functional assessments
, 141

environmental scan
, 64, 156

functions
, 133

mission alignment measurement
, 65–67

mixed methods approach to institutional research
, 9–10

models
, 11

performance models
, 134, 142

sensemaking
, 3

values alignment measurement
, 68–70.

Instruction(al)
, 77

assessing learning engagement
, 87–90, 91–92

assessing learning experience
, 90–98

course components measurement
, 80–83

prior learning measurement
, 87

and learning support
, 99

measuring learning achievement
, 83–87

measuring learning engagement
, 78–80

measuring learning experience
, 80–83

support
, 115, 152

system
, 31, 77, 140, 180

vision statement
, 77–78

Instructor
, 78–80, 87, 90

Instruments
, 73, 77, 101

Integrate/integrated/integrating/integration
, 4, 36, 148, 172

Intellectual process of sensemaking
, 3–4

Intended functional performance
, 140

Intended performance
, 3, 115, 134, 174

Interconnected/interconnections/interconnectedness
, 7–9, 33

Intercultural services
, 101

Interdependencies/interdependent
, 3, 11, 142, 161

Internal data
, 192

in ML
, 7

Internship/externship experience
, 102

component assessment
, 119

measurement
, 104

services
, 115

Interrelationships

of courses
, 36

in functional performance data
, 134

between indicators
, 135, 174, 179

Ioannidis, J. A.
, 174

Irani, Z.
, 135

Islam, M. A.
, 36

Jackson, C.
, 143

Jackson, D.
, 23

James, M. R.
, 20–21

Jamshidi, L. l.
, 131

Jankowski, N. A.
, 87, 154

Job satisfaction models
, 101

Johnson, D. R.
, 20

Jones, K.
, 172

Jones, L.
, 161

Joseph
, 21

Junqueira, E.
, 11, 143

Kadir, S. A.
, 140

Kale, V.
, 9

Kalish, C. W.
, 4, 13, 115

Kalkan, Ö. K.
, 13

Kandiko, C.
, 33

Kandusi, C.
, 23

Kang, N.
, 171

Karousiou, C.
, 171

Kataria, A.
, 11, 171

Katz, N.
, 23

Kelecioglu, H.
, 13

Kennedy, J.
, 78

Kennedy-Phillips, L.
, 102

Key performance indicators (KPIs)
, 134, 145, 154, 174, 193

clusters
, 181, 190

functional KPIs through goal-path approach
, 145

making sense of assessment KPIs through systems approach
, 146, 150–154

of strongest correlations
, 184–185

Khezrimotlagh, D.
, 173

Kibria, B. M. G.
, 2

King, B. R.
, 64

Kinzie, J.
, 87, 154

Knowledge, skills, and values
, 153

Kooy, M.
, 102

Koppen, C. S. A.
, 33

Kowalski, D.
, 11

Kowalski, R.
, 11

Kremer, I.
, 13, 115, 156

Krishna, A.
, 9

Kroeger, A.
, 156, 164

Kucukaltan, B.
, 135

Kuh, G. D.
, 78, 87, 154

Kulkarni, D. K.
, 174

Kyndt, E.
, 23

Ladyshewsky, R.
, 146

Lahav, O.
, 23

Lapiņa, I.
, 23

Lavie, D.
, 6

Leader
, 4, 171

evaluation
, 164

institutional
, 154, 161, 181

Leadership
, 11, 21, 164

Leads
, 177

Learning.
, (see also Machine learning (ML))

environment
, 140

measuring learning achievement
, 83–87

outcomes
, 152

support services
, 105–106

Learning engagement
, 152

assessing
, 87–90, 91–92

measuring
, 78–80

Learning experience(s)
, 102, 152

assessing
, 90–98

measuring
, 80–83

Leber, R.
, 164

Lecca, H.
, 77

Lechman, E.
, 164

Ledder, G.
, 133

Lee, C. A.
, 142

Leemans, R.
, 33

Legal factors
, 28, 163

of institutional interaction
, 21

Levine, R. A.
, 134

Levy, M. A.
, 99, 101–102

Lewin, K.
, 26

Lewis, M.
, 36

Li, J.
, 171

Library
, 107, 125, 138, 170

component assessment
, 123

service assessment
, 122

Licensed/licensing

boards
, 32

counselors
, 109

Liela, E.
, 9

Life path transition
, 153

“Likert-type” scale
, 102

Limit/limits
, 4, 10, 17, 145

Linear

paradigm
, 156

values
, 8

Lingard, B.
, 156

Linhares, A.
, 17, 140, 150, 156, 172

Lunenburg, F. C.
, 11, 18

Luo, B. N.
, 143

Macfadyen, L. P.
, 2, 3, 11, 32, 77, 142

Machine learning (ML)
, 6

acyclical data
, 7

algorithms as measurement strategies
, 7

association learning
, 8

authentic data
, 7

classification
, 7

dimension reduction and modeling
, 8

internal data
, 7

outlier detection
, 8

statistical modeling
, 7–8

structured prediction
, 8

Machine learning loop
, 190

artificial neural network
, 193

systematic process
, 190–192

MacKay, D. J. C.
, 7–8, 192

Maiolini, R.
, 139

Major avg length of time to withdraw
, 177

Major course

completion %
, 177

failure %
, 177

major course–student/instructor ratio
, 177

Maloshonok, N.
, 99

Maluk Mohamed, M. A.
, 135

Management
, 45, 55, 61, 86

Manathynga, C. E.
, 140

Manifest
, 146

Marco, M.
, 11

Marcus, G. F.
, 211

Marius, P.
, 2

Marsh, C. J.
, 32, 36

Martin T. N.
, 171

Martinez-Mora, F.
, 23

Martinsson, J.
, 101

Mastery
, 43

Matherly, L. L.
, 23

Mathiassen, L.
, 143

Matriculate(d)/matriculations
, 177, 185

Matrix
, 134

McAdam, R.
, 143

McClure, K. R.
, 140

McDermott, I.
, 171

McLendon, M. K.
, 24

McNay, I.
, 209

McSorley, C.
, 143

Measurement(s)
, 2–3

Measures/measuring
, 1–3, 5–7, 10, 101, 143

Medler, D. A.
, 212

Meir, P.
, 204

Mejia, A.
, 101

Melnik Oleksandr, H.
, 25

Mena Report
, 33

Menard, S.
, 80

Mertler, C. A.
, 51

Metadata
, 11

Metaphors
, 17

Methodology
, 161

Metzler, M.
, 33

Meyer, P.
, 164

Michenzi, A. R.
, 33

Middaugh, M. F.
, 164, 171–172

Mihanović;, Z.
, 143

Mikelsone, E.
, 9

Miller, G. A.
, 17, 140, 150, 156, 172

Miller, K.
, 143

Mission, vision, and values (MVVs)
, 2, 6, 15–17, 134

assessing environment
, 21–29

creation
, 18

functional MVVs’ statements
, 18–19

measuring external environment
, 19–21

Mixed methods approach to institutional research
, 9–10

Mixson-Brookshire, D.
, 79

Mocanu, C.
, 23

Modality
, 71

Modes
, 78

Mokher, C. G.
, 24

Moon, K. K. L.
, 8

Moore, T. L.
, 102

Moran, K. A.
, 145

Morgan, G.
, 142, 164

Morrison, J. L.
, 19

Mouritsen, M. E.
, 2, 10, 15, 31

Mullally, C.
, 9

Multi-dimensional or phenomenological scale
, 161

Multiplistic thinking
, 144

Museus, S. D.
, 10

Myagkov, I.
, 201

Mylopoulos, J.
, 11

Nabak, M.
, 36

Nagarajan, V.
, 135

Nahyan, S. S. K.
, 23

Natow, R. S.
, 24

Naturalistic data
, 9

Neher, C.
, 143

Nellesen, D.
, 143

Neuroscience
, 140

Neutral response
, 22

Newton, J.
, 172

Ngai, E. W. T.
, 8

Nichols, C.
, 77

Nightingale, A. J.
, 16

Nolan, C.
, 23

Noldon, D. F.
, 99

Nominal scale
, 51

Nominative scale
, 42–43

Norvig, P.
, 8

Nosofsky, R.
, 17, 140, 150, 156, 172

Noumair, D. A.
, 139

Nuraan
, 23

O’Leary, L. S.
, 102

Oaks, D. J.
, 33, 87

Objectively/objectives
, 3, 5, 11, 22, 29, 79, 155

Observable/observed/observational/observations
, 3, 8–9, 16, 79, 87, 90

Observer
, 79

Observes
, 79

O’Connor
, 171

Oechslin, M.
, 4, 11, 13, 115

Office of Career Services or Placement
, 111

Oimet J. A.
, 210

“Open systems” model
, 20

Operational performance
, 142

Operationalize
, 16

Oprandi, P. R.
, 33

Optimal model
, 36

Optimize learning
, 31

Organic systems
, 144

Organization(al)

effectiveness approaches
, 134, 140

intellectual process of sensemaking in
, 4

learning for improvement
, 11

theory
, 20

Orientation
, 185

Osinga, E. C.
, 6

Oswick, C.
, 17

Outcomes
, 2, 17

demonstration
, 33, 147

program
, 33

Outliers
, 7, 10

detection
, 8, 192

Palgrave Connect
, 6

Palomba, C. A.
, 22

Parameters
, 14

Parametric
, 4

Paraprofessional
, 23, 27

Parker, S.
, 155

Parris, M. A.
, 20

Parsing/parse
, 6, 18, 43

Patel, D.
, 164

Patenaude, G.
, 204

Path
, 31

Pattern
, 52

Paucar-Caceres, A.
, 149

Pausits, A.
, 64

Pautler, A. J.
, 33

Pavičić;, J.
, 143

Peck, L. K.
, 5

Peifer, J. L.
, 20

Penn, J. D.
, 83

Pennings, J. M.
, 142

Peral, J.
, 11

Percentage
, 14

of leads
, 177

Perceptions
, 9, 22

Perceptual
, 3

Performance

of functional
, 10

indicators
, 181

institution
, 134, 142

performance-based model of effectiveness
, 6

Performs
, 3, 11

Perl, E. J.
, 99

Perry, W. J.
, 53

Perry’s Model of Intellectual and Ethical Development
, 51–52

Persistence
, 31

rate
, 72

Perspectives
, 90

Peters, G. B.
, 15

Phenomena
, 10

Phenomenological
, 9

Phenomenon
, 6

Pickering, J. W.
, 99

Pietarinen, J.
, 33

Pinelli, M.
, 139

Pirciog, S.
, 23

Placement
, 111

Plausible
, 4

Plewis, I.
, 212

Policies
, 108, 163

Political(ly)
, 29

factors
, 28

of institutional interaction
, 20, 163

model of effectiveness
, 6

Polnariev, B. A.
, 99

Pomerantz, N. K
, 102

Popham, W. J.
, 10

Population
, 2

Porter, A.
, 39

Portfolio
, 42

Possibility
, 13, 173

Potential
, 71

Poth, C. N.
, 9

Pounder, J. S.
, 156

Power test
, 12–14

Practitioners
, 2

Preceptor
, 104

Precise
, 52, 154

Precision
, 3

Predict/predictive/predictable
, 6, 16, 139

Prejudice
, 58

Preparation
, 180

Presumption
, 156

Prior learning measurement
, 87

Pritchard, R. M. O.
, 64

Privilege
, 46

Process-oriented functions
, 143

Product
, 17

Profession(als)
, 32, 105

Proficiency
, 29

Program

completion percentage
, 177, 179–180, 188

relevance
, 153

viability and feasibility assessment
, 21

Program design structure
, 31

course performance assessment
, 40–42

courses measurement
, 36–38

curriculum assessment
, 39–40

curriculum measurement
, 31–35

designing optimal rubric
, 51–52

Program feasibility and viability

assessment
, 73–75

measurement
, 63–73

Program learning

assessment
, 52–55, 179

objective measurement
, 43–51, 55–63, 148

outcome measurement
, 42–43, 56, 148

Projected
, 179

Protocols
, 145

Psychological
, 46

Psychology
, 43

Psychophysical
, 33

Purcell, J.
, 79

Pyhältö, K.
, 33

Qadeer, F.
, 17

Qiu, J. X.
, 143

Qualitative
, 9

Quality
, 42, 80

Quantify
, 3–4, 13

Quantitative
, 9

Quantum
, 6

Questionnaire
, 11, 80, 101

learning experience
, 81–82

Raab, G.
, 134

Rakoczy, K.
, 78

Ramy
, 21

Randall, E. J.
, 36

Rankin, S.
, 105

Rastogi, R.
, 11

Ratio
, 14

Readiness
, 36

Regha, V. S.
, 156

Registrar
, 191

Regulations
, 86

Regulatory
, 21

Relatedness
, 47

Relationship
, 9, 20

Relativistic
, 144

Relevance
, 29

Reliable/reliably/reliability
, 1, 21, 52

data
, 5

Represent(ation)
, 8, 11

Resilient
, 180

Response
, 10, 20

Responsibility
, 99–100

Retaining
, 187

Retention
, 188

Rho, S.
, 136

Ridgley, L. M.
, 31

Rigali-Oiler, M.
, 101

Rivera, M.
, 139

Rizvi, F.
, 156

Roberts, D. M.
, 114

Robinson, V. M. J.
, 139

Roga, R.
, 23

Rogers, J. D.
, 3

Rounsevell, M. D. A.
, 204

Rubenstein, L. D.
, 31

Rubric
, 42–43

designing optimal rubric
, 51–52

model
, 53

program learning outcomes measurement
, 44–50, 54–55

Rukh, H.
, 17

Russell, S. J.
, 8

Sample size attribute
, 12–14

Sampling
, 13

Sánchez-Fernández, R.
, 25

Sanders, K.
, 4, 11, 115

Sarraf, S.
, 5

Satapathy, S. C.
, 142

Satisfaction
, 6

measurement
, 101–102

Saville, K.
, 20, 23

Scaling/scaled/scale(s)
, 42–43, 52

Scalise, K.
, 102

Scan
, 19

Scheerens, J.
, 78–79

Schlesinger, W.
, 25

Schneck, R. E.
, 142

Science
, 115

Scorecard
, 140

Scott, B. A.
, 6

Scott, H.
, 79

Seagren, A. T.
, 143

Seale, J.
, 180

Second-order effect of functional changes
, 139

Senker, J. M.
, 3

Sensemaking
, 3–4, 11, 173–174

acquisition, student
, 181, 185

action planning process
, 189–190

of assessment KPIs

through competing-values approach
, 156, 158, 160–163

correlation matrix for performance indicators
, 182–184

of drivers
, 181

experience, student
, 186–188

of functional KPIs through goal-path approach
, 145

graduate GPA average
, 185–186

of institutional effectiveness models
, 161, 178–181

KPI clusters of strongest correlations
, 184–185

process
, 142

through strategic constituency approach
, 155–156, 159

through strategic contingencies approach
, 154–155, 158

success triads, student
, 188–189

system
, 140

through systems approach
, 146, 150–154, 157

Sequence
, 36, 148

Service level assessment
, 114–115

Shah, M.
, 80

Shahtalebi, S.
, 140

Shapira, P.
, 32

Sharpe, M. S.
, 99

Shayan, A.
, 164

Sheu, H. -B.
, 101

Shiffrin, R.
, 17, 140, 156

Shirom, A.
, 1, 10

Significance level attribute
, 13

Simon, M.
, 51

Singh, A.
, 135

Sitikovs, V.
, 25

Situated(ness)
, 16, 29

Smit, R.
, 51

Smith, D. G.
, 155

Snehal, B.
, 4

Social factors
, 27

of institutional interaction
, 20, 162

Social information processing
, 101

Sofo, F.
, 164

Soini, T.
, 33

Sokolova, T.
, 9

Soleimani, H.
, 33

Spearman correlation matrixes
, 192

Spearman Rho coefficient of correlation
, 134, 136

Specific, Measurable, Achievable, Realistic, and Time-bound attributes (SMART attributes)
, 16–17

Stakeholders
, 133, 143, 150–151

Standard
, 16

Statistical

modeling
, 7–8, 192

power attribute
, 13

power test
, 12–13

Statistics
, 134

Stevenson
, 102

Steventon, G.
, 77

Stewart, J.
, 4

Stienstra, M.
, 19

Stonebraker, I.
, 164

Stork, D. G.
, 8

Strategic contingencies approach
, 142–144, 154–156, 159

percentage of students demonstrating program learning objectives
, 158

Strategic/strategically/strategy
, 6, 10, 17, 143

Strength, weakness, opportunity, or threat analysis (SWOT analysis)
, 26, 29

Stronach, J.
, 134

Structured/structure
, 36, 148

of academic discipline
, 115

of curriculum
, 32, 39, 146

prediction technique
, 8, 192

of rubrics
, 51

Student

acquisition
, 181, 185

assessment of components
, 129

career services
, 127–128

experience
, 186–188

graduate student support services measurement
, 114

learning outcomes portfolio
, 84–86

life measurement
, 103

outcomes
, 140

perceptions
, 101

persistence–developmental students
, 178

persistence–non-developmental students
, 178

services organization
, 99

success number
, 178

support services function
, 115

transition support services
, 111–113, 126

Student learning support services
, 105, 119

academic success center
, 106, 120–121

counseling services
, 125–126

counseling services measurement
, 110

disabilities services
, 123–124

disabilities services measurement
, 109

functional performance data
, 111

library component assessment
, 123

library questionnaire
, 107–108

library service assessment
, 122

Student support services
, 99–101, 152

assessing
, 113–115

assessing student support services
, 113–115

experiential learning assessments
, 115–119

experiential learning services
, 102–105

function
, 101, 107, 119

global student services assessment
, 126, 129–131

mission, vision, and values for student services function
, 100

satisfaction
, 101–102

student learning support services
, 105–111, 119–126

student support services
, 99–101

student transition support services
, 111–114, 126–129

Successful program completion
, 153

Sullivan, M. M.
, 2

Sum
, 57

Summarization/summarizing/summarized/summarize
, 7, 22, 26, 39, 73

Summary
, 3, 26

Summative
, 52

Supporting/supported/support
, 5, 180, 189

Survey
, 80, 101

Svenfelt, Å.
, 139

Swaggerty, E. A.
, 33

Synergies
, 9, 36

of cross-functional performance
, 134

of institutional process
, 32

of participants
, 164

visualization
, 161

Synergistic/synergistically/synergy
, 6, 77, 161

Synthetic/synthesize/synthesis
, 1, 10, 164

Systematic/systematically/systems
, 4, 64, 150, 154

approach
, 142, 146, 150–154

assessment method
, 1, 9, 13, 139, 155, 190–192

to effectiveness
, 10–11

trending report of sensemaking data for institution
, 157

Tadesse, T.
, 140, 149

Taggar, S.
, 10

Taheri, R.
, 36

Taljard, A.
, 24

Talukder, R. M.
, 36

Tao, S. S. C.
, 8

Taplin, R.
, 146

Target
, 29, 71, 101, 178

Tashakkori, A.
, 9

Taut, S.
, 78

Technological factors
, 20, 28, 163

Techt, U.
, 135

Tedlie
, 9

Terentev, E.
, 99

Terkla, D. G.
, 102

Tewari, D.
, 135

Tewari, P. C.
, 135

Theories
, 1, 33, 79, 113

Third-order effect of functional changes
, 139

Thompson, A. S.
, 171

Thompson, L. F.
, 32

Threat
, 2, 26, 52

3 × 7 rule
, 150

Throughputs
, 142, 150, 174

Tibshirani, R.
, 6

Tierney, R.
, 51

Toloo, M.
, 173

Tone, K.
, 11

Toom, A.
, 78

Transform(ed)
, 26, 134, 145

Transition support services
, 99–100, 115

student
, 111–113, 126, 159

Translate/translated/translation
, 10–11, 18, 52, 135, 137–138, 190

Triad
, 133, 135, 174, 181, 186–187, 189

Triangulated/triangulates
, 135

Trujillo, J.
, 11

Trustworthiness
, 5, 10, 12

Trustworthy
, 3, 10, 15, 113, 192

Tutoring
, 139, 141

Type I error in decision-making process
, 12

Type II error in decision-making process
, 12

Ulrich, T. A.
, 33

Ültanır, E.
, 57

Ültanır, Y. G.
, 57

Unanticipated
, 62–63

Unexpected
, 11–12, 51

Unintended
, 172, 190

Valdez Noel, K.
, 80

Valid
, 5, 13

Validated
, 147

Validity of data
, 5

Values
, 8, 16

statements
, 17

van der Weerdt, N.
, 19

Van Gorder, K.
, 4, 11

van Koppen, C. S. A.
, 204

van Woerkom, M.
, 4, 11, 13

Variables
, 8, 13, 134, 192

Variances
, 10, 13, 19

Verdu, A.
, 19

Verwaal, E.
, 19

Viability measurement
, 71

Viable
, 73, 144, 188

Vinyard, M.
, 9, 142, 164

Vision

institutional
, 31

instructional
, 150

statement
, 17

Visualize/visualization
, 8–9, 87, 161, 164, 190

Vittori, K.
, 36

Volberda, H.
, 19, 156, 161

Volkov, P.
, 201

Vukasović;, M.
, 209

Wagner, S. H.
, 101

Waiganjo, E.
, 23

Walker, A.
, 36, 87

Waters
, 164

Weber, C.
, 156, 164

Wei, Y.
, 36

Weick, K. E.
, 4, 11

Weiss, N.
, 135

Well
, 77

Wenderoth, M. P.
, 36

Wergin, J. F.
, 32

Whetten, D. A.
, 32

White, P.
, 6

Wilds, P. C.
, 2, 11, 32, 41

Williams, J.
, 64

Willis, G.
, 32, 36

Wilson, M.
, 102

Winnaar, L. D.
, 172

Wissam, E. L.
, 20–21

Withdraw/withdrawal/withdrawal(s)
, 13–14, 179, 180, 186–188

Withdrawn
, 180

Witten, I. H.
, 6

Women’s Re-entry Program
, 110, 125

Woodhouse, I. H.
, 204

Wright, N. J. D.
, 36

Yarmohammadian, M. H.
, 140

York, T. T.
, 105

Yorkstone, S.
, 209

Young, A. G.
, 4, 13, 115

Yousef, M.
, 219

Zamfir, A. M.
, 23

Zhao, C.
, 171

Zhu, J.
, 11, 134, 173