Subject Index

Evaluating Scholarship and Research Impact

ISBN: 978-1-78756-390-2, eISBN: 978-1-78756-387-2

Publication date: 27 June 2018

This content is currently only available as a PDF

Citation

Alstete, J.W., Beutell, N.J. and Meyer, J.P. (2018), "Subject Index", Evaluating Scholarship and Research Impact (Great Debates in Higher Education), Emerald Publishing Limited, Leeds, pp. 181-192. https://doi.org/10.1108/978-1-78756-387-220181011

Publisher

:

Emerald Publishing Limited

Copyright © 2018 Jeffrey W. Alstete, Nicholas J. Beutell, and John P. Meyer


INDEX

AAA
, 55

AACSB International
, 50, 77

accreditation standards
, 91, 101

Academe
, 93, 96

Academic capitalism
, 11, 14, 125

Academic Capitalism
, 12

Academic freedom
, x

Academic journals document
, 26–27

Academic publishing

changing nature of
, 52–65

commercial
, 24

negative indicators
, 62

positive indicators
, 61–62

Academic research production
, 87

Academic Revolution, The
, 2–3, 54

Academic “sell out”
, 84

Academy of Management Journal
, 101

Accountability
, 11, 14, 15, 36, 44, 69, 88

calls for changes in
, 81–86

external
, 80

internal
, x

quantitative-based
, 17

Accreditation
, 122

agencies
, 119

review
, 113

standards
, 91, 101, 107

Administrative decentralization
, 116

Age-weighted citation rate (AWCR)
, 40–41

a index
, 38

“A-list” journal
, xvii

Allowing choice
, 105

Altmetric for Scopus
, 51

Altmetrics
, xviii, 18, 50–51, 76, 106, 107

AMA
, 55

American Society for Cell Biology

Annual Meeting (2012)
, 48, 133

AOM
, 55

Application, scholarship of
, 9

ar index
, 38

Article Influence® Score (AI)
, 36, 91

Article-level IFs versus journal impact factors
, 76

Artificial intelligence algorithms
, 84

Association of University Presses
, 56

Attention score
, 51

Audit culture
, 36, 114

Australia

research funding
, 99–100

Australian Business Deans Council (ABDC)
, 56, 57, 91

Author/article citation counts
, x

Author-level metrics (AutLM)
, 97

Author processing charge (APC)
, 55, 61

Author Rank
, 64

AW-index
, 40–41

Babbitt, Irving
, 3

Bad to Good: Achieving High Quality and Impact in Your Research
, 116

Balance of teaching and research
, 21

Bases for Policy in Higher Education
, 4

Basic research
, 74

Batista, Pablo D.
, 41

Beall’s List of Predatory Publishers
, 56–58

Benchmark analysis
, 98–99

Berlin Declaration on Open Access
, 53

Bethesda Statement on Open Access Publishing
, 53

Bibliometrics
, x, xviii, 27, 67, 69, 79, 81, 84, 87, 88, 89, 94, 106, 111, 112, 131

Bibliometrics and Citation Analysis
, 58

Bibliometrics as Weapons of Mass Citation
, 78

Big thinkers
, 55

Boyer, Earnest L.
, 95–96

Brazil

university ranking system
, 15

Bridge media
, xvii, 51, 118

Britain/England
, 103

Research Assessment Exercise
, 69, 70

Research Excellence Framework
, 69–70

research funding
, 99

Brodman, Estelle
, xi

Budapest Open Access Initiative
, 53

Business schools

faculty scholarship in teaching and learning
, 50

Cabell, David W. E.
, 44–46, 56, 77, 101

Cabell’s Blacklist
, 46, 56, 57, 78

Cabell’s Classification Index (CCI)
, 46, 77

Cabell’s Directory
, 44–45

Cabell’s whitelist
, 45, 46, 78

Ca Creativity index
, 38

Campiteli, Monica G.
, 41

Career preparation
, 1–2

Career trajectory
, 97

Carnegie Classification of institutions
, 108

Carnegie Foundation for the Advancement of Teaching
, 108

Cattell, James McKeen
, 85

China
, 103

Chronicle of Higher Education
, 63

Citation analysis
, xi, 15, 16, 84, 87, 95

interdisciplinary ties in
, 89

timeline of
, 30–36

Citation-based journal rankings
, 129

Citation counts
, 71, 84, 89, 105, 107, 121

Citation index
, 25, 29, 30, 48–50

See also individual indexes

Citation metrics
, xii, 43–44

Citations per paper
, 90

Cited Half-life
, 39

Citefactor
, 46

Cit metric
, 37

Cit/N metric
, 37

Clarivate Analytics
, 39

Clinical vs. basic research
, 75

Cobey, Kelly
, 86

Coercive Citation in Academic Publishing
, 78

Collaboration
, 111, 115, 131

Collocation
, 18, 115, 116

Commercial academic publishing
, 24

Commercialization
, 13

Consumatory good
, 4–5

Continuous improvement
, 18, 91

Costs

of acquiring data and information
, 46–47

of publishing
, 52, 53

Creative Commons licensing
, 62, 120

Crisis in the University
, 126

Critical-thinking skills
, 1

Croson, Rachel
, 101–102

Cultural diversity
, 114

Curiosity-driven research
, 8

Curry, Stephen
, 79–80

CV
, 57, 78, 88

Cybermetrics
, 27

Data collection
, 104

Dean’s Council
, 57

DeepDyve
, 56

Desk-rejected
, 77

Difficulty of Acceptance (DA)
, 46, 77

Digital distribution
, 24

Digital media platforms
, 56

Digital Object Identifier (DOI)
, 62

Directness
, 104

Directory of Open Access Journals
, 62

Discovery, scholarship of
, 9

Disruptive technology, and research policies
, 13–16

Distributed knowledge production
, 10

Diversity
, 95

EarlyCite
, 120

Egghe, Leo
, 38

Eigenfactor® Score
, 36, 91

e-index
, 40

Eisenhower, Dwight (President)
, 83

Elitism
, 3

Elsevier
, 55, 64

Altmetric for Scopus
, 51

Emerald Publishing
, 55, 120

EMNPC
, 39

English collegiate model
, 7

English-language bias
, 114

accommodations for
, 18

Entrepreneurial management culture
, 13

Europe

university ranking system
, 15

Excellence in Research for Australia (ERA)
, 90

Expert judgment
, 85–86

Facebook
, 51, 71

Faculty effectiveness
, 94

Faculty research
, 1

Faculty scholarship in teaching and learning
, 50

Faculty writing
, 118

Fake articles
, 100, 121

Fake impact factors
, 46

Fake ISSNs
, 122

Faulty citations
, 72–73

Field-normalized citation rates
, 18

Fields of study
, 27

Financial backing
, 23–24

Financial research incentives, for journal publication
, 102

5-Y JIF
, 91

Flexner, Abraham
, 3

Forms of scholarship

application
, 9

discovery
, 9

integration
, 9

teaching
, 9

France
, 103

Freedom of intellectual inquiry
, 81

Funding organizations
, 119

Fuzzy cluster analysis
, 113

Gaming
, xiv, 29

Garfield, Eugene
, xi, xiii, 25, 29, 47–48, 64, 73

Generation
, 6

g-index
, 38, 98

Global environment
, 19, 99

Global Impact Factor (GIF)
, 46

Global Serials Directory
, 620

“Gold standard”
, 90

Google + 
, 51

Google Scholar (GS)
, 36, 92, 94, 96, 97, 101

author-level metrics
, 97

citation metrics
, xii, 43, 44

inaccuracies
, 72

scholarly work’s impact on citations
, 89

Governance
, 11

Grand Valley State University Libraries
, 61, 63

h(2) index
, 38

Halo effect
, 87

Harvard Press
, 56

Harzing, Anne-Wil
, 40, 92, 108

Harzing’s list-of-lists
, 57

Haughtiness
, 3

Higher Education Funding Council for England
, 49, 94

Higher education research
, 7–8

hInorm
, 41

Hiring
, xviii, 96, 107

Hirsch, J. E.
, 37, 38

Hirsch Index (h-index)
, xii, xviii, 37–38, 43–44, 71, 91–92, 97, 101, 107, 114, 127

average annual increase in
, 42

contemporary
, 40

individual
, 41

multiauthored
, 41

Humanities, citation metrics in
, 43

Humility
, 94

Hutchings, Robert Maynard
, 3

Hybrid evaluation
, xix

Hypothesis testing
, 116–117

Idea of a University
, 2

IEEE
, 55

Illegitimate publishing entities
, 122

Imetrics
, 27

Immediacy Index
, 39

Impact factors (IFs)
, xii, 21–65, 73

fake
, 46

statistical inaccuracy of
, 78–79

timeline of
, 30–36

See also Journal impact factors (JIFs)

Impact measurement
, 25–26

Impact narratives
, 122

Impact of Research, The
, 50

Impact statements
, 122

ImpactStory

author-level metrics
, 97

Inaccuracies
, 71–81

Inconsistency of the h-Index, The
, 78

Inderscience Publishers
, 55, 117

Indirect quality measurement
, 88–123

Informed research funding decisions and recognition
, 99–107

Informetrics
, 27

Informing Science Institute
, 117

Innovation
, x

Institute for Research and Higher Education (Norway)
, 73

Institute for Scientific Information (ISI)
, 29, 72, 101

Institutional policy developments
, 120

Institutional Publication Activity (IPA)
, 46

Institutional rankings
, 84

Integration, scholarship of
, 9

Intellectual capital
, 112

Intellectual property
, 11, 30, 133

Intellectual quality
, 6

International Standard Name Identifier (ISNI)
, 99

International Standard Serial Numbers (ISSNs)
, 45, 56, 58, 62, 122

Internet
, 47, 51, 53, 59, 69, 71, 119

Internet -based research
, 19

ISO Standard (ISO 27729)
, 98

Japan

university ranking system
, 15

Jin, Bihui
, 40–41

John Hopkins
, 56

Journal acceptance rate
, 76–77

Journal Citation Reports® (JCR)
, xii, xv, 30, 36, 39, 81

Journal classification lists, need for
, 44

Journal impact factors (JIFs)
, x–xii, xviii, 15, 17, 26, 29, 49, 64, 88, 90, 97, 118, 129, 130, 134

distinguished from article-level IFs
, 76

limitations of
, 134

problems associated with
, 74–75

usefulness of
, 86, 93–99

See also Impact factor

Journal-level metrics
, 113

Journal of Finance
, 101

Journal of Marketing Research
, 101

Journal scholarship metrics
, 37–38

Katsaros, Dimitrios
, 40

Kinouchi, Osame
, 41

Knowledge

creation
, 8

dissemination of
, 6, 129

distribution
, 67

network
, 11

production
, 9, 10

scientific
, 7

sharing
, 9, 111

social
, 7

Knowledge-based economy
, 6

Language
, 18, 104, 114

Language other than English (LOTE)
, 43

Leiden Manifesto
, 103–104

Library journal selection
, 24–25

Linear statistical models
, 117

Machine learning
, 84

Management Science
, 101

“Managerial class”
, 82

Manolopoulos, Yannis
, 40

Mantel–Haenzel quotient (MHq)
, 39

Martinez, Alexandre S.
, 41

MDNRS
, 39

Measurement
, 7–13

Measurement systems
, xvii, 16, 17, 69, 84, 98, 113, 114, 130

Measuring Science: Irresistible Temptations, Easy Shortcuts, and Dangerous Consequences
, 78

Medieval universities
, 7

Megajournals
, 59–60

Meikeljohn, Alexander
, 3

Metrics
, ix

history and evolution of
, 21–65

See also individual metrics

Metrics-based research assessment
, 103

Metric-wise
, 107

Michigan Publishing (University of Michigan)
, 50–51

m index
, 38

MNPC
, 39

MNRS
, 39

Mobley, Sir Walter
, 126

Mode One
, 9–10

Mode Two
, 10

m quotient
, 38

Monetary publication award
, 101

Multiversity
, 4

Netherlands, the
, 103

Netometrics
, 27

Newman, Cardinal
, 2, 3

New Scientist
, 51

19th century German models
, 2

Nobel Foundation
, 90

Nobel Prize
, 90

Nock, Albert Jay
, 3

Normalized index
, 79

Normalized indicators
, 39, 40

N pr/yr metric
, 37

N/yr metric
, 37

Number of citations per paper (NCPP)
, 76, 90

Olayan School of Business
, 102

“Old boys’ network”
, 87

Online Submissions and Peer Review System (OSPEERS)
, 117

Opaqueness
, 105

Open access (OA)
, 24, 28, 53, 55, 56, 58–60, 119–121

Open Access Movement
, 53

Open Access Scholarly Publishers Association
, 62

Operational utility
, 3, 7, 19

Operations research (OR)
, 96

ORCID (ResearcherID)
, 98

Page charges
, 23

Paradigm shift
, ix

Pareto Principle
, 22

Peer review
, xviii, 87, 117–118

Peer-review system
, 23, 60, 90, 118, 122

Peer-reviewed journal
, xv, 91, 102, 134

Philosophical Transactions of the Royal Society
, 23

Pinterest
, 51

PLoS ONE
, 60

Policy
, 1–20

creation and implementation, using scholarly metrics for
, 107–123

development
, 13

Policymaking
, xiv

Post-Sputnik era
, 5

Practical considerations, for research measurement
, 112–113

Practicality
, 6

Predatory journals
, 46, 53, 56, 58, 59, 118, 122

Predatory publishing
, 56–59, 121

Preservation
, 6

Processing
, 6

Promotion
, xviii, 107, 120

Publication outlet quality
, xi

Publication productivity
, 21–22

Publish or Perish (PoP) program
, 40–42, 108

Publons
, 118

Pure research
, 50

Qualitative evaluation strategies
, 5

Qualitative judgments
, 104

Qualitative review
, 105

Quality assurance
, 10–11

Quality of citations
, 89–90

Quality Open Access Publishers
, 56

Quantitative evaluation strategies
, 30, 94, 104

Ranking organizations
, 119

Recommendations for research assessment
, 135–138

Reference
, 27

Referencing as Persuasion
, 78

Reflexivity
, 95

Regression analysis
, 116

Relative Citation Ratio (RCR)
, 39

Reliability
, xv, 28, 46, 88

Research
, 1–20

forms of
, 7–13

framework
, 12

Research Assessment Exercise (RAE)
, 69, 70

Research evaluation

impact
, ix, 96, 105

systems
, 93

by type of institutions
, 109–110

Research Excellence Framework (REF)
, 69–70, 84

Research-for-student-skill-development
, 6

Research funding
, xi, xiv, 128

decisions and recognition, informed
, 99–107

ResearchGate (RG)
, 94, 96, 101

author-level metrics
, 97

Research grant funding
, xviii, 107

Research policy
, xviii, 7, 11, 19, 57, 68, 70, 82, 89, 94, 99, 103, 106, 116, 131

development, factors influencing
, 110

disruptive technology and
, 13–16

improvements, benefits and possibilities for
, 87–88

Research purpose
, xvi, 6, 12

Research-for-student-skill-development
, 6

Research university model
, 7, 54–55

“Responsible research and innovation” (RRI)
, 94

Retraction Watch
, 86

Review process for academic journals
, 117

Review systems of journal articles
, 117

Revolutionary movement into academic professionalism
, 2–3

Reward systems
, 120

Robustness
, 94

Rousseau, Ronald
, 30

Rutgers
, 56

Sage
, 55, 58

San Francisco Declaration on Research Assessment (DORA)
, 16, 48–49, 133–138

Scholarly metrics
, xi, xvii–xix, 21–65, 84, 94–97, 106, 107, 108

awareness of
, 44

growth of
, 46–52

in policy creation and implementation, using
, 107–123

selection and usage of
, 111

subsequently formulated
, 80

See also individual metrics

Scholarly Metrics: Under the Microscope: From Citation Analysis to Academic Auditing
, 47, 81, 84–85

Scholarly regulation
, 22

Scholarship
, x, 17–18

forms of
, 9

measurement, origin of
, 23–29

measurement, timeline of
, 29–46

quality of
, 92

Scholarship Reconsidered
, 95–96

Science blogs
, 51

Science Citation Index® (SCI)
, xi, xii, 25, 29, 30

Science magazine
, 25

Scientific American
, 51

Scientific knowledge
, 7

Scientific research
, 115

Scientist Impact Factor (SIF)
, 39

Scientometrics
, 27, 90

SciFinder, inaccuracies
, 72

SCImago Journal Rank
, xii, 91, 101

Scopus
, 36, 58, 92

inaccuracies
, 72

Second World War
, 21

Sedona
, 118

Seglen, Peter
, 73–76

Self-citation
, 36

Self-referential citation
, 80

Service activities
, 1

Sher, Irving H.
, 29

Shippensburg State University
, 101

Sidiropoulos, Antonis
, 40

Significant sameness model
, 117

Similar scholarly groups
, 24

Simplicity
, 104

SNIP
, 91

Social knowledge
, 7

Social media metrics
, 76

Social Science Research Network (SSRN)
, 63–64

Social Sciences, citation metrics in
, 43

Social Sciences Citation Index® (SSCI)
, xii, 30, 58, 102

Soft discipline scholars
, 115

Solbridge International School of Business (South Korea)
, 57–58, 102

Spamming
, 82

Springer
, 55, 58

Stakeholders
, x, xvii, 15, 17, 50, 52, 61, 69, 70, 94, 105, 110, 119, 128, 131

Statistical analysis of research
, x, 85

Status quo
, 14

Structural equation modeling
, 116

Symmetric tests
, 116

Taylor & Francis
, 55

Teaching

scholarship of
, 9

loads allocation
, xviii, 96

Technological development
, 1

Tenure
, xviii, 96, 107, 120

Thomson ISI
, 30

Thomson Reuters
, xi, 39, 46, 93, 112, 134

citation indexes
, 29–30

3 … 2 … 1 … Impact [Factor]: Target [Academic Career] Destroyed!”: Just Another Statistical Casualty
, 78

Timeline of Bibliometrics
, 30–36

Time-period calculation
, 81

Times Higher Education
, 123

Total citation tabulation
, 80

Traditional research
, 9–10

Transdisciplinary skill sets
, 10

Transparency
, 95, 104

Trinity University
, 91

Twitter
, 40, 51, 71

Twitter Percentile (TP)
, 40

Ulrichs Web
, 62

Understandability
, 104

UNESCO
, 6, 11

United States

Congress
, 100

research funding
, 100

Universal Impact Factor (UIF)
, 46

University of Texas, at Arlington
, 101

University ranking systems
, 15

Validation of inputs
, 105

Validity
, xv, xviii, 15, 28, 77, 78, 83, 85, 88, 91, 94, 96, 107, 120

Visibility of scholarly research
, 94, 130, 131

“We are Columbia University”
, 83

Web of Science (WOS)
, 22, 36, 92, 101, 102

citation metrics
, 43

inaccuracies
, 72

Webometrics
, 27

Why the Medieval Idea of a Community-oriented University is Still Modern
, 129

Wilson, Tom
, 81

Work–family synergy
, 116

Work–life balance
, 116

Zhang, Chun-Ting
, 40

Z-score
, 101