A visual interpretation rating scale for validation of numerical models

Abstract

Purpose

The comparison of large volumes of complex data resulting from numerical modelling in computational electromagnetics is a demanding task, especially when validating the performance of numerical models against experimental results and testing experimental repeatability. “By‐eye” comparisons can lead to inconsistencies and inherent subjectivity. This paper establishes a “visual” benchmark by which comparisons can be made and therefore used to assist in the development of an algorithmic approach to data comparison.

Design/methodology/approach

This new method presented here is based on the Cooper‐Harper Rating Scale, which is a test pilot's evaluation‐rating instrument. This has been modified through qualitative research. The assertion that the rating scale will leave the group mean response unaltered but will reduce the variance has been statistically tested.

Findings

The proposed rating scale provides a calibration technique by which to benchmark comparisons. The scale also reduces subjectivity by producing an overall quantitative measure of similarity. The paper concludes with an application of the rating scale to assessment of a candidate algorithmic approach against correlation.

Research limitations/implications

The research findings are based on small data sets, which is a limit imposed by the industrial environment in which this scale will be used.

Practical implications

This paper provides a tool to overcome some of the key substantial difficulties in communicating similarity or difference, namely that “similarity” and “difference” have no stand‐alone definition, there is a lack of a shared language for the comparisons and little commonality for a decision‐making framework.

Originality/value

This paper provides modellers and experimentalists in computational electromagnetics (particularly electromagnetic compatibility) with a structured approach to quantifying the quality of comparative results.

Citation

Coleby, D.E. and Duffy, A.P. (2005), "A visual interpretation rating scale for validation of numerical models", COMPEL - The international journal for computation and mathematics in electrical and electronic engineering, Vol. 24 No. 4, pp. 1078-1092. https://doi.org/10.1108/03321640510615472