This paper aims to focus on how long‐term digital archiving systems are tested and what benchmarks and other metrics are necessary for that testing to produce data that the community can use to make decisions.
The article reviews recent literature about digital archiving systems involving public and semi‐public tests. It then looks specifically at the rules and metrics needed for doing public or semi‐public testing for three specific issues: triggering migration; ingest rates; and storage capacity measurement.
Important literature on testing exists but common metrics do not, and too few data are available at this point to establish them reliably. Metrics are needed to judge the quality and timeliness of an archive's migration services. Archives should offer benchmarks for the speed of ingest, but that will happen only once they come to agreement about starting and ending points. Storage capacity is another area where librarians are raising questions, but without proxy measures and agreement about data amounts, such testing cannot proceed.
Testing is necessary to develop useful metrics and benchmarks about performance. At present the archiving community has too little data on which to make decisions about long term digital archiving, and as long as that is the case, the decisions may well be flawed.
The article shows that testing is key to making rational decisions about digital long term archiving systems but establishing metrics and rules by which librarians can compare the results is far from easy.
Emerald Group Publishing Limited
Copyright © 2011, Emerald Group Publishing Limited