Scientific and Human Errors in a Snow Model Intercomparison
Date
2021
Authors
Menard, Cecile
Essery, Richard
Krinner, Gerhard
Arduini, Gabriele
Bartlett, Paul
boone, aaron
Brutel-Vuilmet, Claire
Burke, Eleanor
Cuntz, Matthias
Dai, Yongjiu
Journal Title
Journal ISSN
Volume Title
Publisher
American Meteorological Society (AMS)
ORCID
Type
Article
Degree Level
Abstract
Twenty-seven models participated in the Earth System Model–Snow Model Intercomparison Project (ESM-SnowMIP), the most data-rich MIP dedicated to snow modeling. Our findings do not support the hypothesis advanced by previous snow MIPs: evaluating models against more variables and providing evaluation datasets extended temporally and spatially does not facilitate identification of key new processes requiring improvement to model snow mass and energy budgets, even at point scales. In fact, the same modeling issues identified by previous snow MIPs arose: albedo is a major source of uncertainty, surface exchange parameterizations are problematic, and individual model performance is inconsistent. This lack of progress is attributed partly to the large number of human errors that led to anomalous model behavior and to numerous resubmissions. It is unclear how widespread such errors are in our field and others; dedicated time and resources will be needed to tackle this issue to prevent highly sophisticated models and their research outputs from being vulnerable because of avoidable human mistakes. The design of and the data available to successive snow MIPs were also questioned. Evaluation of models against bulk snow properties was found to be sufficient for some but inappropriate for more complex snow models whose skills at simulating internal snow properties remained untested. Discussions between the authors of this paper on the purpose of MIPs revealed varied, and sometimes contradictory, motivations behind their participation. These findings started a collaborative effort to adapt future snow MIPs to respond to the diverse needs of the community.
Description
Keywords
Snow, Snowpack, Model comparison, Model evaluation/ performance
Citation
Degree
Department
Program
Advisor
Committee
Citation
Part Of
item.page.relation.ispartofseries
DOI
10.1175/BAMS-D-19-0329.1