Urban-PLUMBER

A multi-site model evaluation project for urban areas

Phase 2 Phase 1 Download project protocol

Mathew Lipson (UNSW), Sue Grimmond (Reading), Martin Best (Met Office),
with observational and modelling participants.

AU-Preston: CHTESSEL_U

NOTE: Results presented here are highly dependent on how models are configured in this experiment and may be subject to variable output formatting errors. Results are not intended to indicate the quality of any individual model, but to help participants better understand and improve modelling approaches in different urban environments.

Submitted metadata

Error metrics

flux	experiment	MAE	MBE	nSD	R	5th	95th	RMSE	cRMSE	AMBE	1-nSD	1-R	nSkewness	nKurtosis	Overlap
SWup	baseline	2.90652	0.303955	1.01266	0.996466	0.41111	2.89107	3.99716	0.0855427	0.303955	0.0126561	0.00353397	0.033295	0.0833081	0.0598599
SWup	detailed	2.90652	0.303955	1.01266	0.996466	0.41111	2.89107	3.99716	0.0855427	0.303955	0.0126561	0.00353397	0.033295	0.0833081	0.0598599
LWup	baseline	9.3796	5.10425	1.15793	0.976855	2.6377	20.8188	12.8366	0.280252	5.10425	0.157925	0.023145	0.0236007	0.00738362	0.076066
LWup	detailed	9.3796	5.10425	1.15793	0.976855	2.6377	20.8188	12.8366	0.280252	5.10425	0.157925	0.023145	0.0236007	0.00738362	0.076066
Qle	baseline	30.1539	-22.5258	0.38315	0.334171	9.29874	89.6498	51.288	0.943784	22.5258	0.616851	0.665829	2.31188	9.14862	0.45663
Qle	detailed	30.1539	-22.5258	0.38315	0.334171	9.29874	89.6498	51.288	0.943784	22.5258	0.616851	0.665829	2.31188	9.14862	0.45663
Qh	baseline	28.0536	9.58417	1.36385	0.942394	9.84205	98.244	50.3017	0.538069	9.58417	0.36385	0.057606	0.101534	0.155607	0.143202
Qh	detailed	28.0536	9.58417	1.36385	0.942394	9.84205	98.244	50.3017	0.538069	9.58417	0.36385	0.057606	0.101534	0.155607	0.143202
Qtau	baseline	0.262823	-0.262823	0	nan	0.007	0.913	0.406053	nan	0.262823	1	nan	1	1	0.915896
Qtau	detailed	0.262823	-0.262823	0	nan	0.007	0.913	0.406053	nan	0.262823	1	nan	1	1	0.915896

MAE: mean absolute error (close to 0 is better)
MBE: mean bias error (close to 0 is better)
NSD: ratio of model to obs standard deviation (close to 1 is better)
R: Pearson’s correlation (close to 1 is better)
all others: closer to 0 is better

Link to variable definitions

subset_SWup_v0-9

out of range: baseline

CHTESSEL_U Qh max value of 640.3898 is greater than expected 600.0 [W/m2]

out of range: detailed

CHTESSEL_U Qh max value of 640.3898 is greater than expected 600.0 [W/m2]

Link to variable definitions