Urban-PLUMBER

A multi-site model evaluation project for urban areas

Phase 2 Phase 1 Download project protocol

Mathew Lipson (UNSW), Sue Grimmond (Reading), Martin Best (Met Office),
with observational and modelling participants.

AU-Preston: UCLEM

NOTE: Results presented here are highly dependent on how models are configured in this experiment and may be subject to variable output formatting errors. Results are not intended to indicate the quality of any individual model, but to help participants better understand and improve modelling approaches in different urban environments.

Submitted metadata

Error metrics

flux	experiment	MAE	MBE	nSD	R	5th	95th	RMSE	cRMSE	AMBE	1-nSD	1-R	nSkewness	nKurtosis	Overlap
SWup	baseline	3.97221	2.04085	1.03671	0.993063	0.5554	2.9086	6.18991	0.125425	2.04085	0.0367127	0.00693717	0.111949	0.279932	0.0655698
SWup	detailed	3.60468	0.612148	1.01157	0.993949	0.5725	0.154204	5.21923	0.111247	0.612148	0.0115702	0.00605102	0.0969819	0.242033	0.0608021
LWup	baseline	20.0298	19.9418	1.25247	0.979156	6.47339	44.403	24.5455	0.340522	19.9418	0.252468	0.0208444	0.0675581	0.371909	0.161719
LWup	detailed	14.5911	11.3019	1.2756	0.972109	2.44831	38.3077	19.6867	0.383547	11.3019	0.275595	0.0278908	0.0151662	0.198878	0.10454
Qle	baseline	21.6455	-7.9212	0.791159	0.709226	9.186	14.6405	35.5434	0.709726	7.9212	0.208842	0.290774	0.270588	0.0327021	0.264149
Qle	detailed	21.9843	-6.33136	0.862391	0.687881	8.055	9.9447	36.9911	0.746508	6.33136	0.13761	0.312119	0.426239	0.891509	0.279097
Qh	baseline	21.8699	4.8036	0.888456	0.929178	18.0199	22.0523	34.4639	0.371869	4.8036	0.111543	0.070822	0.0418314	0.0682691	0.16384
Qh	detailed	22.5726	14.0923	1.06851	0.947425	19.2588	36.5946	34.415	0.342121	14.0923	0.0685112	0.0525745	0.0886131	0.113035	0.183593
Qtau	baseline	0.153605	0.120267	1.13227	0.863877	0.0151	0.1705	0.213711	0.570746	0.120267	0.132272	0.136123	0.221481	0.374437	0.204529
Qtau	detailed	0.110393	-0.0806412	0.626502	0.863446	0.0058	0.3376	0.19042	0.557318	0.0806412	0.373498	0.136554	0.250222	0.463668	0.105772

MAE: mean absolute error (close to 0 is better)
MBE: mean bias error (close to 0 is better)
NSD: ratio of model to obs standard deviation (close to 1 is better)
R: Pearson’s correlation (close to 1 is better)
all others: closer to 0 is better

Link to variable definitions

subset_SWup_v0-9

out of range: baseline

out of range: detailed

UCLEM Qle max value of 791.5195 is greater than expected 700.0 [W/m2]

Link to variable definitions