Holocene DA Validation Report

Validation of the custom Holocene Data Assimilation reconstruction against published Holocene global temperature reconstructions. Reference datasets are discovered at runtime from reference_data/ — any CSV with columns age_BP, median, q05, q95 or age_BP, anomaly, uncertainty_1sigma will be used.

0.093
6 ka ΔT (°C, area-weighted)
0.994
GMST R vs erb2022_gmst
0.988
GMST CE vs erb2022_gmst
0.853
GMST R vs kaufman2020_temp12k
-1.152
GMST CE vs kaufman2020_temp12k
0.977
Spatial R vs erb2022
0.104
Proxy R (temp12k_v102_proxies, N=1174)

GMST Validation Metrics

Pearson correlation (R) and Nash–Sutcliffe coefficient of efficiency (CE) of the ensemble-median GMST against each reference over their common age range. CE = 1 is perfect; CE = 0 equals climatology; CE < 0 is worse than climatology.

ReferenceOverlapRCE
erb2022_gmst 4.0–11994.0 BP (1200 pts) 0.9945 0.9877
kaufman2020_temp12k 100.0–11900.0 BP (119 pts) 0.8526 -1.1521

Spatial Anomaly at 6 ka

Mean temperature anomaly for 5500–6500 BP relative to 0–1000 BP baseline. Robinson projection.

6 ka spatial anomaly map

Spatial Comparison at 6 ka

Side-by-side 6 ka temperature anomaly for the custom reconstruction and each spatial reference, plus their difference. Pattern correlation (R) and area-weighted RMSE are computed after nearest-neighbor regridding of the reference onto the reconstruction grid.

ReferencePattern RRMSE (°C)Recon geo meanRef geo mean
erb20220.97660.0493+0.093 °C+0.085 °C
6 ka spatial comparison vs erb2022

Proxy-Site Comparison (6 ka)

For each proxy site, the reconstruction’s 6 ka anomaly is sampled via nearest-neighbor on the model grid, then compared to the proxy’s own 6 ka anomaly (5500–6500 BP relative to 0–1000 BP baseline, falling back to the record mean if the modern baseline is absent). R, RMSE, and bias (recon − proxy) summarize the match.

DatasetNRRMSE (°C)Bias (°C)
temp12k_v102_proxies11740.10401.8542-0.1662
Proxy comparison (temp12k_v102_proxies)
Proxy Database Comparison vs Temp12k 1.0.2 (Erb et al. 2022) (shared 1104, custom-only 97, reference-only 172)

Comparison of the proxy records in this run’s lipd_legacy.pkl against Temp12k 1.0.2 (Erb et al. 2022), the version used by the published Erb et al. 2022 reconstruction. Records are matched on paleoData_TSid after the same paleoData_inCompilation == Temp12k + paleoData_units == degC filter that da_load_proxies.py applies at runtime.

1,276
Temp12k 1.0.2 (Erb et al. 2022) records
1,201
Custom records
1,104
Shared
97
Custom-only
172
Temp12k 1.0.2 (Erb et al. 2022)-only

Side-by-side statistics

StatisticCustomTemp12k 1.0.2 (Erb et al. 2022)
Records1,2011,276
Distinct archive types88
Earliest record start (yr BP)1,277,3461,277,346
Latest record end (yr BP)-275-275
Median record length (yr)1140311403
Median observations per record7171

Records by archive type

ArchiveSharedCustom-only Temp12k 1.0.2 (Erb et al. 2022)-onlyTotal
LakeSediment6273567729
MarineSediment2854972406
Peat1671024201
GlacierIce103518
Midden80210
Speleothem3025
Wood3003
GroundIce1001
Total1104971721373

Spatial distribution

Proxy spatial comparison

Temporal coverage

Records covering each 250-yr age bin, partitioned by which database they belong to.

Temporal coverage comparison

Records exclusive to the custom run (97)

Records present in this reconstruction’s proxy database but absent from Temp12k 1.0.2 (Erb et al. 2022) — typically records added in later Temp12k versions or pulled from filtered queries.

TSIDArchiveDatasetAge range (BP)n_obs
GH2d963782MarineSedimentBS79_38.Cacho.2001867–24,51771
GH6edd69deMarineSedimentGeoB33131.Lamy.2002283–6,99075
LPD52d54dc4MarineSedimentGEOFAR_KF16_MgCa.Repschlager.2016524–11,25898
LPD537be86cPeatSouthernCalifornia.Ohlwein.2012408–9,27622
LPD5d932ca5MarineSedimentPP10-07.Mary.2016422–10,150206
LPD71287822MarineSedimentTTR17_434G.Rodrigo-Gamiz.201427–13,72892
LPD73260700MarineSedimentPP10-07.Mary.2016422–10,150206
LPD74bc6584LakeSedimentLittlePondRoyalston.Marsicek.20130–11,000221
LPD779b21dcLakeSedimentBloodPond.Marsicek.20130–11,000221
LPD7abab671-dupGlacierIceLawDome.Dahl-Jensen.1999-45–8,69235
LPD92d845a8MarineSedimentPP10-07.Mary.2016422–10,150206
LPD9c79485dxxxxMarineSedimentODP658C_UK37.Zhao.1995137–22,589203
LPDa0c55c63MarineSedimentPP10-07.Mary.2016422–10,150206
LPDadaae75fMarineSedimentSN-6.Tiwari.2015154–4,77236
LPDb59e4b87PeatSouthernCalifornia.Ohlwein.201210,469–11,4466
LPDc82d344dMarineSedimentGEOFAR_KF16_MgCa.Repschlager.2016524–11,25898
M2L4bz5nk5qPLakeSedimentBanksIsland-12.Gajewski.2000175–10,18333
M2Lzkp2ld6fPLakeSedimentBanksIsland-12.Gajewski.2000175–10,18333
PYT2264KMU9LakeSedimentTrout.Irvine.201263–9,88431
PYT2GZRWCSFLakeSedimentQipisarqo.Frechette.20098–8,63450
PYT5H6FC5I1LakeSedimentQipisarqo.Frechette.20098–8,63450
PYT79QPULU7LakeSedimentTrout.Irvine.20121,784–15,42467
PYT917S9C8JMarineSedimentGIK17748-2.Kim.20021,080–16,07054
PYTDSG9BNO2MarineSedimentGIK23258.Sarnthein.2003698–13,987285
PYTH91MXU0ZMarineSedimentP1003.Sejrup.2011-48–7,881649
PYTP4VYPRWBLakeSedimentUpperFly.Bunbury.20090–13,32953
PYTQ5AK802PLakeSedimentHolebudalen.Seppa.2009-10–8,92966
PYTQBB7JT6PLakeSedimentsjuuodjijaure.Rosen.2001167–9,26348
PYTRS33LNIKMarineSedimentGIK23258.Sarnthein.2003698–13,987285
PYTUQPUNFJTPeatCorser.Nichols.2014103–11,11636

⬇ Download full CSV (97 rows)

Records exclusive to Temp12k 1.0.2 (Erb et al. 2022) (172)

Records used by the published reconstruction but missing from this custom run — typically records dropped by the user’s filter or removed from later Temp12k versions.

TSIDArchiveDatasetAge range (BP)n_obs
GH06e59526MarineSedimentMD79-257.Levi.20071,554–15,69547
LPD27f34021PeatYakumo.Leipe.201340–5,50638
LPD3267fe5dMarineSedimentPP10-07.Mary.2016422–10,150206
LPD5c8693b4MarineSedimentMD01-2416.Sarnthien.20045,727–11,92041
LPD7abab671GlacierIceLawDome.Dahl-Jensen.1999-45–8,69235
M2L1fcqp9rpPLakeSedimentEC1.Gajewski.199358–6,61032
M2L1r9snju2PLakeSedimentAtocas.Gauthier.19810–11,97741
M2L68fmqq0lPLakeSedimentAtocas.Gauthier.19810–11,97741
M2L68iw0l2ePLakeSedimentNorthPond.Whitehead.1978-105–13,08355
M2L6qbln98nPLakeSedimentLoneFoxLake.MacDonald.1985-32–12,63837
M2L726ed2xjPLakeSedimentCH2.Garralla.19921–8,33289
M2L7thzxje2PLakeSedimentHams.Bennett.1987-29–11,94582
M2L8sc7gn3mPLakeSedimentHams.Bennett.1987-29–11,94582
M2LdjjxzkgtPLakeSedimentQueens.Moser.19900–8,84033
M2Lfut6kmdqPLakeSedimentQueens.Moser.19900–8,84033
M2Lg77nq75zPLakeSedimentEC1.Gajewski.199358–6,61032
M2Lh4fhttxhPLakeSedimentCH2.Garralla.19921–8,33289
M2LiaueutgvPLakeSedimentEldora.Maher.19699–8,64044
M2Ll9trg0t0PLakeSedimentBI2Lake.Gajewski.1992-42–7,79143
M2Lmx8lcp55PLakeSedimentPerchLake_Manitoba.Ritchie.NA-14–6,05845
M2LnpuqcuqlPLakeSedimentBanksIsland-15.Gajewski.200014–10,18362
M2Lq7umd2r5PLakeSedimentRadtke.Webb.19831–13,35849
M2Lqd7jeqa8PLakeSedimentBanksIsland-15.Gajewski.200014–10,18362
M2Lqditl4qyPLakeSedimentBillys.Jacobson.19750–11,47477
M2Lr58abc8kPLakeSedimentAtocas.Gauthier.19810–11,97741
M2LsdjhmhltPLakeSedimentSaintCalixte.Larouche.NA77–11,20935
M2Ltt67sy8bPLakeSedimentSaintCalixte.Larouche.NA77–11,20935
M2Luwan852aPLakeSedimentSaintCalixte.Larouche.NA77–11,20935
M2Lv9gueit2PLakeSedimentEC1.Gajewski.199358–6,61032
M2Lvlvf54mwPLakeSedimentDemont.Kapp.NA13–13,28273

⬇ Download full CSV (172 rows)

GMST Time Series

Custom reconstruction ensemble spread alongside reference medians. X-axis runs from the oldest age (left) to present (right).

GMST time series

GMST Ensemble Members (1040 total)

Every ensemble member plotted individually (subsampled to 200 for readability), showing the full reconstruction spread.

GMST ensemble members

GMST Difference (Custom − erb2022_gmst)

Year-by-year difference between the custom reconstruction median and the primary reference. Red = warmer, Blue = cooler.

GMST difference plot

← Back to results