LiDAR ground-classification validation
This page summarizes the ground-classifier evidence behind the optional ground bundle. It is a validation record, not a new product contract. The operational contract is in LiDAR ground-bundle contract.
The classifier is opt-in. No default FEMIC LidarBC product depends on it.
Evidence at a glance
Phase |
What was tested |
Result |
|---|---|---|
P135 |
Real TFL6 crop, seven blocks, 137,428,675 points |
36,662,162 predicted ground (26.68%); 20.29% low-point flags; HAG p95 21.4207 m; 30.4 min; no field labels |
P137 |
Squamish public control: open mudflat + closed-canopy first returns |
5,461 ground and 9,284 non-ground labels; precision 0.9970; recall 0.9872 |
P138 |
54-setting sensitivity grid on the Squamish control |
P135 defaults: recall 0.9742, canopy false ground 0.00141; best 2 m / 30 deg / 0.3 m: recall 0.9998, false ground 0.00011 |
P139 |
Candidate settings on two TFL6 blocks and Golden 2021 |
Candidate rejected: Golden class-2 HAG p99 worsened from 0.044 m to 0.340 m |
P140 |
Public-control CI guard |
Ground recall >= 0.95 and canopy false ground <= 0.005; workflow runs on PRs and
|
P141 |
TFL6 steep-block false-negative audit |
53% of class-2 false negatives were SOR-removed; kept-point recall 0.9049; 99.4% of kept false negatives had HAG <= 0.15 m |
P142 |
Opt-in near-surface pass |
Default stays strict; enabled mode raises Squamish recall to 0.9903 and TFL6 SOR-off recall to 0.9990 |
What the evidence supports
The strict classifier is usable on real LidarBC ALS tiles.
The P135 defaults are conservative and robust across TFL6, Golden, and Squamish.
The public Squamish control shows the strict mask does not systematically call canopy first returns ground.
The P138 candidate parameter change is not safe as a default because it degraded Golden class-2 HAG.
The P141 audit found that the remaining TFL6 recall gap is mostly SOR removal and a conservative final mask, not a bad TIN surface.
The P142 near-surface pass is available as an opt-in terrain-surface mode.
What the evidence does not support
It is not a field-validated accuracy estimate.
It does not validate ground under a closed forest canopy; the Squamish control has open mudflat ground and canopy first returns, not hidden forest floor.
It does not make TFL6-specific claims from the Squamish public control.
The class-2 reference is incomplete, especially on TFL6.
Parameter tuning on one small coastal patch is not a general tuning set.
Strict versus terrain-surface ground
The default bundle is strict ground. is_ground excludes points that the final PTD
surface passes through but the densification mask did not add.
The opt-in --include-near-surface mode is terrain-surface ground. It adds points
within --near-surface-tolerance-m of the final surface to is_ground. hag and
is_low are unchanged, so the low-point band remains available. This mode can include
low vegetation and is not mineral-ground-only.
Public control data
The Squamish control uses:
District of Squamish 2024 7.5 cm orthophoto, Open Government Licence - Squamish;
LidarBC 2019, 8 points/m2, Open Government Licence - British Columbia.
The compact CI fixtures are under tests/fixtures/lidar/ground_control/. Raw orthophoto
and LAZ bytes are not tracked.
Reproduction
Build a bundle with the strict default:
femic lidar ground-bundle-build data/lidar/crop/tfl6_blocks.laz \
output/ground/tfl6_blocks \
--crs EPSG:3156 --vertical-datum CGVD2013
Build a terrain-surface bundle:
femic lidar ground-bundle-build data/lidar/crop/tfl6_blocks.laz \
output/ground/tfl6_blocks \
--crs EPSG:3156 --vertical-datum CGVD2013 \
--no-sor --include-near-surface --near-surface-tolerance-m 0.15
Run the public-control guard:
python -m pytest tests/test_lidar_ground_control_fixture.py -q
Detailed reports
notes/reports/p135-tfl6-ground-e2e.mdnotes/reports/p137-squamish-control-patch.mdnotes/reports/p138-ptd-sensitivity.mdnotes/reports/p139-candidate-settings.mdnotes/reports/p140-ground-control-guard.mdnotes/reports/p141-tfl6-false-negative-audit.mdnotes/reports/p142-near-surface-ground.md
Licence and attribution
The public control uses OGL-Squamish orthophoto and OGL-BC LidarBC point clouds. Retain the source attribution and licence notices when reusing derived labels or metrics.
Arbor provenance
This lane is a clean-room reimplementation of cited Arbor methods. No Arbor package,
R code, C++ code, model object, or GPL source is imported or vendored. The scope close-out,
including what was and was not taken, is in
notes/reports/arbor-mining-closeout.md.