Data Repository

Large HectaresBC payloads are not stored directly in this repository. They live in UBC-FRESH/fresh-hectaresbc-data, a DataLad/git-annex dataset linked as a Git submodule at:

external/fresh-hectaresbc-data

Clone with submodules:

git clone --recurse-submodules https://github.com/UBC-FRESH/fresh-hectaresbc.git
cd fresh-hectaresbc

Or initialize the submodule after cloning:

git submodule update --init --recursive external/fresh-hectaresbc-data

The submodule stores Git and git-annex metadata. Annexed file content is retrieved on demand from configured storage remotes. Current user-facing API and CLI workflows wrap these details with status, diagnostics, and dry-run fetch planning so normal catalog use does not require learning git-annex internals.

The recovered ZIP payload publication currently includes:

  • 2,183 raw ZIP payloads;

  • 418 data-layer ZIPs;

  • 1,765 virtual-layer ZIPs;

  • 17,531,591,717 published ZIP bytes;

  • the arbutus-s3 storage remote.

The data repository also stores the published browser-preview artifact cache under:

derived/web_map_previews/v1/

That cache currently includes a compact preview index for all 2,183 recovered records, 2,163 source-derived preview PNGs tracked by git-annex, and 20 not_previewable records. The main repository consumes this publication through the linked submodule at external/fresh-hectaresbc-data/derived/web_map_previews/v1/.