Extract
State Agencies
Per-state scrapers with pagination, CRS reprojection, and rate-limit handling for 40+ regulatory portals
Python
GeoPandas
pyproj
ArcGIS REST
GeoJSON
XLS
Load
State Specific Tables
Per-state PostGIS tables. Change detection, deduplication, and date-tracking on every incremental run
PostGIS
psycopg2
SQLAlchemy
Transform
Master Normalized Table
Canonical schema across all states — unified categories, EPSG:5070 geometry, standardized API numbers
ST_Transform
EPSG:5070
Enrich
Post-normalize
Data enrichment via spatial joins
ST_Within
census_geom
Serve
Portal & Tiles
Pre-rendered vector tiles in Google Cloud Storage, streamed to a Django-powered public data portal
MapLibre GL
Vector Tiles
Google Cloud
Django