Technical Writing

Data Ingestion and Analytics Methodology

This page documents reproducible data loading and transformation rules used by the dashboard.

Pipeline

  1. Run database migrations to create PostGIS-enabled schema.
  2. Run Excel ingest command to perform full refresh and record ingest stats.
  3. Apply active/reachable filters by source system.
  4. Apply AP/WLC source-of-truth precedence (CatCtr over Prime, both over NA).
  5. Derive state/site code from device naming convention and enrich with site metadata.
  6. Map models to lifecycle milestones and cost values from ModelData.
  7. Compute lifecycle status and weighted 0-100 risk score for prioritization.

Operational Commands

Run migrations

npm run migrate

Ingest workbook

npm run ingest -- --file "/Users/nerd/Downloads/UAInnovateDataset-SoCo.xlsx"

Key Defaults

  • Reference date for lifecycle scoring: February 28, 2026.
  • Approaching lifecycle window default: 6 months.
  • Radius grouping default: 5 miles.
  • Risk threshold for high-risk views: score 65 and above.