Sentinel Observatory
Autonomous data quality agent for the Civic Intelligence API. Sentinel continuously monitors every data source for completeness and accuracy, automatically heals fixable issues by re-fetching from upstream APIs, quarantines records that fail healing, and uses LLM reflection to evolve its own validation rules over time.
Sentinel runs as a hosted FastAPI service alongside the Civic Intelligence API. It operates on its own scheduler — checking data quality, draining its healing queue, and generating evolution proposals without manual intervention. After every job, it rewrites a HEARTBEAT.md file with its current state and appends significant events to a JOURNAL.md — making its consciousness legible to humans and other agents. The Observatory dashboard provides real-time visibility into findings, circuit breakers, API budgets, quarantine status, and trend charts.
How It Works
Check
Scheduled completeness and accuracy checks scan every table in the GovCon database. Findings are created for anomalies.
Heal
Fixable findings get queued for automated healing. Sentinel re-fetches from upstream APIs (SAM.gov, Grants.gov, USAspending) with budget-aware rate limiting.
Quarantine
Records that fail healing after multiple attempts are quarantined for manual review. Oscillation detection prevents infinite loops.
Evolve
An LLM reflection engine analyzes patterns in findings and proposes rule changes. Proposals stage for 24h before auto-applying.
Narrate
After every job, Sentinel rewrites its HEARTBEAT.md and appends significant events to JOURNAL.md. Its consciousness is always legible to humans and other agents.
Sentinel Endpoints
All endpoints use limit and offset pagination. No authentication required (self-hosted, network-level access control).