ZAIXOS Engineering Platform — Success Metrics
Document type: Product Definition
Version: 1.0 · Phase: 12-2
Status: Permanent product authority
Nature: Engineering KPIs only — no marketing metrics (NPS, brand awareness, etc.)
Measurement Principles
| Principle | Statement |
|---|---|
| Baseline before migration | Capture embedded-ERP metrics before platform pin for comparison |
| Per-product tracking | Each product reports; platform aggregates for ZAIXOS portfolio |
| Fail closed counts as success | Validation catches are positive outcomes pre-merge |
| No vanity counts | Lines of rules generated, chat messages sent — excluded |
Primary KPIs
KPI-1 — Platform Installation Time
| Attribute | Value |
|---|---|
| Definition | Wall-clock from start of documented install to first successful local validation run |
| Unit | Minutes |
| Target (v1 GA) | ≤ 60 minutes (experienced Laravel developer, clean repo) |
| Target (steady state) | ≤ 30 minutes |
| Measurement | Timestamp install command → timestamp green EngineeringRuntimePlatformIntegrityTest |
| Owner | Product integrator logs; platform reviews quarterly |
KPI-2 — Developer Onboarding Time
| Attribute | Value |
|---|---|
| Definition | Time from repo clone to first merged PR that passes full CI including platform validation |
| Unit | Hours (first-time ZEP developer) |
| Target (v1 GA) | ≤ 8 hours |
| Target (v2+) | ≤ 4 hours |
| Measurement | HR/onboarding ticket or self-reported log with CI link |
| Owner | Product engineering lead |
KPI-3 — Successful Validation Rate
| Attribute | Value |
|---|---|
| Definition | % of CI runs where platform + product architecture tests pass on first attempt (main branch) |
| Unit | Percentage (rolling 30 days) |
| Target | ≥ 95% on main; failures investigated as platform doc or test defect |
| Measurement | CI analytics |
| Owner | Product CI; platform triages recurring failures |
KPI-4 — Architecture Compliance Rate
| Attribute | Value |
|---|---|
| Definition | % of merged PRs that did not require post-merge fix for module boundary violations |
| Unit | Percentage |
| Target | ≥ 90% |
| Measurement | Architecture test failures on PR vs main |
| Owner | Product architect |
KPI-5 — Platform Upgrade Duration
| Attribute | Value |
|---|---|
| Definition | Wall-clock from bumping platform lock to green CI on integration branch |
| Unit | Hours |
| Target (patch/minor) | ≤ 4 hours |
| Target (major) | ≤ 2 business days with migration guide |
| Measurement | Upgrade ticket timestamps |
| Owner | Product integrator |
Secondary KPIs
KPI-6 — Product Bootstrap Duration
| Attribute | Value |
|---|---|
| Definition | Time to new product repo with platform pin, adapter materialized, empty module scaffold, green validation |
| Unit | Days |
| Target (v2+) | ≤ 2 days |
| v1 | Establish baseline only |
KPI-7 — Adapter Materialization Drift
| Attribute | Value |
|---|---|
| Definition | Count of .cursor/ (or equivalent) files differing from platform template without extension manifest entry |
| Unit | Count (should be 0) |
| Target | 0 undocumented drifts |
| Measurement | Validation diff or materialize --check (future CLI) |
| Owner | Developer + platform validation |
KPI-8 — Contract Conformance
| Attribute | Value |
|---|---|
| Definition | % of adapter manifest checks passing against contracts@1 |
| Unit | Percentage |
| Target | 100% for certified adapters |
| Measurement | Integrity test suite |
| Owner | Adapter maintainer |
KPI-9 — Phase Acceptance Cycle Time
| Attribute | Value |
|---|---|
| Definition | Median time from Format B report submission to Architect RESPONSE_TEMPLATE acceptance |
| Unit | Hours |
| Target | Product-defined; platform tracks median for process health |
| Note | Long cycles may indicate spec ambiguity — feed back to docs |
KPI-10 — Governance Duplication Index
| Attribute | Value |
|---|---|
| Definition | Lines of platform-authoritative content duplicated in product repos outside extensions |
| Unit | Line count (target → 0) |
| Target | 0 after migration complete |
| Measurement | Audit script or manual Phase 12-7 (Consumer Migration) checklist |
| Owner | Platform team |
Anti-Metrics (Do Not Optimize)
| Anti-metric | Why excluded |
|---|---|
| Number of Cursor rules | Encourages sprawl |
| AI messages per developer | No quality signal |
| GitHub stars | Marketing |
| Speed of skipping validation | Violates philosophy |
Reporting Cadence
| Audience | Cadence | Content |
|---|---|---|
| Platform team | Sprint | KPI-3, KPI-8, KPI-10 |
| Product lead | Monthly | KPI-1, KPI-2, KPI-4, KPI-5 |
| Architect | Per phase | KPI-9 |
| Portfolio (ZAIXOS) | Quarterly | All primary KPIs trend |
GA Acceptance Threshold (Platform v1.0.0)
Platform v1.0.0 GA is not accepted unless on reference product (Dental Clinic):
- [ ] KPI-1 measured ≤ 60 minutes
- [ ] KPI-3 ≥ 95% over 30-day window
- [ ] KPI-8 = 100%
- [ ] KPI-10 trending to 0 (migration in progress acceptable with plan)
Success Metrics v1.0 — Phase 12-2.