Feedback to comparable insight
Combine trustworthy metrics, customer themes and controlled experiments.
4 stages · 0 approvals
Roles and responsibilities
-
Step 1Classify permitted comments
Masked TextSentimentPrimary ThemeSecondary ThemeNeutral
-
Step 2Publish the score basis
PeriodRespondent CountPromotersPassives
-
Step 3Evaluate the experiment
Test CodeCampaignStart DateEnd Date
-
Step 4Keep the history current
CustomerScopeOpt Out AtSourceNPSOnly
Process steps
Follow the process from start to finish. Select a step to see who acts and what changes.
Classify permitted comments
The classifier creates one Comments projection per free-text answer, labels sentiment and proposed themes, and stores masked display text. AI output is a suggestion, not a guaranteed classification or safety guarantee. CX Manager may correct permitted theme tags with provenance; recomputation counts canonical comments once. Anonymous rows contain no customer, ticket, agent or flow references. Raw text is not sent in notification bodies and private data is excluded from model requests unless the configured processor and policy explicitly permit it.
Publish the score basis
Service recomputation uses Accepted responses and the frozen primary metric question once per respondent; skipped/invalid responses are excluded and zero denominators produce unavailable values. NPS category counts partition valid NPS respondents. CSAT favourable percentage uses its instrument range; CES keeps its explicit effort direction, applying the same polarity to easy/difficult shares, outreach and compatible benchmarks. Response rate divides distinct accepted completions by distinct provider-accepted invitations for the same matured occurrence population; queued, suppressed and failed sends are separate. Versioned cohort memberships and full PopulationKey prevent cross-campaign overwrite. Anonymous breakdowns respect minimum group size and forbid identity joins. Benchmark comparisons require matching metric, scale, population and period; incompatible or absent benchmarks remain unavailable.
Evaluate the experiment
Wording tests freeze both published template versions, stable invitation assignment, analysis method, split and minimum samples before Running. Variant denominators include assigned eligible sent invitations, not only respondents; retries do not move recipients. Reaching a sample threshold permits evaluation but does not itself prove a winner; report inconclusive/no significant difference under the prespecified method. Versioned results never replace ordinary campaign metrics. Alert only when the configured score-change threshold and minimum sample are both met; support-team alerts stay within authorized scope.
Keep the history current
Opt-out callbacks and authenticated requests upsert suppression immediately. Every queued send and reminder applies the current suppression, while completed evidence remains governed by retention and privacy requests. CX Manager closes/archives campaigns without editing accepted responses; audited invalidation triggers same-basis score recomputation. Admin preserves delivery keys and restricted correlation only for the approved retention period. Reports retain counts of invited, delivered, suppressed, accepted, invalidated and unresolved outcomes so unavailable data is never presented as a favourable score.
0 approvals required in this process
- One valid primary metric answer contributes once per respondent.
- Zero denominatorsIncompatible benchmarks remain unavailable.
- Anonymous small slices and identity joins remain suppressed.
- Sample threshold alone is not evidence of an A/B winner.
Records and postings
| Stage | Records | Effect |
|---|---|---|
| 1 Classify permitted comments | CommentsThemes | Create masked theme projections with classification provenance |
| 2 Publish the score basis | NPSScoresCSATScoresCESScoresCohortsCohortMembersTrendsBenchmarkData | Recompute versioned comparable score populations |
| 3 Evaluate the experiment | SurveyABTestsSurveyInvitationsSurveyTemplates | Record the prespecified comparison and permitted alerts |
| 4 Keep the history current | OptOutsSurveyResponsesTrends | Apply current consent and traceable recomputation |
Process reports
All reportsCES by Flow
Per Period: average effort score and high-effort percentage per Flow (Onboarding, Renewal, SupportResolution, ProductCheckout). Surfaces friction hotspots in the customer journey.
Themes & Sentiment
Mentions per Theme × Period × Scope with sentiment mix and rising / falling theme detection. Drills into representative quotes (PII-masked when configured). The qualitative companion to the quantitative scorecard.
Cohort Comparison
NPS / CSAT / CES per Cohort × Period side-by-side — e.g. Onboarding cohort vs. Tenured cohort, Enterprise vs. SMB, US-East vs. US-West. Supports the segmentation hypothesis the CX program is built on.
Participation & Response Rate
Per Campaign: invited, sent, opened, responded, suppressed (with SuppressedReason mix), bounced, response rate and days-to-respond distribution. Surfaces deliverability problems and survey fatigue.
Benchmark Variance
Org metrics vs. industry benchmark per Metric × Period × Scope — variance in NPS points, CSAT points, CES points. The "are we above or below industry" view, used in board prep and renewal conversations.
Org NPS Trend
Quarterly NPS at Org and per Segment / Region / Plan / AccountOwner, trailing 8 quarters with Promoter / Passive / Detractor mix and period-over-period movement. Drills into the per-Cohort view (e.g. New customers vs. Tenured) and into the per- AccountOwner leaderboard. The CX Manager's daily landing report and the board-deck input.
CSAT by Channel & Agent
Per Period: CSAT Average, Top-2-Box, Bottom-2-Box, ResponseRate by Channel (Email, Chat, Phone, Portal), drilling into AgentTeam × Agent. Highlights channel-specific dips and per-agent variance. The Support Manager's coaching report.
Agent support
Proto cannot approve a self-prepared campaign or follow-up, bypass current consent, expose anonymous recipient correlation, edit accepted responses or declare an A/B winner from sample size alone. Provider outcomes require verified acknowledgments; classification remains a suggestion.
Other processes
3 moreSurvey to approved campaign
Publish the instrument and approve the exact campaign before launch.
4 stages · 1 approval
Event to accepted response
Deliver an eligible invitation and accept one valid response.
4 stages · 0 approvals
Low score to reviewed follow-up
Assign attributable customer outreach and independently review the result.
4 stages · 1 approval