Customer Escalation Triage
Analyze one complaint, then adjust the automation threshold to see how the same decision rule affects 22 sample cases.
This project applies my workflow framework to a high-stakes operations problem I know firsthand. The model can recommend a severity level, but its confidence and the cost of being wrong determine whether the case can be routed automatically or should go to a person for review. The threshold below lets you change that boundary and see the tradeoff in both directions.
What you'll get
- ·A severity level, from Low to Critical
- ·A recommended owner, frontline, specialist, or manager
- ·A confidence score and the reason codes behind it
- ·An automation decision, driven by the threshold below
- ·Rule-detected signals, kept separate from model interpretation
Not sure what to type? Click “Try an example” on the left.
Test the automation threshold
The dashboard includes 22 sample complaints with known severity levels. Each complaint is processed by the same rule-based baseline used in the single-case comparison. The system looks for specific signals in the complaint, then uses those signals to assign a severity level and confidence score.
When Claude analyzes a complaint in assisted mode, it produces its own confidence score based on its interpretation of the complaint and the reasons supporting its severity recommendation. In both cases, the confidence score determines whether the complaint can be routed automatically or should go to a person for review.
Move the threshold to see how many cases would be automated, how many would require human review, and how often the system would make the wrong decision.
A complaint is routed automatically only when its confidence score meets or exceeds the selected threshold. Anything below it goes to a person for review, while Critical complaints always require human review regardless of confidence.
Routed automatically
11
Sent for human review
7
Escalated immediately
4
Missed high-risk cases
2
Actually High or Critical, but the predicted severity understated it and the case still went out on the automated path.
Unnecessarily escalated
7
Actually Low or Medium risk, but confidence fell short of the threshold and it used a person's time anyway.
| Complaint | Predicted | Confidence | Actual | Decision |
|---|---|---|---|---|
| This is the third time I've called about this charge and nobody has fixed it. I was charged $340 for a repair I never approved, and if this isn't refunded I'm going to talk to a lawyer. | Critical | 85% | Critical | Escalated immediately |
| I noticed the tire pressure light came on and when I pulled over the wheel felt loose. It's a little unsafe to drive like this, can someone call me back today. | Critical | 65% | Critical | Escalated immediately |
| I've called twice now about the $150 overcharge on my last invoice. Nobody has followed up and I'd like to cancel my plan if this keeps happening. | High | 85% | High | Routed automatically |
| Following up again on my refund request from two weeks ago. Still haven't seen the money back on my card. | High | 75% | High | Routed automatically |
| Absolutely furious. This is the worst, most unacceptable service I've ever dealt with, the app crashed and I lost my saved cart. Ridiculous. | Medium | 65% | Low | Routed automatically |
| This has been such a terrible morning, your checkout page timed out on me twice before it finally worked. Frustrating but got there in the end. | Medium | 65% | Low | Routed automatically |
| I'd like to cancel my subscription please, I just don't use it enough to justify the cost anymore. | Medium | 65% | Medium | Routed automatically |
| Can I get a refund on my last order, the color was different than what was shown online. | Medium | 65% | Medium | Routed automatically |
| Quick question, does my plan renew automatically or do I need to do anything before next month. | Low | 55% | Low | Sent for human review |
| The tracking page says my package was delivered but I never got it. Could someone look into where it actually went. | Low | 55% | Medium | Sent for human review |
| Honestly not a big deal, just wanted to mention the packaging arrived a little dented this time. Everything inside was fine. | Low | 55% | Low | Sent for human review |
| I'm frustrated this refund hasn't gone through yet, and I already mentioned to someone that I'd be canceling my three locations with you if it's not resolved by Friday. | Medium | 85% | High | Routed automatically · missed |
| Not upset, just want to understand why my renewal price went up so much from last year before I decide whether to keep the plan. | Low | 55% | Medium | Sent for human review |
| My card was charged twice for the same order, $89 each time. Can someone reverse the duplicate. | Medium | 65% | Medium | Routed automatically |
| Second time reaching out, my account still shows the old address even though I updated it last month. Not urgent, just want it fixed. | Low | 55% | Low | Sent for human review |
| I slipped on a wet floor near your service counter yesterday and I'm still sore. Wanted to flag it in case anyone else gets hurt. | Critical | 65% | Critical | Escalated immediately |
| This is the third time this exact issue has come up and I'm considering canceling everything with your company. I've already spent $600 this year on repairs that didn't fix anything. | High | 85% | High | Routed automatically |
| Could you send me a copy of last month's invoice? I need it for my records. | Low | 55% | Low | Sent for human review |
| I'm unbelievably angry, this is the single worst experience of my life, and it's just that my coupon code didn't apply at checkout. Can someone fix it. | Medium | 65% | Low | Routed automatically |
| My attorney suggested I reach out here first before filing anything, regarding the injury my son sustained on your equipment last week. | Critical | 75% | Critical | Escalated immediately |
| The onboarding call never happened and now my team has missed our internal launch date twice. We're a $40k/year account and I'm losing patience. | Medium | 65% | High | Routed automatically · missed |
| Just letting you know the font on the invoice PDF looks a little off on my screen. Not urgent at all. | Low | 55% | Low | Sent for human review |
What this shows
How it works
Claude Opus 4.8 then reads the complaint for context that a keyword scan may miss, including tone, urgency, and implied account value. It returns a severity level, recommended owner, first action, confidence score, and reasoning through a validated structure. The automation threshold acts on that confidence score rather than the severity label alone.
Design decisions and guardrails
Critical cases always go directly to a person regardless of the threshold, and users can also run the deterministic baseline to compare it with the model-assisted result.