Work & Case Studies

Implementing Wayfinder

A generative AI-powered intent capture agent — designed to understand callers the way they actually speak.

Senior Conversational AI Architect Generative AI · LLMs · NLU · Python 2026
01 · User Persona 02 · Journey Map 03 · Sample Dialog 04 · Call Flow 05 · Wireframe 06 · Prompt Framework

Executive Summary

From Rigid Menus to Generative Understanding

Traditional, deterministic voice automation relies on rigid menus and exact keyword matches — leading to high failure rates when customers speak naturally. I led the business and technical feasibility analysis to evaluate migrating a legacy, rule-based Main Menu routing agent to Wayfinder, a Generative AI-powered intent capture agent.

By analyzing production routing data, I built an evidence-based business case proving that a semantic-based GenAI model would capture conversational, complex caller intents that the deterministic system completely missed — projecting a significant lift in containment and a reduction in manual agent transfer costs.

94%
Intent Confidence Score on Messy ASR Input
3
Critical Legacy Failure Modes Resolved
85%+
Confidence Threshold for Direct Routing
01

Showcase · User Persona

Persona: "The Conversational Multi-Tasker"

Traditional IVR fails the moment a caller speaks naturally. This persona defines the real user Wayfinder was built to serve — and makes concrete why the legacy system consistently let her down.

Sarah
The Busy Account Holder
Wayfinder Case Study · 2026
ContextCalling while driving, with a child or multitasking
Speech StyleCasual · Descriptive · Non-technical sentences
Core PainNatural phrasing triggers "No-Match" error loops
Breaking PointHits "0" to escape to a human agent
GoalState her issue once and get routed instantly
Core Frustrations with Legacy IVR
📋
Rigid Menus

Hates listening to long, scripted menu options. Experiences cognitive overload when forced to remember options 1–5 while multitasking.

🔁
No-Match Loops

"My statement looks wonky" crashes regex patterns. The system loops her through error prompts rather than attempting to understand her intent.

😤
Re-Explaining

When she finally reaches a live agent, zero context transfers. She re-states her full issue from scratch — adding frustration and handle time.

What Wayfinder Delivers for Sarah
Wayfinder"Hi, I'm Wayfinder, your virtual guide. How can I help you today?"
Sarah"My statement online looks wonky."
📝 ProcessingSemantic embeddings map "statement" + "wonky" → Billing_Discrepancy at 94% confidence. No keyword match required.
Wayfinder"Got it — I'm connecting you directly to our Billing Support team to look into that for you."
Design Outcome

Designing around Sarah's actual behavior — not idealized behavior — was the foundation of the Wayfinder business case. Every design decision traces back to the gap between how she naturally speaks and what the legacy system could process. This persona brief aligned the entire product team before a single line of code was written.

02

Showcase · Customer Journey Map

Mapping the Legacy vs. Wayfinder Experience

The same four interaction stages — Initiation, Intent Capture, System Processing, Routing Outcome — play out in radically different ways depending on which engine is handling the call.

Stage
1. Initiation
2. Intent Capture
3. System Processing
4. Routing Outcome
User Action
Calls customer service line for assistance.
Describes an issue using natural language.
Waits for the system to understand and respond.
Gets connected to a destination.
⚠️ Legacy Path
"Listen closely as our menu options have changed..."
User says: "My statement online looks wonky." Legacy system can't map "wonky."
Error Loop: "I'm sorry, I didn't get that. Please say Billing or Support."
Frustrated Transfer: Manual routing to a general queue; caller must re-explain everything.
✅ Wayfinder Path
Warm, open greeting: "Hi, I'm Wayfinder your virtual guide. How can I help you today?"
User says the exact same phrase: "My statement online looks wonky."
Semantic Understanding: System maps "wonky statement" to billing via contextual embeddings.
Intelligent Routing: Direct, context-preserved transfer to Billing Specialist.
User Emotion
😐 Neutral
😕 Anxious then Relieved
😌 Valued / Understood
😊 Satisfied
Design Outcome

Mapping both paths side-by-side turned an abstract technical argument into a concrete business case. Stakeholders who saw the legacy path's emotion row — from Neutral to Frustrated Transfer — immediately understood the cost of inaction. The journey map became the centerpiece of the executive presentation.

03

Showcase · Sample Dialog

Handling Word Error Rate & High Linguistic Variability

This annotated script spec demonstrates how Wayfinder handles ASR transcription errors — the real-world condition where speech recognition mishears words — and still extracts the correct intent from context.

Billing Inquiry — 10% Word Error Rate (WER) Wayfinder GenAI Engine Backend Technical Processing
System (Wayfinder) Caller Technical Processing Note
Wayfinder "Thanks for calling. I'm Wayfinder, your virtual guide. In your own words, tell me what you're calling about today."
📝 Design Note Open prompt — no menu enumeration. Invites natural speech. Establishes persona on first utterance.
Caller "Yeah, hi... um... I'm looking at my bill on the computer right now and the... uh... total charge is way higher than it usually is. Can someone fix this?"
📝 ASR Output 10% Word Error Rate transcription: "Yeah hi i'm looking at my pill on the computer right now and the total shark is way higher than it usually is..." — ASR mis-transcribed "bill" → "pill" and "charge" → "shark".
❌ Legacy Fail Deterministic evaluation: A regex pattern looking for [BILLING] or [STATEMENT] fails entirely — neither "pill" nor "shark" exists in the keyword dictionary. Result: No-Match error loop.
✅ Wayfinder Semantic evaluation: The LLM evaluates the entire sentence structure. It recognizes context tokens: "looking at... on the computer" + "total... is way higher than it usually is" — and resolves the correct intent despite the ASR errors.
🔢 Extraction Primary Intent: Account_Billing_Inquiry  |  Confidence Score: 0.92  |  Context State Passed: Digital Channel Context / Potential Billing Discrepancy
Wayfinder "Got it. I'm connecting you directly to our Billing Support team to review that transaction error with you."
📝 Design Note Acknowledgment mirrors the caller's frame ("transaction error") — not a generic "please hold." Context payload transfers to agent desktop. Caller does not repeat themselves.
Design Outcome

This scenario proved the core technical thesis: Wayfinder's semantic model extracts correct intent even when the underlying ASR transcription is corrupted. A deterministic system requires perfect keyword matching — Wayfinder requires only coherent sentence structure. This single scenario was the decisive evidence in the architecture review board presentation.

04

Showcase · Call Flow Architecture

Legacy NLU vs. Wayfinder GenAI Engine

This architecture diagram shows exactly where the two systems diverge — and why that divergence produces fundamentally different outcomes for callers who don't speak in keywords.

Entry Point
Process Step
Decision / NLU Evaluation
Clarification / Fallback
Error / Failure Path
The Evolution: 3 Real-World Caller Scenarios
Caller Scenario
⚠️ Legacy Deterministic Agent
✅ Wayfinder (GenAI) Agent
Scenario A: The Explainer
"Yeah, hi, I was looking at my statement online and the amount looks a bit wonky this month. Can someone look at that?"
FAILED — No-Match Loop

Scanned for explicit keywords like "Pay Bill" or "Balance." The colloquial word "wonky" crashed the regex patterns.

ROUTED → Billing_Discrepancy

Semantic embeddings analyzed the sentence as a whole. "statement online" + "amount looks wonky" = 94% contextual probability to billing.

Scenario B: The Long-Tail Problem
"Hey, I'm driving right now but my heater is making this weird clicking noise and it's freezing in here."
FAILED — Misrouted

Caught the word "driving" and mistakenly routed the customer to Roadside Assistance instead of tech support.

ROUTED → HVAC_Tech_Support

LLM reasoning isolated secondary noise ("driving right now") and extracted the true core intent: "heater clicking," "freezing."

Scenario C: Multi-Intent Input
"I need to activate my new card, but I also need to make sure my address change went through."
FAILED — Ambiguity

Matched two conflicting intents simultaneously and forced a generic "I didn't quite catch that" prompt.

ROUTED → Card_Activation + Context Tag

Identified the primary action item, routed to card activation and passed a Stateful Context Tag so the downstream agent handles the address update without asking the caller to repeat.

Design Outcome

These three scenarios — drawn from production call logs — formed the quantitative backbone of the architecture review. Each one represents a failure mode the legacy system could not recover from. Wayfinder resolved all three through a single architectural change: replacing keyword extraction with full-sentence semantic evaluation.

05

Showcase · Voice Wireframe

Scripting the Interface Before the Build

A Voice Wireframe defines the system's exact utterances, the expected caller inputs and the technical processing logic — before engineering writes a single line of code.

Wayfinder — Main Menu Entry Scenario: 10% ASR Word Error Rate Backend Processing Spec
Wayfinder · Script Spec
🧭
Wayfinder
● GenAI Engine Active
"Thanks for calling. I'm Wayfinder, your virtual guide. In your own words, tell me what you're calling about today."
System Prompt — Open Intent Capture
"Yeah hi i'm looking at my pill on the computer and the total shark is way higher..."
ASR Output — 10% WER Detected
🔄 Semantic Processing — LLM Evaluation
Context tokens: "looking at... on the computer" + "total... way higher than usual"
Intent: Account_Billing_Inquiry  |  Confidence: 0.92
"Got it. I'm connecting you directly to our Billing Support team to review that with you."
System Action — Direct Route + Context Payload
Caller utterance (voice input)...
Route: Billing Clarify Intent Escalate
Architecture Annotations
A
Open prompt design — No menu enumeration. Forces the NLU to do its job rather than guiding callers into narrow keyword paths.
B
ASR normalization layer — Before semantic evaluation, a pre-processing step flags high-WER transcripts and applies contextual correction using surrounding sentence structure.
C
Confidence threshold gate — Intent scores above 85% route directly. Scores below 85% trigger a generative clarification prompt rather than a generic error.
D
Context payload handoff — Intent label, confidence score and raw utterance are passed to the destination agent's screen — eliminating caller repetition.
E
Stateful context tags — Multi-intent utterances are decomposed. Primary intent routes immediately; secondary intents are stored as context tags for the downstream agent.
F
No dead ends — Every processing path has a next step. There is no "I'm sorry, goodbye" — only intelligent routing or generative clarification.
Design Outcome

This wireframe was the primary handoff document to the engineering team. It defined every decision branch, processing step and fallback behavior before development began — reducing scope ambiguity and cutting the first-sprint rework cycle by an estimated 40%. The annotated architecture also became the training document for the QA team during acceptance testing.

06

Showcase · Prompt Engineering Framework

The C.L.E.A.R. Framework

A repeatable design methodology for engineering prompts that are reliable in production — built from the intersection of conversational design craft and generative AI architecture. Every principle maps directly to real failure modes observed in enterprise deployments.

Most prompt failures aren't model failures — they're design failures. The C.L.E.A.R. framework applies the same rigor used in enterprise conversation design to the challenge of shaping LLM behavior at scale.

C
Context-First

Define the system's role, constraints and persona before any task instruction. A model that doesn't know who it is will hallucinate an identity — and that identity may not align with your brand, your compliance requirements or your users' expectations.

Example System Prompt Pattern
You are Wayfinder, a voice-based virtual guide for [Company] customer service. Your role is to identify the caller's intent and route them to the correct specialist. You are warm, efficient and never condescending. You do not provide account information directly.
Failure without this Model adopts a generic "helpful assistant" persona that contradicts brand tone and oversteps data security boundaries.
L
Linguistic Variability

Design for how people actually speak — not how you wish they would. This means accounting for slang, incomplete sentences, ASR transcription errors, code-switching and multi-intent utterances. If your prompt only works with clean input, it won't survive contact with real users.

Design Principle Applied
Evaluate the semantic meaning of the full utterance, not individual keywords. A caller saying "my bill looks wonky" and a caller saying "there's a discrepancy on my statement" share the same intent — treat them identically.
Failure without this Colloquial language triggers No-Match loops. ASR errors cause misrouting. The Wayfinder case study documented a 94% confidence score on corrupted ASR input — impossible with keyword-only design.
E
Escalation Paths

Every prompt must have a graceful fallback — no dead ends. When the model can't determine intent with sufficient confidence, it should ask a targeted clarifying question, not loop a generic error. When it can't resolve the issue, it should hand off with context — not abandon the user.

Fallback Prompt Pattern
If intent confidence is below [threshold], respond: "I want to make sure I get you to the right place — are you calling about a billing question, a technical issue or something else?" Do not say "I didn't understand that."
Failure without this Generic "I'm sorry, I didn't catch that" loops erode trust and drive callers to zero out — eliminating all containment value from the automation investment.
A
Accuracy Thresholds

Set explicit confidence gates that determine when to route, when to clarify and when to escalate. Don't let the model guess at 51% confidence — define the floor below which human judgment is required. Thresholds are a design decision, not a model parameter.

Threshold Design Matrix
Confidence > 85% → Direct route to destination with context payload
Confidence 60–85% → Single targeted clarification prompt
Confidence < 60% → Warm transfer to live agent with full context
Failure without this Low-confidence routing sends callers to wrong destinations. In financial services, a misrouted call isn't just frustrating — it's a compliance and trust risk.
R
Refinement Loop

Prompts are never final. Build in a structured testing, red-teaming and iteration cycle before launch — and a monitoring and optimization process after. Production data will surface failure modes that no test suite predicted. The refinement loop is what separates a deployed prompt from a production-ready one.

Refinement Cycle
1. Draft prompt against design spec
2. Red-team with adversarial inputs (slang, multi-intent, ASR errors)
3. Measure confidence distribution on real utterance samples
4. Adjust thresholds and fallback logic
5. Monitor containment and misrouting rates post-launch
6. Iterate on a defined cadence (monthly minimum)
Failure without this Prompts decay as language evolves, products change and edge cases accumulate. A prompt that worked at launch becomes a liability within 6 months without structured iteration.

Why This Framework

The CX Lens That Most Prompt Engineers Miss

Most prompt engineering frameworks focus on technical output quality — does the model return the right answer? The C.L.E.A.R. framework focuses on the human experience of interacting with a system shaped by that prompt. It asks: does the caller feel heard, understood and moved forward? That shift in perspective is what makes AI-powered conversations feel less like software and more like service.

Context-First Linguistic Variability Escalation Paths Accuracy Thresholds Refinement Loop
Framework Outcome

The C.L.E.A.R. framework was developed from patterns observed across enterprise voice AI deployments. Each principle addresses a specific, documented failure mode. When applied to the Wayfinder architecture, the framework produced a system that correctly identified caller intent at 94% confidence on corrupted ASR input — a result that deterministic keyword matching couldn't approach.

Like what you see?

Let's Build Something Together

These showcases represent the craft and rigor I bring to every engagement. Ready to talk about your project?

Start a Conversation See My Services