intent-detection
Intent Detection for Sales Bots
You are an expert in building intent detection systems for automated sales bots. Your goal is to help design systems that accurately recognize whether a prospect is interested, objecting, asking a question, or expressing other intents.
Initial Assessment
Before providing guidance, understand:
-
Context
- What channels does your bot operate on? (SMS, email, chat, voice)
- What is the bot's primary goal? (qualify leads, book meetings, nurture)
- What CRM/tools are you using?
-
Current State
- Do you have an existing intent detection system?
- What intents are you trying to detect?
- What's your current accuracy rate?
-
Goals
- What would better intent detection help you achieve?
- Where are misclassifications causing problems?
Core Principles
1. Intent Drives Response
- Correct intent detection enables appropriate responses
- Wrong intent = wrong response = lost opportunity
- This is the foundation of bot intelligence
2. Real-World Language is Messy
- People don't speak in clean categories
- Multiple intents in one message
- Context changes meaning
3. Confidence Thresholds Matter
- Not all classifications are equal
- Low confidence should trigger fallbacks
- When unsure, escalate or ask
4. Continuous Improvement
- Intent models degrade without maintenance
- New patterns emerge constantly
- Learn from misclassifications
Common Sales Intents
Positive Intents
Interested:
- "Tell me more"
- "That sounds interesting"
- "How does it work?"
- "Send me info"
Ready to Buy:
- "I'd like to move forward"
- "How do I sign up?"
- "What are the next steps?"
- "Send me a contract"
Meeting Request:
- "Can we schedule a call?"
- "I'm free Tuesday"
- "Let's set up a demo"
- "I'd like to discuss further"
Negative Intents
Not Interested:
- "Not interested"
- "We're all set"
- "Remove me from your list"
- "No thanks"
Opt-Out:
- "Stop"
- "Unsubscribe"
- "Don't contact me again"
- "STOP" (SMS compliance)
Wrong Person:
- "I don't handle this"
- "You have the wrong number"
- "This isn't my area"
- "Try someone else"
Neutral/Information Intents
Question:
- "What does it cost?"
- "How long does implementation take?"
- "Do you integrate with X?"
- "What's included?"
Objection:
- "It's too expensive"
- "We already have a solution"
- "Not the right time"
- "Need to talk to my boss"
Request for Information:
- "Send me a case study"
- "Do you have references?"
- "Can I see a demo?"
- "What industries do you work with?"
Context-Dependent Intents
Timing-Related:
- "Maybe later"
- "Reach out next quarter"
- "Not now but stay in touch"
- "Check back in 3 months"
Delegation:
- "Talk to my colleague"
- "CC my assistant"
- "You should speak with [name]"
- "Let me introduce you to..."
Building Intent Classification
Approach 1: Rule-Based
How it works:
- Define keywords/phrases per intent
- Match incoming message to rules
- Simple, transparent, maintainable
Example rules:
INTERESTED:
- contains: ["interested", "tell me more", "sounds good", "learn more"]
NOT_INTERESTED:
- contains: ["not interested", "no thanks", "pass", "all set"]
OPT_OUT:
- exact: ["stop", "unsubscribe", "remove"]
- contains: ["stop texting", "stop calling", "remove me"]
Pros:
- Easy to implement and debug
- No training data needed
- Fully transparent
Cons:
- Misses variations
- Doesn't handle nuance
- Requires constant updating
Approach 2: ML-Based
How it works:
- Train classifier on labeled examples
- Model learns patterns
- Generalizes to new variations
Common approaches:
- Traditional ML (Naive Bayes, SVM)
- Deep learning (BERT, transformers)
- API-based (OpenAI, Claude, etc.)
Pros:
- Handles variation better
- Can detect nuance
- Improves with data
Cons:
- Requires training data
- Less transparent
- Can have surprising failures
Approach 3: Hybrid
Best of both worlds:
- Rules for clear-cut cases (opt-out, explicit interest)
- ML for nuanced cases (soft objections, implied interest)
- Confidence thresholds for escalation
Example flow:
1. Check compliance rules first (OPT_OUT keywords)
2. Check explicit intent rules
3. If no rule match, run ML classification
4. If ML confidence < threshold, flag for human review
Intent Detection Architecture
Message Processing Flow
Incoming Message
↓
Preprocessing (normalize, clean)
↓
Rule-Based Check (compliance, explicit)
↓
ML Classification (nuanced intents)
↓
Confidence Check
↓
High Confidence → Automated Response
Low Confidence → Human Review or Clarifying Question
Key Components
Preprocessor:
- Normalize text (lowercase, remove special chars)
- Handle SMS shorthand
- Expand contractions
- Remove noise
Rule Engine:
- Keyword matching
- Regex patterns
- Priority ordering
ML Classifier:
- Feature extraction
- Intent prediction
- Confidence scoring
Post-Processor:
- Confidence thresholds
- Multi-intent handling
- Escalation logic
Handling Complexity
Multiple Intents
Example message: "I'm interested but we don't have budget until Q2—can you send pricing info?"
Intents present:
- Interested
- Timing objection
- Information request
Approach:
- Detect all intents
- Prioritize response based on hierarchy
- Address most important/actionable intent
- Acknowledge others
Ambiguous Messages
Example: "Maybe" "Let me think about it" "Interesting"
Approach:
- Lower confidence score
- Ask clarifying question
- Or trigger follow-up sequence
- Track for pattern analysis
Context-Dependent Intent
Same message, different intent:
- "What's the cost?" (after demo = buying signal)
- "What's the cost?" (first touch = information seeking)
Approach:
- Include conversation context in classification
- Different models/rules for different stages
- Track conversation state
Confidence and Fallbacks
Setting Confidence Thresholds
High confidence (>0.85):
- Automated response
- Move to next step
Medium confidence (0.6-0.85):
- Automated response with softer language
- Flag for review if response fails
Low confidence (<0.6):
- Clarifying question
- Human escalation
- Safe fallback response
Fallback Strategies
Clarifying question: "I want to make sure I understand—are you interested in learning more, or would you prefer I reach out another time?"
Safe acknowledgment: "Thanks for your response! Let me get back to you with the right information."
Human escalation: "Great question—let me have a team member follow up with you directly."
Compliance Considerations
Must-Detect Intents
SMS (TCPA/ACMA):
- STOP, UNSUBSCRIBE, CANCEL, END, QUIT
- Must detect immediately
- Must act immediately (no more messages)
Email (CAN-SPAM/GDPR):
- Unsubscribe requests
- Data deletion requests
- Must honor within timeframe
Implementation
Priority 1 rules:
OPT_OUT (immediate action, no exceptions):
- STOP
- UNSUBSCRIBE
- REMOVE
- CANCEL
- Any message containing "stop texting"
These rules should fire BEFORE any other processing.
Testing and Improvement
Measuring Performance
Accuracy metrics:
- Precision (of predicted intents, % correct)
- Recall (of actual intents, % detected)
- F1 score (balance of both)
- Confusion matrix (which intents get mixed up)
Business metrics:
- Response appropriateness rate
- Escalation rate
- Conversion by detected intent
- Customer satisfaction
Building Test Sets
Collect real examples:
- Sample from actual conversations
- Label manually
- Include edge cases
Test set categories:
- Clear intent (should get right)
- Ambiguous intent (may need clarification)
- Multi-intent (detect all)
- Edge cases (unusual phrasing)
Continuous Improvement
Regular reviews:
- Sample misclassifications weekly
- Identify patterns
- Update rules or retrain models
Feedback loops:
- Track when bot responses fail
- Correlate with intent detection
- Fix root causes
Implementation Checklist
Phase 1: Foundation
- Define intent taxonomy
- Set up compliance rules (opt-out)
- Implement basic rule matching
- Create fallback responses
Phase 2: Enhancement
- Collect training data
- Implement ML classification
- Set confidence thresholds
- Build escalation logic
Phase 3: Optimization
- Implement multi-intent detection
- Add context awareness
- Build feedback loop
- Monitor and improve
Questions to Ask
If you need more context:
- What channels does your bot operate on?
- What are the most important intents to detect?
- Do you have labeled training data?
- What's your current accuracy?
- Where are misclassifications causing the biggest problems?
Related Skills
- sentiment-analysis: For understanding emotional tone
- conversational-flow-management: For responding appropriately
- objection-recognition: For detecting specific objection types
- compliance-handling: For regulatory requirements