โ† Back to skills
extension
Category: Data & AnalyticsNo API key required

Chat Vitals

Chat Vitals - Monitor chat conversation health with real-time insights. Tracks conversation quality metrics: first-try success rate, promise fulfillment, tok...

personAuthor: carolavahubclawhub

๐Ÿ“Š Chat Vitals v1.1.0

Monitor your AI conversation health like a doctor checks vital signs. Auto-collection + Real-time dashboard + Actionable insights.

โœจ What's New in v1.1.0

๐Ÿš€ Auto-Collection (Zero Friction)

Before: Manual tracking for every turn
Now: One command, automatic tracking

vitals start claude-sonnet-4.6
# All conversations tracked automatically!

๐Ÿ–ฅ๏ธ Real-Time Dashboard

Live terminal UI with health monitoring:

vitals dashboard

Shows:

  • โšก Live health score (0-100) with color coding
  • ๐Ÿ“Š Real-time metrics refresh
  • ๐Ÿšจ Instant alerts for problems
  • ๐Ÿ“ˆ Token usage tracking

๐Ÿš€ Quick Start

# 1. Start monitoring (one command!)
vitals start claude-sonnet-4.6

# 2. View real-time dashboard (in another terminal)
vitals dashboard

# 3. Check status anytime
vitals status

# 4. Generate report when done
vitals report

๐Ÿ“‹ All Commands

| Command | Description | |---------|-------------| | vitals start [model] | Start auto-monitoring session | | vitals dashboard | Launch real-time dashboard | | vitals status | Show current session status | | vitals summary | Quick session summary | | vitals complete | Mark session as complete | | vitals report | Generate detailed report |

๐ŸŽฏ Core Metrics

| Metric | Description | Healthy | Warning | Danger | |--------|-------------|---------|---------|--------| | First-Try Success | % tasks without rework | โ‰ฅ70% | 50-70% | <50% | | Rework Count | Corrections per task | 0 | 1-2 | >2 | | Promise Fulfillment | % promises delivered | โ‰ฅ80% | 60-80% | <60% | | Plan Inflation | Actual / Promised turns | โ‰ค1.3x | 1.3-2.0x | >2.0x | | Token Efficiency | Value per token | โ‰ฅ0.15 | 0.08-0.15 | <0.08 |

๐Ÿฅ Health Status

| Score | Status | Emoji | Color | |-------|--------|-------|-------| | 85-100 | Excellent | ๐ŸŸข | Green | | 70-84 | Good | ๐ŸŸก | Yellow | | 50-69 | Warning | ๐ŸŸ  | Orange | | <50 | Critical | ๐Ÿ”ด | Red |

๐Ÿ“Š Sample Output

๐Ÿ“Š Chat Vitals Dashboard
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€

Session: a1b2c3d4
Model:   claude-sonnet-4.6
Started: 2026-04-08T11:34:27

Health Score:
๐ŸŸข 85/100 - Excellent
[โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ] 85%

Key Metrics:
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
  โœ… First-Try Success: 85%
  โœ… Rework Count: 0
  โš ๏ธ  Promise Fulfillment: 75%
  โœ… Plan Inflation: 1.1x
  โœ… Token Efficiency: 0.22

Session Stats:
  ๐Ÿ’ฌ Total Turns: 3
  ๐Ÿ”ข Total Tokens: 1,030
  ๐Ÿ“Š Avg Tokens/Turn: 343

โš™๏ธ Configuration

Edit ~/.openclaw/skills/chat-vitals/config.json:

{
  "monitor": {
    "token_thresholds": {
      "report_daily": 50000
    },
    "health_thresholds": {
      "first_try_success_rate": {
        "excellent": 85,
        "good": 70,
        "warning": 50
      }
    }
  },
  "patterns": {
    "correction_keywords": ["ไธๅฏน", "้”™ไบ†", "้‡ๆ–ฐ"],
    "promise_patterns": ["ๆŽฅไธ‹ๆฅๆˆ‘ไผš", "้ฆ–ๅ…ˆ่ฎฉๆˆ‘"]
  }
}

๐Ÿ“ Project Structure

chat-vitals/
โ”œโ”€โ”€ vitals                  # โญ Simple CLI entry point
โ”œโ”€โ”€ SKILL.md
โ”œโ”€โ”€ README.md
โ”œโ”€โ”€ config.json
โ”œโ”€โ”€ scripts/
โ”‚   โ”œโ”€โ”€ collector.py        # Core data collection
โ”‚   โ”œโ”€โ”€ analyzer.py         # Metric analysis
โ”‚   โ”œโ”€โ”€ reporter.py         # Report generation
โ”‚   โ”œโ”€โ”€ auto_collector.py   # โญ Auto-collection
โ”‚   โ””โ”€โ”€ dashboard.py        # โญ Real-time dashboard
โ””โ”€โ”€ tests/
    โ””โ”€โ”€ test_vitals.py      # Test suite

๐Ÿงช Testing

cd ~/.openclaw/skills/chat-vitals
./tests/run_tests.sh

# Test new features
vitals start test-model
vitals status
vitals dashboard  # In a real terminal

๐Ÿ”Œ Advanced Usage

Legacy Manual Mode

python3 scripts/collector.py create ...
python3 scripts/collector.py record ...
python3 scripts/collector.py complete ...

Programmatic Access

from llmchat_vitals.scripts import auto_collector

# Start monitoring
auto_collector.auto_start_session("gpt-4")

# Record turn
auto_collector.auto_record_turn(user_input, model_output)

# Get live summary
summary = auto_collector.get_session_summary()
print(f"Health: {summary['health_score']}/100")

๐Ÿ›ฃ๏ธ Roadmap

  • [x] Auto-collection (v1.1.0)
  • [x] Real-time dashboard (v1.1.0)
  • [x] Simplified CLI (v1.1.0)
  • [ ] Webhook integrations (Feishu/Slack)
  • [ ] Intent drift detection
  • [ ] Web dashboard
  • [ ] Multi-model comparison
  • [ ] Prompt optimization suggestions

๐Ÿค Contributing

Issues and PRs welcome!

๐Ÿ“„ License

MIT License