๐ Chat Vitals v1.1.0
Monitor your AI conversation health like a doctor checks vital signs. Auto-collection + Real-time dashboard + Actionable insights.
โจ What's New in v1.1.0
๐ Auto-Collection (Zero Friction)
Before: Manual tracking for every turn
Now: One command, automatic tracking
vitals start claude-sonnet-4.6
# All conversations tracked automatically!
๐ฅ๏ธ Real-Time Dashboard
Live terminal UI with health monitoring:
vitals dashboard
Shows:
- โก Live health score (0-100) with color coding
- ๐ Real-time metrics refresh
- ๐จ Instant alerts for problems
- ๐ Token usage tracking
๐ Quick Start
# 1. Start monitoring (one command!)
vitals start claude-sonnet-4.6
# 2. View real-time dashboard (in another terminal)
vitals dashboard
# 3. Check status anytime
vitals status
# 4. Generate report when done
vitals report
๐ All Commands
| Command | Description |
|---------|-------------|
| vitals start [model] | Start auto-monitoring session |
| vitals dashboard | Launch real-time dashboard |
| vitals status | Show current session status |
| vitals summary | Quick session summary |
| vitals complete | Mark session as complete |
| vitals report | Generate detailed report |
๐ฏ Core Metrics
| Metric | Description | Healthy | Warning | Danger | |--------|-------------|---------|---------|--------| | First-Try Success | % tasks without rework | โฅ70% | 50-70% | <50% | | Rework Count | Corrections per task | 0 | 1-2 | >2 | | Promise Fulfillment | % promises delivered | โฅ80% | 60-80% | <60% | | Plan Inflation | Actual / Promised turns | โค1.3x | 1.3-2.0x | >2.0x | | Token Efficiency | Value per token | โฅ0.15 | 0.08-0.15 | <0.08 |
๐ฅ Health Status
| Score | Status | Emoji | Color | |-------|--------|-------|-------| | 85-100 | Excellent | ๐ข | Green | | 70-84 | Good | ๐ก | Yellow | | 50-69 | Warning | ๐ | Orange | | <50 | Critical | ๐ด | Red |
๐ Sample Output
๐ Chat Vitals Dashboard
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Session: a1b2c3d4
Model: claude-sonnet-4.6
Started: 2026-04-08T11:34:27
Health Score:
๐ข 85/100 - Excellent
[โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ] 85%
Key Metrics:
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ
First-Try Success: 85%
โ
Rework Count: 0
โ ๏ธ Promise Fulfillment: 75%
โ
Plan Inflation: 1.1x
โ
Token Efficiency: 0.22
Session Stats:
๐ฌ Total Turns: 3
๐ข Total Tokens: 1,030
๐ Avg Tokens/Turn: 343
โ๏ธ Configuration
Edit ~/.openclaw/skills/chat-vitals/config.json:
{
"monitor": {
"token_thresholds": {
"report_daily": 50000
},
"health_thresholds": {
"first_try_success_rate": {
"excellent": 85,
"good": 70,
"warning": 50
}
}
},
"patterns": {
"correction_keywords": ["ไธๅฏน", "้ไบ", "้ๆฐ"],
"promise_patterns": ["ๆฅไธๆฅๆไผ", "้ฆๅ
่ฎฉๆ"]
}
}
๐ Project Structure
chat-vitals/
โโโ vitals # โญ Simple CLI entry point
โโโ SKILL.md
โโโ README.md
โโโ config.json
โโโ scripts/
โ โโโ collector.py # Core data collection
โ โโโ analyzer.py # Metric analysis
โ โโโ reporter.py # Report generation
โ โโโ auto_collector.py # โญ Auto-collection
โ โโโ dashboard.py # โญ Real-time dashboard
โโโ tests/
โโโ test_vitals.py # Test suite
๐งช Testing
cd ~/.openclaw/skills/chat-vitals
./tests/run_tests.sh
# Test new features
vitals start test-model
vitals status
vitals dashboard # In a real terminal
๐ Advanced Usage
Legacy Manual Mode
python3 scripts/collector.py create ...
python3 scripts/collector.py record ...
python3 scripts/collector.py complete ...
Programmatic Access
from llmchat_vitals.scripts import auto_collector
# Start monitoring
auto_collector.auto_start_session("gpt-4")
# Record turn
auto_collector.auto_record_turn(user_input, model_output)
# Get live summary
summary = auto_collector.get_session_summary()
print(f"Health: {summary['health_score']}/100")
๐ฃ๏ธ Roadmap
- [x] Auto-collection (v1.1.0)
- [x] Real-time dashboard (v1.1.0)
- [x] Simplified CLI (v1.1.0)
- [ ] Webhook integrations (Feishu/Slack)
- [ ] Intent drift detection
- [ ] Web dashboard
- [ ] Multi-model comparison
- [ ] Prompt optimization suggestions
๐ค Contributing
Issues and PRs welcome!
๐ License
MIT License
Scan to join WeChat group