- name
- chat-vitals
- version
- 1.1.0
- description
- |
- Features
- Keywords
- chat monitoring, LLM health, conversation quality, token
- metadata
- author
- OpenClaw Community
- license
- MIT
- openclaw
- emoji
- 📊
- category
- utility
- tags
- ["chat", "monitoring", "vitals", "analytics", "performance", "dashboard"]
- requires
- bins
- ["python3"]
- python
- >=3.8
- compatibility
- openclaw
- >=0.9.0
📊 Chat Vitals v1.1.0
Monitor your AI conversation health like a doctor checks vital signs. Auto-collection + Real-time dashboard + Actionable insights.
✨ What's New in v1.1.0
🚀 Auto-Collection (Zero Friction)
Before: Manual tracking for every turn Now: One command, automatic tracking
vitals start claude-sonnet-4.6
# All conversations tracked automatically!🖥️ Real-Time Dashboard
Live terminal UI with health monitoring:
vitals dashboardShows:
- ⚡ Live health score (0-100) with color coding
- 📊 Real-time metrics refresh
- 🚨 Instant alerts for problems
- 📈 Token usage tracking
🚀 Quick Start
# 1. Start monitoring (one command!)
vitals start claude-sonnet-4.6
# 2. View real-time dashboard (in another terminal)
vitals dashboard
# 3. Check status anytime
vitals status
# 4. Generate report when done
vitals report📋 All Commands
| Command | Description |
|---|---|
vitals start [model] | Start auto-monitoring session |
vitals dashboard | Launch real-time dashboard |
vitals status | Show current session status |
vitals summary | Quick session summary |
vitals complete | Mark session as complete |
vitals report | Generate detailed report |
🎯 Core Metrics
| Metric | Description | Healthy | Warning | Danger |
|---|---|---|---|---|
| First-Try Success | % tasks without rework | ≥70% | 50-70% | <50% |
| Rework Count | Corrections per task | 0 | 1-2 | >2 |
| Promise Fulfillment | % promises delivered | ≥80% | 60-80% | <60% |
| Plan Inflation | Actual / Promised turns | ≤1.3x | 1.3-2.0x | >2.0x |
| Token Efficiency | Value per token | ≥0.15 | 0.08-0.15 | <0.08 |
🏥 Health Status
| Score | Status | Emoji | Color |
|---|---|---|---|
| 85-100 | Excellent | 🟢 | Green |
| 70-84 | Good | 🟡 | Yellow |
| 50-69 | Warning | 🟠 | Orange |
| <50 | Critical | 🔴 | Red |
📊 Sample Output
📊 Chat Vitals Dashboard
──────────────────────────────────────────────────
Session: a1b2c3d4
Model: claude-sonnet-4.6
Started: 2026-04-08T11:34:27
Health Score:
🟢 85/100 - Excellent
[██████████████████████████████] 85%
Key Metrics:
──────────────────────────────────────────────────
✅ First-Try Success: 85%
✅ Rework Count: 0
⚠️ Promise Fulfillment: 75%
✅ Plan Inflation: 1.1x
✅ Token Efficiency: 0.22
Session Stats:
💬 Total Turns: 3
🔢 Total Tokens: 1,030
📊 Avg Tokens/Turn: 343⚙️ Configuration
Edit ~/.openclaw/skills/chat-vitals/config.json:
{
"monitor": {
"token_thresholds": {
"report_daily": 50000
},
"health_thresholds": {
"first_try_success_rate": {
"excellent": 85,
"good": 70,
"warning": 50
}
}
},
"patterns": {
"correction_keywords": ["不对", "错了", "重新"],
"promise_patterns": ["接下来我会", "首先让我"]
}
}📁 Project Structure
chat-vitals/
├── vitals # ⭐ Simple CLI entry point
├── SKILL.md
├── README.md
├── config.json
├── scripts/
│ ├── collector.py # Core data collection
│ ├── analyzer.py # Metric analysis
│ ├── reporter.py # Report generation
│ ├── auto_collector.py # ⭐ Auto-collection
│ └── dashboard.py # ⭐ Real-time dashboard
└── tests/
└── test_vitals.py # Test suite🧪 Testing
cd ~/.openclaw/skills/chat-vitals
./tests/run_tests.sh
# Test new features
vitals start test-model
vitals status
vitals dashboard # In a real terminal🔌 Advanced Usage
Legacy Manual Mode
python3 scripts/collector.py create ...
python3 scripts/collector.py record ...
python3 scripts/collector.py complete ...Programmatic Access
from llmchat_vitals.scripts import auto_collector
# Start monitoring
auto_collector.auto_start_session("gpt-4")
# Record turn
auto_collector.auto_record_turn(user_input, model_output)
# Get live summary
summary = auto_collector.get_session_summary()
print(f"Health: {summary['health_score']}/100")🛣️ Roadmap
- [x] Auto-collection (v1.1.0)
- [x] Real-time dashboard (v1.1.0)
- [x] Simplified CLI (v1.1.0)
- [ ] Webhook integrations (Feishu/Slack)
- [ ] Intent drift detection
- [ ] Web dashboard
- [ ] Multi-model comparison
- [ ] Prompt optimization suggestions
🤝 Contributing
Issues and PRs welcome!
📄 License
MIT License