Agent Token Cost Signal Kit
Find token waste, repeated calls, and risky routing changes before they become real cost.
Features
-
🔍 Token Waste Check Finds agents that may be using too many tokens for the work they do.
-
🔁 Repeated Call Signal Spots retries, loops, repeated tool calls, or duplicate scheduled jobs.
-
🧠 Routing Risk Check Flags model or routing changes that may increase token use.
-
🧾 Evidence Before Action Avoids judging from one noisy run or mixed workloads.
-
🛠 Clear Next Step Tells you whether to watch, investigate one path, keep status quo, or consider rollback.
Install
openclaw skills install agent-cost-eval-kit
openclaw skills install agent-cost-eval-kit --global
openclaw skills install agent-cost-eval-kit --global --force
Activation
eval cost change for [My_Agent]
eval token change for [My_Agent]
check token waste for [My_Agent]
What You Will Get
- Status
- What was checked
- Waste signal
- Risk level
- Recommended next action
Status Labels
-
No Clear Waste No meaningful token waste is visible from the available evidence.
-
Watch Only There may be waste, but evidence is not strong enough to act.
-
Investigate One Path One specific agent, job, route, or task path looks suspicious.
-
Keep Status Quo The current setup looks better than the previous one. Do not rollback or make more changes yet.
-
Rollback Candidate A recent change may have increased token use or reduced reliability. Review before rollback.
-
Unsafe to Decide The workflow is too risky, mixed, or under-sampled to make a safe judgment.
Output Format
Every result starts with a status label, then gives the priority item, reason, evidence, risk level, and next action.
Status: Investigate One Path
Fix First:
daily_empty_signal_reminder
Reason:
Recent runs repeatedly returned NO_REPLY or produced no useful downstream action while still starting a full agent loop.
Evidence:
- Recent scheduled runs repeatedly returned NO_REPLY
- The job still consumed tokens on each run
- The upstream signal source appears empty or inactive
Risk:
Medium
Next Action:
Do read-only verification first. Confirm whether the reminder still has a valid upstream signal source before pausing, reducing frequency, or adding pre-agent filtering.
A short output is not waste by itself. Waste means the task consumed tokens without producing useful downstream value.
What This Will Not Do
It will not:
- calculate exact provider billing without full pricing and usage data
- treat token count as exact dollar cost
- judge from one noisy run
- compare unrelated task types as the same workload
- promise lower cost with equal quality
- edit configs, switch models, disable jobs, or delete cron tasks
- require API keys, private keys, secrets, credentials, or full private logs
This skill is read-only. It may recommend an action, but it will not ask to immediately disable, edit, delete, switch, or change production configs.
Redact sensitive data before pasting logs.
Scan to join WeChat group