File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change 1+ # TokenMeter Roadmap
2+
3+ ## Vision
4+ Be the de-facto observability layer for LLM applications — as essential as logging is for traditional services.
5+
6+ ## ✅ Shipped
7+ - One-line drop-in integration (replace a single import)
8+ - Real-time cost + token + latency tracking
9+ - Smart model routing (up to 60% cost savings)
10+ - OpenAI, Anthropic, Google Gemini support
11+ - ` <5ms ` overhead
12+
13+ ## 🔨 In Progress
14+ - [ ] Mistral AI provider support
15+ - [ ] LangChain callback integration
16+ - [ ] CSV / JSON cost export
17+
18+ ## 📋 Planned — Q2 2025
19+ - [ ] Web dashboard for cost visualisation
20+ - [ ] Per-feature / per-user cost attribution tags
21+ - [ ] Budget alerts (Slack / email when threshold hit)
22+ - [ ] OpenAI Assistants API support
23+ - [ ] Streaming response cost tracking
24+
25+ ## 📋 Planned — Q3 2025
26+ - [ ] Ollama (local model) cost estimation
27+ - [ ] Team / org cost sharing and allocation
28+ - [ ] CI budget gates — fail PRs that exceed cost thresholds
29+ - [ ] AWS Bedrock provider support
30+
31+ ## 💡 Under Consideration
32+ - Grafana dashboard plugin
33+ - OpenTelemetry metrics export
34+ - Cohere provider support
35+ - LlamaIndex integration
36+
37+ ## Contributing
38+ See [ CONTRIBUTING.md] ( CONTRIBUTING.md ) . Provider integrations are a great first contribution.
You can’t perform that action at this time.
0 commit comments