nickviljoen
|
8bc1256e82
|
Add usage tracking reports, profile versioning, and token tracking
Implements three major feature enhancements:
1. Usage Tracking Reports
- Command-line tool (generate_usage_report.py) for comprehensive usage reports
- Supports text, JSON, and CSV output formats
- Filters by date range, client, and user
- Aggregates statistics by client, user, profile, and date
- Automated report generation via cron jobs
2. Profile Auto-Versioning & Visibility Control
- Automatic version control: edits create new versions (v2, v3, etc.)
- Original profiles preserved for rollback capability
- Profile visibility control (all clients vs client-specific)
- Client-profile relationship management with dynamic updates
- Audit trail with timestamps and user tracking
3. Actual Token Usage Tracking
- Captures real token counts from OpenAI and Gemini APIs
- Precise cost calculations instead of estimates (99% accuracy)
- Per-check and per-provider token breakdowns
- Pricing validation tool (validate_pricing.py)
- Token usage optimization recommendations
Key Files Added:
- backend/generate_usage_report.py - Usage report generator
- backend/validate_pricing.py - Pricing validation tool
- backend/USAGE_REPORTS.md - Usage reports documentation
- backend/PROFILE_MANAGEMENT.md - Profile versioning guide
- backend/TOKEN_TRACKING_ENHANCEMENT.md - Token tracking guide
- backend/PRICING_GUIDE.md - Pricing validation guide
- backend/NEW_FEATURES_QUICKSTART.md - Quick start guide
- IMPLEMENTATION_SUMMARY.md - Complete implementation overview
Key Files Modified:
- backend/api_server.py - Profile versioning, token passthrough
- backend/client_config.py - Visibility-aware profile filtering
- backend/llm_config.py - Token usage extraction from APIs
- backend/usage_tracker.py - Actual token tracking and cost calculation
- CLAUDE.md - Updated documentation with new features
Benefits:
- Accurate cost tracking with real token usage
- Safe profile editing with version history
- Flexible profile visibility for multi-tenant setup
- Comprehensive usage analytics for optimization
- Better budget forecasting and client billing
Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
|
2026-02-02 13:22:33 +02:00 |
|