Gregor Žunič 35bb5e8039 Add token caching for claude (#2108) ...

<!-- This is an auto-generated description by cubic. -->

## Summary by cubic
Added token caching support for Claude models, including accurate
tracking and cost calculation for cached, cache creation, and uncached
tokens.

- **New Features**
- Added `cache` flag to messages and updated Anthropic message
serialization to support Claude's token caching.
- Updated token usage and cost tracking to handle cached tokens, cache
creation tokens, and their costs.
- Improved token usage logs to show detailed breakdowns for cached and
uncached tokens.
  - Added tests for Anthropic cache serialization and cost calculation.

<!-- End of auto-generated description by cubic. -->

2025-06-25 21:28:42 +02:00

..

service.py

Add token caching for claude (#2108)

2025-06-25 21:28:42 +02:00

utils.py

Squashed commit langchain to native

2025-06-24 12:26:55 +02:00

views.py

mr cloudrunner

2025-06-24 23:02:08 +02:00