-
Notifications
You must be signed in to change notification settings - Fork 770
Open
Labels
priority-highThe team is prioritizing this issue and will tackle it very soon.The team is prioritizing this issue and will tackle it very soon.rustThis issue involves Rust.This issue involves Rust.
Milestone
Description
Follow up to #6260
The values should be stored in aggregate for the whole inference in ChatInference or JsonInference; and for the individual model inference in ModelInference. We'll need to add cost columns to all those tables in both backends.
Proposed:
- Postgres: `NUMERIC(18, 9)
-
- ClickHouse:
Decimal(18, 9)
- ClickHouse:
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
priority-highThe team is prioritizing this issue and will tackle it very soon.The team is prioritizing this issue and will tackle it very soon.rustThis issue involves Rust.This issue involves Rust.