mirror of
https://github.com/vimagick/dockerfiles.git
synced 2025-12-21 13:23:02 +01:00
38 lines
1.2 KiB
Plaintext
38 lines
1.2 KiB
Plaintext
- go to https://www.botgenuity.com/tools/llm-pricing.
|
|
- extract the 1M input & output token prices for 4 models from page
|
|
1. gpt-4o
|
|
2. gpt-4o-mini
|
|
3. claude-3-5-sonnet-latest
|
|
4. claude-3-5-haiku-latest
|
|
- convert the 1M token price to per token price (in exponential notation)
|
|
- fill in all missing values (related to model_name) in the provided yaml file.
|
|
- print the updated yaml file
|
|
|
|
```yaml
|
|
model_list:
|
|
- model_name: gpt-4o
|
|
litellm_params:
|
|
model: openai/gpt-4o
|
|
api_key: os.environ/OPENAI_API_KEY
|
|
input_cost_per_token: missing
|
|
output_cost_per_token: missing
|
|
- model_name: gpt-4o-mini
|
|
litellm_params:
|
|
model: openai/gpt-4o-mini
|
|
api_key: os.environ/OPENAI_API_KEY
|
|
input_cost_per_token: missing
|
|
output_cost_per_token: missing
|
|
- model_name: claude-3.5-sonnet
|
|
litellm_params:
|
|
model: anthropic/claude-3-5-sonnet-latest
|
|
api_key: os.environ/ANTHROPIC_API_KEY
|
|
input_cost_per_token: missing
|
|
output_cost_per_token: missing
|
|
- model_name: claude-3.5-haiku
|
|
litellm_params:
|
|
model: anthropic/claude-3-5-haiku-latest
|
|
api_key: os.environ/ANTHROPIC_API_KEY
|
|
input_cost_per_token: missing
|
|
output_cost_per_token: missing
|
|
```
|