theserverless.dev InferenceList

Compare

Add up to four models. The bill starts at 1M input tokens, 1M output tokens, and 1,000 units.

Monthly bill

Token models use the token counts. Other models use units times the flat rate.

Anthropic: Claude Haiku Latest$0.60
Arize AI Qwen 2 1.5B Instruct$0.20

Lowest bill: Arize AI Qwen 2 1.5B Instruct · $0.20

Add another

Search by name, then add up to four.

Anthropic: Claude Haiku LatestArize AI Qwen 2 1.5B Instruct
ProviderAnthropicTogether
Modalitytext, imagetext
Context1M33K
Input$0.1/1M$0.1/1M
Output$0.5/1M$0.1/1M
Cache read$0.01/1MNot published—
Cache write$0.125/1MNot published—
1-hour cache write$0.2/1MNot published—
Tiers and extras
Anthropic: Claude Haiku Latest
Web search: $0.01 per request; Above 100,000 prompt tokens: in $0.5 · out $2.5 · cache read $0.05 · cache write $0.625 · 1h cache write $1
Arize AI Qwen 2 1.5B Instruct
—