theserverless.dev InferenceList

Compare

Add up to four models. The bill starts at 1M input tokens, 1M output tokens, and 1,000 units.

Monthly bill

Token models use the token counts. Other models use units times the flat rate.

Salesforce Llama Rank V1 (8B)$0.20
Anthropic: Claude Haiku Latest$0.60

Lowest bill: Salesforce Llama Rank V1 (8B) · $0.20

Add another

Search by name, then add up to four.

Salesforce Llama Rank V1 (8B)Anthropic: Claude Haiku Latest
ProviderTogetherAnthropic
Modalitytexttext, image
Context8K1M
Input$0.1/1M$0.1/1M
Output$0.1/1M$0.5/1M
Cache readNot published—$0.01/1M
Cache writeNot published—$0.125/1M
1-hour cache writeNot published—$0.2/1M
Tiers and extras
Salesforce Llama Rank V1 (8B)
—
Anthropic: Claude Haiku Latest
Web search: $0.01 per request; Above 100,000 prompt tokens: in $0.5 · out $2.5 · cache read $0.05 · cache write $0.625 · 1h cache write $1