theserverless.dev InferenceList

Compare

Add up to four models. The bill starts at 1M input tokens, 1M output tokens, and 1,000 units.

Monthly bill

Token models use the token counts. Other models use units times the flat rate.

Meta: Llama 3.3 70B Instruct$0.42
Anthropic: Claude Haiku Latest$0.60

Lowest bill: Meta: Llama 3.3 70B Instruct · $0.42

Add another

Search by name, then add up to four.

Meta: Llama 3.3 70B InstructAnthropic: Claude Haiku Latest
ProviderMetaAnthropic
Modalitytexttext, image
Context131K1M
Input$0.1/1M$0.1/1M
Output$0.32/1M$0.5/1M
Cache readNot published—$0.01/1M
Cache writeNot published—$0.125/1M
1-hour cache writeNot published—$0.2/1M
Tiers and extras
Meta: Llama 3.3 70B Instruct
—
Anthropic: Claude Haiku Latest
Web search: $0.01 per request; Above 100,000 prompt tokens: in $0.5 · out $2.5 · cache read $0.05 · cache write $0.625 · 1h cache write $1