theserverless.dev InferenceList

Compare

Add up to four models. The bill starts at 1M input tokens, 1M output tokens, and 1,000 units.

Monthly bill

Token models use the token counts. Other models use units times the flat rate.

Meta Llama 3 70B Instruct Turbo$1.76
Command A Plus Inp Glbl$4.00

Lowest bill: Meta Llama 3 70B Instruct Turbo · $1.76

Add another

Search by name, then add up to four.

Meta Llama 3 70B Instruct TurboCommand A Plus Inp Glbl
ProviderTogetherAzure
Modalitytexttext
Context8K—
Input$0.88/1M$0.8/1M
Output$0.88/1M$3.2/1M