theserverless.dev InferenceList

Compare

Add up to four models. The bill starts at 1M input tokens, 1M output tokens, and 1,000 units.

Monthly bill

Token models use the token counts. Other models use units times the flat rate.

Meta Llama 3.1 70B Instruct Turbo$1.76
Command A Plus Inp DZ$4.40

Lowest bill: Meta Llama 3.1 70B Instruct Turbo · $1.76

Add another

Search by name, then add up to four.

Meta Llama 3.1 70B Instruct TurboCommand A Plus Inp DZ
ProviderTogetherAzure
Modalitytexttext
Context131K—
Input$0.88/1M$0.88/1M
Output$0.88/1M$3.52/1M