theserverless.dev InferenceList

Compare

Add up to four models. The bill starts at 1M input tokens, 1M output tokens, and 1,000 units.

Monthly bill

Token models use the token counts. Other models use units times the flat rate.

Meta Llama 3.1 405B Instruct$7.00
aion-labs-aion-3-0$11.25

Lowest bill: Meta Llama 3.1 405B Instruct · $7.00

Add another

Search by name, then add up to four.

Meta Llama 3.1 405B Instructaion-labs-aion-3-0
ProviderTogetherVenice
Modalitytexttext
Context4K128K
Input$3.5/1M$3.75/1M
Output$3.5/1M$7.5/1M
Cache readNot published—$0.9375/1M